-- Logs begin at Sun 2022-08-07 00:10:25 UTC, end at Sun 2022-08-07 02:08:49 UTC. -- Aug 07 00:48:23.319308 dv-neutron-master-2-hyperv systemd[1]: Starting Devstack devstack@keystone.service... Aug 07 00:48:23.333135 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 07 00:48:23.336297 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 00:48:23 2022] *** Aug 07 00:48:23.336297 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 00:48:23.336297 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 00:48:23.336297 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: nodename: dv-neutron-master-2-hyperv Aug 07 00:48:23.336297 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: machine: x86_64 Aug 07 00:48:23.336297 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: clock source: unix Aug 07 00:48:23.336297 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: pcre jit disabled Aug 07 00:48:23.336297 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: detected number of CPU cores: 4 Aug 07 00:48:23.336297 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: current working directory: / Aug 07 00:48:23.336297 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: detected binary path: /usr/bin/uwsgi-core Aug 07 00:48:23.336868 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: your processes number limit is 47680 Aug 07 00:48:23.336868 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: your memory page size is 4096 bytes Aug 07 00:48:23.336868 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: detected max file descriptor number: 2048 Aug 07 00:48:23.336868 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: lock engine: pthread robust mutexes Aug 07 00:48:23.336868 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: thunder lock: enabled Aug 07 00:48:23.336868 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 07 00:48:23.337159 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 00:48:23.408277 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: Python main interpreter initialized at 0x559a0f4109c0 Aug 07 00:48:23.408277 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: python threads support enabled Aug 07 00:48:23.408277 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: your server socket listen backlog is limited to 100 connections Aug 07 00:48:23.408277 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: your mercy for graceful operations on workers is 90 seconds Aug 07 00:48:23.408820 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 00:48:23.408990 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: *** Operational MODE: preforking *** Aug 07 00:48:23.409449 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: *** uWSGI is running in multiple interpreter mode *** Aug 07 00:48:23.409449 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: spawned uWSGI master process (pid: 80501) Aug 07 00:48:23.409691 dv-neutron-master-2-hyperv systemd[1]: Started Devstack devstack@keystone.service. Aug 07 00:48:23.411076 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: spawned uWSGI worker 1 (pid: 80515, cores: 1) Aug 07 00:48:23.411186 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: spawned uWSGI worker 2 (pid: 80516, cores: 1) Aug 07 00:48:23.417380 dv-neutron-master-2-hyperv devstack@keystone.service[80501]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 00:48:29.187790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:48:29.187790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: from cryptography.utils import int_from_bytes Aug 07 00:48:29.189100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:48:29.189100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: from cryptography.utils import int_from_bytes Aug 07 00:48:29.241173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 00:48:29.241429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 00:48:29.241577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] command line args: [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 00:48:29.241788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 00:48:29.241972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ================================================================================ {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 00:48:29.242203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] admin_token = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.242450 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] config_dir = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.242645 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.242830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] config_source = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.243009 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] debug = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.243208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.243591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.243771 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.244035 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.244290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.245109 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] list_limit = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.245391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] log_config_append = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.245668 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.245945 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] log_dir = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.246230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] log_file = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.246580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.246940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.247308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.247668 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.247997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.248264 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.248631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.249172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.249402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.249730 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.250061 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.250389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.250729 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.251069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.251447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.252087 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.252361 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] publish_errors = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.252685 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.253006 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.253265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.253606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.253929 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.254258 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] standard_threads = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.254576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.254904 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.255193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.255457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] use_journal = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.255715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] use_json = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.256022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] use_stderr = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.256290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] use_syslog = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.256718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.257065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.257403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.257758 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.258095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.258446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.258783 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.259128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.259463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.259854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.260354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.260764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.261157 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.261548 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.261941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.262334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.262723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.263106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.263502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.263884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.264334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.264728 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.265220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.265657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.266008 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.266357 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.266692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.267022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.267350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.267679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.268067 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.268409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.268743 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.269067 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.269409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.269767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.270109 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.270457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.270784 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.271115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.271446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.271771 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.272167 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.272493 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.272816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.273398 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.273747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.274076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.274414 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.275063 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.275432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.276338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.276661 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.277008 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.277338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.277672 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.278001 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.278326 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.278651 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.279000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.279327 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.279654 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.280018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.280386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.280720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.281051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.281387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.281721 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.282079 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.282410 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.282748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.283108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.283438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.283764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.284125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.284471 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.284805 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.285146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.285524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.285859 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.286190 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.286523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.286850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.287224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.287585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.288029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.288389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.288721 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.289059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.289404 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.289735 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.290066 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.290391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.290714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.291039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.291966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.292293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.292634 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.292964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.293312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.293648 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.293998 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.294351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.294689 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.295015 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] auth.external = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.295337 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.295766 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.296136 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.296464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] auth.password = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.296786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] auth.token = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.297119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.297449 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.297791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.298119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.298463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.298808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.299128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.299453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] credential.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.299791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.300183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.300523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.300860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.301193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.301527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.301882 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.302232 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.302564 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.302908 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.303289 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.303628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.304029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.304418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.304768 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.305100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.305457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.305821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.306166 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.306496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.306955 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.307278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.307647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.308028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.308389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.308719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.309055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.309376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.309710 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.310047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.310375 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.310700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.311030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.311344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.311664 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.312050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.312403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.312727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.313054 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.313405 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.313741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.314076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.314420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.314766 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.315130 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.315496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.315860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.316254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.316584 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.316913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.317235 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.317560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.317901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.318230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.318576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.318895 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.319233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.319577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.319979 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.320292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.320645 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.320974 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.321303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.321624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.321959 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.322287 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.322695 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.323048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.323379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.323729 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.324114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.324437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.324758 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.325111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.325451 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.325803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.326111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.326436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.326757 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.327100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.327455 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.327779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.328154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.328493 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.328830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.329165 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.329485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.329818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.330149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.330477 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.330795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.331137 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.331473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.331808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.332181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.332596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.332847 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.333197 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.333527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.333853 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.334181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.334507 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.334841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.335184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.335512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.335857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.336237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.336572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.336899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.337230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.337558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.337893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.338770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.339090 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.339417 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.339753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.340127 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.340467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.340794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.341143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.341489 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.341814 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.342157 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.342488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.342815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.343145 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] role.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.343480 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] role.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.343799 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.344179 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.344519 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.344855 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.345198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.345537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.345871 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.346214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.346550 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.346873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.347211 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.347549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.347888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.348269 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.348795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.349118 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.349456 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.349852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.350321 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.350650 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.350934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.351239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.351539 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.351831 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.352150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.352428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.352701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.352997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.353305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.353600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.354552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.354888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.355164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.355505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] token.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.355896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.356237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.356580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.356987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.357329 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.357668 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.358006 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.358341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.358684 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.359015 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.359354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.359688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.360059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.360401 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.360723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.361055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.361445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.361803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.connection = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.362143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.362489 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.362820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.363151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.363482 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.363809 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.364188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.364518 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.364859 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.365214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.365555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.365896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.366244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.366579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.366917 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.367238 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.367569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.367936 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.368190 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 00:48:29.402847 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.403221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.403520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.415240 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.445988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.446236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.466845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:48:29.466845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: from cryptography.utils import int_from_bytes Aug 07 00:48:29.467824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:48:29.467824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: from cryptography.utils import int_from_bytes Aug 07 00:48:29.501777 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.559510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.559847 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.606227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 00:48:29.606468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 00:48:29.606609 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] command line args: [] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 00:48:29.606885 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 00:48:29.607064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ================================================================================ {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 00:48:29.607324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] admin_token = **** {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.607575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] config_dir = [] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.607765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.607976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] config_source = [] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.608178 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] debug = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.608360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.608603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.608783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.609039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.609290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.609525 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] list_limit = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.609708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] log_config_append = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.609890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.610072 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] log_dir = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.610254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] log_file = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.610496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.610752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.611005 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.611265 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.611443 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.611623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.611877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.612153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.612389 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.612627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.612863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.613099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.613356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.613605 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.613886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.614408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.614591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] publish_errors = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.614829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.615062 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.615240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.615491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.615726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.616000 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] standard_threads = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.616237 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.616485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.616664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.616841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] use_journal = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.617018 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] use_json = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.617193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] use_stderr = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.617371 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] use_syslog = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.617607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:48:29.617870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.618113 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.618363 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.618608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.618859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.619100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.619408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.620185 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.620442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.620697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.621161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.621415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.621670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.621912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.622166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.622422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.622664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.622923 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.623185 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.623437 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.623681 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.623965 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.624233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.624491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.624749 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.625224 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.625224 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.625696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.625896 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.626155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.626412 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.626646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.626884 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.627139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.627395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.627637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.627893 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.628153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.628395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.628640 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.628877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.629114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.629350 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.629588 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.629830 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.630086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.630321 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.630562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.630796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.631037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.631282 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.631537 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.631809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.632198 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.632447 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.632690 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.632935 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.633179 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.633415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.633671 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.633911 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.634157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.634395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.634726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.635006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.635347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.635697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.636083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.636517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.636772 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.637031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.637292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.637536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.637778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.638020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.638271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.638515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.638755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.639007 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.639247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.639492 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.639732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.640000 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.644577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.644577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.644577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.644577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.644577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.644577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.644577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.644577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.644577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.646369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.646369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.646369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.646648 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.646776 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.646889 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.646988 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.646988 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.647169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.647287 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.647421 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.647543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.647655 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.647768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.647886 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.648281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.648281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.648281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.648281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] auth.external = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.648281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.648281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.648281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.648281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] auth.password = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.648281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] auth.token = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.649208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.649208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.649208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.649208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.649208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.649208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.649838 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.649838 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] credential.caching = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.649838 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.650224 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.650651 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.650911 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.651167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.651417 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.651682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.651987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.652206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.652467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.652770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.653023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.653293 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.653537 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.653791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.654030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] federation.caching = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.654271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.654523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.654773 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.655009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.655331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.655506 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.655766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.656031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.656446 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.656691 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.656949 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.657292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity.caching = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.657490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.657692 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.657936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.658178 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.658435 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.658674 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.658918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.659176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.659437 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.659675 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.659936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.660170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.660421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.660677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.660932 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.661201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.661452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.661729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.661974 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.662218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.662453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.662694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.662930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.663171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.663421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.663667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.663941 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.664182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.664437 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.664690 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.664930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.665180 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.665439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.665679 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.665921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.666156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.667233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.667233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.667467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.667683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.667950 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.668211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.668465 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.668703 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.668940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.669196 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.669449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.669689 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.669930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.670167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.670406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.670653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.670920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.671157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.671408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.671659 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.671992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.672167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.672407 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.672644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.672881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.673122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.673357 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.673611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.673859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.674110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.674360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.674611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.674846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.675099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.675339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.675580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.675822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.676095 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.676345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.676599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.676838 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.677099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.677335 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.677582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.677826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.678066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.678309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.678560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.678805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.679041 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.679286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.679532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] resource.caching = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.679788 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.680067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.680307 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.680561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.680819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.681057 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.681312 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.681555 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.681692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.681875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.682602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] role.caching = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.682825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] role.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.683059 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.683197 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.683332 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.683550 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.683837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.683837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.684099 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.684229 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.684360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.684510 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.684510 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.684755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.684886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.685014 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.685216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.685216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.685474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.685728 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.685980 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.686231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.686676 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.686916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.687174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.687431 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.687688 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.687982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.688208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.688474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.688730 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.688976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.689214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.689454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.689691 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.689948 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.690209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.690491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.690701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.690943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.691187 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.691427 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] token.caching = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.691669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.691944 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.692194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.692457 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.692711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.692954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.693204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.693451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.693703 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.693944 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.694188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.694428 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.694680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.694933 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.695166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.695412 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.695715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.696091 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.connection = **** {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.696274 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.696530 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.696776 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.697022 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.697262 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.697906 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.697906 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.698362 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.698362 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.698608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.698793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.699034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.699289 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.699529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.699777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.700036 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.700284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.700523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:48:29.700766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 00:48:29.702253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.715707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.716000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.716145 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.716362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.716584 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.716798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.717009 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80515) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.726074 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.726330 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.726519 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.735859 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.736171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 00:48:29.736312 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.736538 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.736751 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 00:48:29.737039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.737303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.737567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.737825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.750725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.751039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.751311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.751592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.757111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.757476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.759283 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.762534 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.762819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.763120 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.763403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.763696 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.763983 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.764266 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.764541 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.764810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.765096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.765378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.789059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.790600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.790896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.796421 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.796767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.796982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.798324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.804235 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.804561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.809252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.809560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.809845 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.810129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.810405 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.810682 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.810952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.811218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.827432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.827796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.831775 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.835052 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.835353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.835586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.835785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.839957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.843189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.846442 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.846747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.847050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.847347 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.847626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.847931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.865673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.866036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.866240 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.866490 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.874435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.876065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.876346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.879224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.879508 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.879809 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.880208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.880490 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.884590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.884863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.885358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.885779 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.886060 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.886453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.892175 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.892474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.892760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.893044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.893327 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.893604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.893879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.900154 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.900399 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.901025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.901025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.901323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.901472 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.901592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.909879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.911600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.913028 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.913260 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.913487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.913712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.913931 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.914144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.914358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:48:29.914717 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.918364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.920323 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.921839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.922126 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.922420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.925871 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.926081 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 00:48:29.926440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.926645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 00:48:29.926941 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.927217 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.927482 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.927740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.929001 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.930622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.934218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.934513 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.934796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.935070 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.939176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.939541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.939879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.940276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.943246 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.943549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.943830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.948205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.951062 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80515) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.951361 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.951511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.951649 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.951866 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.952053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.952191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.952323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.952461 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.952706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.953187 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.953547 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.953667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.953784 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.953784 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.954174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.954313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.954439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.954663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.954663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.954912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.955038 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80515) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.955149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.955358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.956086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.979799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.981385 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.981675 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.986757 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.987052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.987340 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.989378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559a0f4109c0 pid: 80515 (default app) Aug 07 00:48:29.993133 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b5c05-0146-4a7f-ac44-f16d774a3137 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:29.993414 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b5c05-0146-4a7f-ac44-f16d774a3137 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:29.993689 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b5c05-0146-4a7f-ac44-f16d774a3137 None None] PATH_INFO: `/v3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:29.995458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:29.995760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:29.999382 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Sun Aug 7 00:48:29 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:48:30.002283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:30.002593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.002912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.003328 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.003736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.004197 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.004481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.004756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.021383 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.021674 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.026616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:30.030092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.030400 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.034794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:30.038046 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:30.042187 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.042591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.042901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.043181 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.043464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.043765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.060042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:30.060356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.060645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.060905 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.068151 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.069913 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.070199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.073027 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:30.073317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.073606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.073905 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.074191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.085841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:30.086136 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.086417 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.086700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.086989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.087270 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.087551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.106709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:30.108326 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:30.110811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.112476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.114134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:30.114424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.114743 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.129043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.129043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:30.129043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.129043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.129043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.129043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.136903 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:30.137193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.137509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.144832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:48:30.145171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.145458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.145741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.146026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.146304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.146602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.146875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.147153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.147442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.147715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.148280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.148564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.148835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:48:30.190917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559a0f4109c0 pid: 80516 (default app) Aug 07 00:48:38.540746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17f153-dcfd-4e77-8b72-3efe1e586417 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:38.541827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17f153-dcfd-4e77-8b72-3efe1e586417 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:38.541827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17f153-dcfd-4e77-8b72-3efe1e586417 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:38.543148 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:48:38.551043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac708ff-1e3f-495a-9ce2-4672ddbc5c25 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:38.551544 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac708ff-1e3f-495a-9ce2-4672ddbc5c25 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:38.551634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac708ff-1e3f-495a-9ce2-4672ddbc5c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:38.623823 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: INFO dbcounter [None req-7ac708ff-1e3f-495a-9ce2-4672ddbc5c25 None None] Registered counter for database keystone Aug 07 00:48:38.645096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG oslo_db.sqlalchemy.engines [None req-7ac708ff-1e3f-495a-9ce2-4672ddbc5c25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 00:48:38.652736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writer thread running {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 00:48:38.840991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG passlib.handlers.bcrypt [None req-7ac708ff-1e3f-495a-9ce2-4672ddbc5c25 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80516) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 00:48:38.841308 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG passlib.handlers.bcrypt [None req-7ac708ff-1e3f-495a-9ce2-4672ddbc5c25 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80516) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 00:48:38.898278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-7ac708ff-1e3f-495a-9ce2-4672ddbc5c25 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:38.899975 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7ac708ff-1e3f-495a-9ce2-4672ddbc5c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:48:39.044194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1/3] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 07 00:48:39.188377 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17f153-dcfd-4e77-8b72-3efe1e586417 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:39.258410 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: INFO dbcounter [None req-3c17f153-dcfd-4e77-8b72-3efe1e586417 None None] Registered counter for database keystone Aug 07 00:48:39.281875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG oslo_db.sqlalchemy.engines [None req-3c17f153-dcfd-4e77-8b72-3efe1e586417 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 00:48:39.288758 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writer thread running {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 00:48:39.418277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17f153-dcfd-4e77-8b72-3efe1e586417 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:39.422928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a000409-3cb6-4e51-a165-5605d9af46d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:39.423584 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a000409-3cb6-4e51-a165-5605d9af46d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:39.423868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a000409-3cb6-4e51-a165-5605d9af46d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:39.424177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a000409-3cb6-4e51-a165-5605d9af46d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:39.434265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a000409-3cb6-4e51-a165-5605d9af46d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:39.486622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7a000409-3cb6-4e51-a165-5605d9af46d9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 00:48:39.486958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a000409-3cb6-4e51-a165-5605d9af46d9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:39.498245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 3/4] 10.222.0.20 () {58 vars in 1324 bytes} [Sun Aug 7 00:48:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 00:48:39.504468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac708ff-1e3f-495a-9ce2-4672ddbc5c25 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:39.520253 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac708ff-1e3f-495a-9ce2-4672ddbc5c25 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:39.525145 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578f6a1-ac3b-4b01-94a4-1cb6afcfebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:39.526318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578f6a1-ac3b-4b01-94a4-1cb6afcfebc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:39.526599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578f6a1-ac3b-4b01-94a4-1cb6afcfebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:39.526870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578f6a1-ac3b-4b01-94a4-1cb6afcfebc0 admin admin] PATH_INFO: `/v3/projects/348c3b03b0964532b13e1c51a4b097f3` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:39.528452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578f6a1-ac3b-4b01-94a4-1cb6afcfebc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=348c3b03b0964532b13e1c51a4b097f3)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:39.582381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a578f6a1-ac3b-4b01-94a4-1cb6afcfebc0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 00:48:39.583048 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578f6a1-ac3b-4b01-94a4-1cb6afcfebc0 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:39.587506 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 2/5] 10.222.0.20 () {56 vars in 1207 bytes} [Sun Aug 7 00:48:39 2022] GET /identity/v3/projects/348c3b03b0964532b13e1c51a4b097f3 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:48:41.659535 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa673bd-8f1a-41a8-9d1f-3163732b2195 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:41.660105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa673bd-8f1a-41a8-9d1f-3163732b2195 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:41.660533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa673bd-8f1a-41a8-9d1f-3163732b2195 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:41.669091 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 4/6] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:41 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:48:41.675332 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b25078-4f4e-49e7-908c-2efac46c30ce None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:41.675831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b25078-4f4e-49e7-908c-2efac46c30ce None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:41.675982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b25078-4f4e-49e7-908c-2efac46c30ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:41.698680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e0b25078-4f4e-49e7-908c-2efac46c30ce None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:41.700277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e0b25078-4f4e-49e7-908c-2efac46c30ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:48:41.708229 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 3/7] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 07 00:48:41.749891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa673bd-8f1a-41a8-9d1f-3163732b2195 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:41.771083 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa673bd-8f1a-41a8-9d1f-3163732b2195 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:41.778371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725bc26-dfc8-4b7c-ad69-ce67163a140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:41.779400 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725bc26-dfc8-4b7c-ad69-ce67163a140d admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:41.779920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725bc26-dfc8-4b7c-ad69-ce67163a140d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:41.780416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725bc26-dfc8-4b7c-ad69-ce67163a140d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:41.795533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725bc26-dfc8-4b7c-ad69-ce67163a140d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:41.799004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725bc26-dfc8-4b7c-ad69-ce67163a140d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:41.813396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1324 bytes} [Sun Aug 7 00:48:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 00:48:41.819499 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b25078-4f4e-49e7-908c-2efac46c30ce None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:41.829254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b25078-4f4e-49e7-908c-2efac46c30ce None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:41.834043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c11012-c048-4561-a317-dc09a06a30d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:41.834690 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c11012-c048-4561-a317-dc09a06a30d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:41.834971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c11012-c048-4561-a317-dc09a06a30d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:41.835245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c11012-c048-4561-a317-dc09a06a30d6 admin admin] PATH_INFO: `/v3/users/9aada59ce5bc4a1481277a87a82e45b5` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:41.836645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c11012-c048-4561-a317-dc09a06a30d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=9aada59ce5bc4a1481277a87a82e45b5)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:41.838514 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c11012-c048-4561-a317-dc09a06a30d6 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:41.840147 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 4/9] 10.222.0.20 () {56 vars in 1198 bytes} [Sun Aug 7 00:48:41 2022] GET /identity/v3/users/9aada59ce5bc4a1481277a87a82e45b5 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:48:44.061121 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ad3b5-cbbc-40c4-924e-09a86a434a80 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:44.061708 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ad3b5-cbbc-40c4-924e-09a86a434a80 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:44.061708 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ad3b5-cbbc-40c4-924e-09a86a434a80 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:44.062997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:48:44.069666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca8840-394e-4a2d-a96e-13de6a30bd16 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:44.070212 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca8840-394e-4a2d-a96e-13de6a30bd16 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:44.070579 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca8840-394e-4a2d-a96e-13de6a30bd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:44.100157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-a7ca8840-394e-4a2d-a96e-13de6a30bd16 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:44.102144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a7ca8840-394e-4a2d-a96e-13de6a30bd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:48:44.240879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 5/11] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:48:44.264774 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ad3b5-cbbc-40c4-924e-09a86a434a80 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:44.323235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98798a-2c12-4ce7-89a3-0f59976c6c8d None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:44.323484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98798a-2c12-4ce7-89a3-0f59976c6c8d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:44.323702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98798a-2c12-4ce7-89a3-0f59976c6c8d None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:44.325350 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 6/12] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:48:44.331782 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ebaa-24a4-422b-aa00-56193d5f181b None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:44.332328 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ebaa-24a4-422b-aa00-56193d5f181b None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:44.332832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ebaa-24a4-422b-aa00-56193d5f181b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:44.365493 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3588ebaa-24a4-422b-aa00-56193d5f181b None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:44.367597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3588ebaa-24a4-422b-aa00-56193d5f181b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:48:44.396259 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:44.441076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ad3b5-cbbc-40c4-924e-09a86a434a80 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:44.466082 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:48:44.488852 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ebaa-24a4-422b-aa00-56193d5f181b None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:44.496376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897201b8-1d97-4de7-9060-63ce8e1c0fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:44.497808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897201b8-1d97-4de7-9060-63ce8e1c0fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:44.498300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897201b8-1d97-4de7-9060-63ce8e1c0fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:44.498766 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897201b8-1d97-4de7-9060-63ce8e1c0fc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:44.518633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897201b8-1d97-4de7-9060-63ce8e1c0fc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-897201b8-1d97-4de7-9060-63ce8e1c0fc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:48:44.533944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:48:44.535750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:48:44.537537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:48:44.537537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:48:44.537537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:48:44.537537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:48:44.537537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:48:44.537537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:48:44.537537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:48:44.537537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:48:44.537537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:48:44.537537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:48:44.537537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:48:44.537537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:48:44.537537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:48:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:48:44.545400 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897201b8-1d97-4de7-9060-63ce8e1c0fc5 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:44.596472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:44.611885 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ebaa-24a4-422b-aa00-56193d5f181b None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:44.657424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7a686-f13b-44ab-adad-2cc5b73375a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:44.658152 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7a686-f13b-44ab-adad-2cc5b73375a2 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:44.658497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7a686-f13b-44ab-adad-2cc5b73375a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:44.658833 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7a686-f13b-44ab-adad-2cc5b73375a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:44.688206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:44.694075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897201b8-1d97-4de7-9060-63ce8e1c0fc5 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:44.744527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e1b81-5854-407a-aaef-22d051edac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:44.745182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e1b81-5854-407a-aaef-22d051edac1f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:44.745464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e1b81-5854-407a-aaef-22d051edac1f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:44.745736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e1b81-5854-407a-aaef-22d051edac1f None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:44.746453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e1b81-5854-407a-aaef-22d051edac1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:48:44.746760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e1b81-5854-407a-aaef-22d051edac1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:44.748238 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e1b81-5854-407a-aaef-22d051edac1f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:44.755149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7a686-f13b-44ab-adad-2cc5b73375a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:44.756725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7a686-f13b-44ab-adad-2cc5b73375a2 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:44.762562 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:48:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:48:44.768959 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e1b81-5854-407a-aaef-22d051edac1f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:44.881395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:44.888821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e1b81-5854-407a-aaef-22d051edac1f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:44.926040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:48:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:48:44.932738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7a686-f13b-44ab-adad-2cc5b73375a2 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:44.938552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8811e-3c6b-498e-8a2c-c0f2fdcd2e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:44.939663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8811e-3c6b-498e-8a2c-c0f2fdcd2e01 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:44.940207 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8811e-3c6b-498e-8a2c-c0f2fdcd2e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:44.940704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8811e-3c6b-498e-8a2c-c0f2fdcd2e01 None admin] PATH_INFO: `/v3/users/9aada59ce5bc4a1481277a87a82e45b5` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:44.943685 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8811e-3c6b-498e-8a2c-c0f2fdcd2e01 None admin] RBAC: Authorizing `identity:get_user(user_id=9aada59ce5bc4a1481277a87a82e45b5)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:44.947037 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8811e-3c6b-498e-8a2c-c0f2fdcd2e01 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:44.950180 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:48:44 2022] GET /identity/v3/users/9aada59ce5bc4a1481277a87a82e45b5 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:48:44.956657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8811e-3c6b-498e-8a2c-c0f2fdcd2e01 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:45.002119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:45.081640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8811e-3c6b-498e-8a2c-c0f2fdcd2e01 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:45.089593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7a686-f13b-44ab-adad-2cc5b73375a2 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:45.129576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb8281-cd8f-45c6-94da-e7c87dc9b009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:45.130631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb8281-cd8f-45c6-94da-e7c87dc9b009 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:45.131122 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb8281-cd8f-45c6-94da-e7c87dc9b009 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:45.131675 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb8281-cd8f-45c6-94da-e7c87dc9b009 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:45.133004 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4fdbf-250b-4b8b-ac14-2c0b3fe32646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:45.133650 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4fdbf-250b-4b8b-ac14-2c0b3fe32646 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:45.133759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb8281-cd8f-45c6-94da-e7c87dc9b009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:45.133934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4fdbf-250b-4b8b-ac14-2c0b3fe32646 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:45.134780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4fdbf-250b-4b8b-ac14-2c0b3fe32646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:45.137317 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb8281-cd8f-45c6-94da-e7c87dc9b009 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:45.145527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:48:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:48:45.146802 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb8281-cd8f-45c6-94da-e7c87dc9b009 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:45.153202 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4fdbf-250b-4b8b-ac14-2c0b3fe32646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:45.154837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4fdbf-250b-4b8b-ac14-2c0b3fe32646 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-d4f4fdbf-250b-4b8b-ac14-2c0b3fe32646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:48:45.184735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:48:45.185857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:48:45.186920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:48:45.186920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:48:45.186920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:48:45.186920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:48:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:48:45.193443 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4fdbf-250b-4b8b-ac14-2c0b3fe32646 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:45.194409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:45.284202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb8281-cd8f-45c6-94da-e7c87dc9b009 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:45.320968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4fdbf-250b-4b8b-ac14-2c0b3fe32646 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:45.323774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:45.333055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d479c-6669-4152-9638-4dfeeb5ee777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:45.333967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d479c-6669-4152-9638-4dfeeb5ee777 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:45.334345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d479c-6669-4152-9638-4dfeeb5ee777 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:45.334741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d479c-6669-4152-9638-4dfeeb5ee777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:45.335603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d479c-6669-4152-9638-4dfeeb5ee777 None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.domain.id=default, user.id=9aada59ce5bc4a1481277a87a82e45b5) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:48:45.336047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d479c-6669-4152-9638-4dfeeb5ee777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:45.338395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d479c-6669-4152-9638-4dfeeb5ee777 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:45.347970 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Sun Aug 7 00:48:45 2022] GET /identity/v3/role_assignments?user.id=9aada59ce5bc4a1481277a87a82e45b5&scope.domain.id=default&role.id=638e1fc82db44124ae615c46408110a7 => generated 233 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:48:45.368651 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81080c-ec8a-40b3-86b0-7446cb44b052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:45.369759 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81080c-ec8a-40b3-86b0-7446cb44b052 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:45.370253 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81080c-ec8a-40b3-86b0-7446cb44b052 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:45.370745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81080c-ec8a-40b3-86b0-7446cb44b052 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:45.372023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81080c-ec8a-40b3-86b0-7446cb44b052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:48:45.372580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81080c-ec8a-40b3-86b0-7446cb44b052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:45.375384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81080c-ec8a-40b3-86b0-7446cb44b052 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:45.411410 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:48:47.708596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0e7f-86f2-42bf-9fd4-71f2e6dc524e None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:47.709588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0e7f-86f2-42bf-9fd4-71f2e6dc524e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:47.710099 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd0e7f-86f2-42bf-9fd4-71f2e6dc524e None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:47.711864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:48:47.718600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c54607-70e5-46d1-bb3f-834599b09655 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:47.719570 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c54607-70e5-46d1-bb3f-834599b09655 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:47.720124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c54607-70e5-46d1-bb3f-834599b09655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:47.741314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-43c54607-70e5-46d1-bb3f-834599b09655 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:47.743350 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-43c54607-70e5-46d1-bb3f-834599b09655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:48:47.844074 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:48:47.879945 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd0e7f-86f2-42bf-9fd4-71f2e6dc524e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:47.992905 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a4261-20b9-45b8-b907-c9e8db5e0292 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:47.994158 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a4261-20b9-45b8-b907-c9e8db5e0292 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:47.994943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a4261-20b9-45b8-b907-c9e8db5e0292 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:47.996729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:48:48.005394 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b64c7c-6a30-4dfd-93d1-2ac7a2f03205 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:48.005995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b64c7c-6a30-4dfd-93d1-2ac7a2f03205 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:48.006467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b64c7c-6a30-4dfd-93d1-2ac7a2f03205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:48.034801 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:48.049065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-d5b64c7c-6a30-4dfd-93d1-2ac7a2f03205 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:48.050678 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d5b64c7c-6a30-4dfd-93d1-2ac7a2f03205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:48:48.053769 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd0e7f-86f2-42bf-9fd4-71f2e6dc524e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:48.119936 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f93319-15d3-431a-81a3-5e8b5d5dbcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:48.121091 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f93319-15d3-431a-81a3-5e8b5d5dbcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:48.121586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f93319-15d3-431a-81a3-5e8b5d5dbcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:48.122060 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f93319-15d3-431a-81a3-5e8b5d5dbcb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:48.137379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f93319-15d3-431a-81a3-5e8b5d5dbcb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-d6f93319-15d3-431a-81a3-5e8b5d5dbcb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:48:48.142866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:48:48.143808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:48:48.144609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:48:48.144609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:48:48.144609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:48:48.144609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:48:48.144609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:48:48.144609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:48:48.144609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:48:48.144609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:48:48.144609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:48:48.144609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:48:48.144609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:48:48.144609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:48:48.147026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 13/25] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:48:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:48:48.149356 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef758b03-8049-49cb-b85a-e19626202b07 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:48.150548 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef758b03-8049-49cb-b85a-e19626202b07 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:48.151658 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef758b03-8049-49cb-b85a-e19626202b07 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:48.154686 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 14/26] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:48:48.155767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef758b03-8049-49cb-b85a-e19626202b07 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:48.204354 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 13/27] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:48:48.205982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d27a7-9de9-4173-a6bd-04b1c1ffdeec None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:48.208909 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d27a7-9de9-4173-a6bd-04b1c1ffdeec None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:48.209473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d27a7-9de9-4173-a6bd-04b1c1ffdeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:48.250339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e91d27a7-9de9-4173-a6bd-04b1c1ffdeec None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:48.252331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e91d27a7-9de9-4173-a6bd-04b1c1ffdeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:48:48.315122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:48.347517 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef758b03-8049-49cb-b85a-e19626202b07 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:48.422500 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846cf1f-32f2-43f2-8704-323f755ff5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:48.423526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846cf1f-32f2-43f2-8704-323f755ff5aa None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:48.424034 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846cf1f-32f2-43f2-8704-323f755ff5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:48.424503 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846cf1f-32f2-43f2-8704-323f755ff5aa None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:48.425420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846cf1f-32f2-43f2-8704-323f755ff5aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:48:48.428252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846cf1f-32f2-43f2-8704-323f755ff5aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:48.429962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846cf1f-32f2-43f2-8704-323f755ff5aa None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:48.451776 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 15/28] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:48:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:48:48.453007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846cf1f-32f2-43f2-8704-323f755ff5aa None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:48.463939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 14/29] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:48:48.471658 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d27a7-9de9-4173-a6bd-04b1c1ffdeec None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:48.499749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:48.670121 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d27a7-9de9-4173-a6bd-04b1c1ffdeec None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:48.724650 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78350241-ea75-4008-99e8-bcf32dae422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:48.725301 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78350241-ea75-4008-99e8-bcf32dae422f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:48.725580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78350241-ea75-4008-99e8-bcf32dae422f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:48.726531 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78350241-ea75-4008-99e8-bcf32dae422f None admin] PATH_INFO: `/v3/users/9aada59ce5bc4a1481277a87a82e45b5` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:48.727167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78350241-ea75-4008-99e8-bcf32dae422f None admin] RBAC: Authorizing `identity:get_user(user_id=9aada59ce5bc4a1481277a87a82e45b5)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:48.728895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78350241-ea75-4008-99e8-bcf32dae422f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:48.732116 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 15/30] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:48:48 2022] GET /identity/v3/users/9aada59ce5bc4a1481277a87a82e45b5 => generated 247 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:48:48.733056 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78350241-ea75-4008-99e8-bcf32dae422f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:48.757605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846cf1f-32f2-43f2-8704-323f755ff5aa None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:48.782951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:48.802165 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2de3f9-4764-48a8-a98e-64bce28821a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:48.803202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2de3f9-4764-48a8-a98e-64bce28821a4 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:48.803706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2de3f9-4764-48a8-a98e-64bce28821a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:48.804203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2de3f9-4764-48a8-a98e-64bce28821a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:48.805107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2de3f9-4764-48a8-a98e-64bce28821a4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:48.807679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2de3f9-4764-48a8-a98e-64bce28821a4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:48.915740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78350241-ea75-4008-99e8-bcf32dae422f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:48.955957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 16/31] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Aug 7 00:48:48 2022] POST /identity/v3/roles => generated 219 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:48:48.957373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2de3f9-4764-48a8-a98e-64bce28821a4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:48.977854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccd679-963c-4ef5-9b48-c13d98ac8494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:48.978382 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccd679-963c-4ef5-9b48-c13d98ac8494 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:48.978656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccd679-963c-4ef5-9b48-c13d98ac8494 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:48.978926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccd679-963c-4ef5-9b48-c13d98ac8494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:49.004768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccd679-963c-4ef5-9b48-c13d98ac8494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:49.006309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccd679-963c-4ef5-9b48-c13d98ac8494 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:49.100385 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:49.131598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2de3f9-4764-48a8-a98e-64bce28821a4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:49.189073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a93be-689e-4f92-a174-765280b1b902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:49.190315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a93be-689e-4f92-a174-765280b1b902 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:49.190838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a93be-689e-4f92-a174-765280b1b902 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:49.191368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a93be-689e-4f92-a174-765280b1b902 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:49.193137 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a93be-689e-4f92-a174-765280b1b902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:49.195245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a93be-689e-4f92-a174-765280b1b902 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:49.198314 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 17/32] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:48:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:48:49.213364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a93be-689e-4f92-a174-765280b1b902 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-64ccd679-963c-4ef5-9b48-c13d98ac8494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:48:49.241904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:48:49.242850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:48:49.245566 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:48:49.245566 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:48:49.245566 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:48:49.245566 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 16/33] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:48:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 512 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:48:49.257731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccd679-963c-4ef5-9b48-c13d98ac8494 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:49.412494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:49.463033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccd679-963c-4ef5-9b48-c13d98ac8494 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:49.535210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a93be-689e-4f92-a174-765280b1b902 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:49.538896 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a383b7-bfff-4560-ac32-d5f3914b1598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:49.539533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a383b7-bfff-4560-ac32-d5f3914b1598 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:49.539878 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a383b7-bfff-4560-ac32-d5f3914b1598 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:49.540908 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a383b7-bfff-4560-ac32-d5f3914b1598 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:49.541414 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a383b7-bfff-4560-ac32-d5f3914b1598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:48:49.541845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a383b7-bfff-4560-ac32-d5f3914b1598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:49.543275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a383b7-bfff-4560-ac32-d5f3914b1598 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:49.565580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 17/34] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:48:49.566984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a383b7-bfff-4560-ac32-d5f3914b1598 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:49.621418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d5210-cc02-43a4-9a9e-942760ffe22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:49.622539 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d5210-cc02-43a4-9a9e-942760ffe22c None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:49.623036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d5210-cc02-43a4-9a9e-942760ffe22c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:49.623543 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d5210-cc02-43a4-9a9e-942760ffe22c None admin] PATH_INFO: `/v3/domains/default/users/9aada59ce5bc4a1481277a87a82e45b5/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:49.626265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d5210-cc02-43a4-9a9e-942760ffe22c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9aada59ce5bc4a1481277a87a82e45b5, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:49.628346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d5210-cc02-43a4-9a9e-942760ffe22c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:49.667423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 18/35] 10.222.0.20 () {58 vars in 1361 bytes} [Sun Aug 7 00:48:49 2022] PUT /identity/v3/domains/default/users/9aada59ce5bc4a1481277a87a82e45b5/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:48:49.720765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a383b7-bfff-4560-ac32-d5f3914b1598 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:49.776909 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5855b-b0ee-4e0b-98b8-12b05b5aaa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:49.777581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5855b-b0ee-4e0b-98b8-12b05b5aaa55 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:49.777844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5855b-b0ee-4e0b-98b8-12b05b5aaa55 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:49.778102 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5855b-b0ee-4e0b-98b8-12b05b5aaa55 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:49.778815 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5855b-b0ee-4e0b-98b8-12b05b5aaa55 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:49.780523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5855b-b0ee-4e0b-98b8-12b05b5aaa55 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:49.789299 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5bec-de22-40d0-9eaa-7a8b99499104 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:49.789880 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5bec-de22-40d0-9eaa-7a8b99499104 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:49.789880 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5bec-de22-40d0-9eaa-7a8b99499104 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:49.791493 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:48:49.794717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:49.797945 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9737876-f1e9-46ee-8902-928fdd248de8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:49.798253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9737876-f1e9-46ee-8902-928fdd248de8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:49.798554 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9737876-f1e9-46ee-8902-928fdd248de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:49.823295 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:49.829978 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG passlib.handlers.bcrypt [None req-b9737876-f1e9-46ee-8902-928fdd248de8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80515) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 00:48:49.831824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG passlib.handlers.bcrypt [None req-b9737876-f1e9-46ee-8902-928fdd248de8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80515) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 00:48:49.883743 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b9737876-f1e9-46ee-8902-928fdd248de8 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:49.886672 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b9737876-f1e9-46ee-8902-928fdd248de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:48:49.972193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Aug 7 00:48:49 2022] POST /identity/v3/projects => generated 301 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:48:49.973952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7ec36-74d1-42f8-b84e-3f665a47ce6d None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:49.974220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7ec36-74d1-42f8-b84e-3f665a47ce6d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:49.974529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7ec36-74d1-42f8-b84e-3f665a47ce6d None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:49.975885 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 19/38] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:48:49.984721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3d8b4-bf5e-44f9-8f17-2445840e0d9b None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:49.985024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3d8b4-bf5e-44f9-8f17-2445840e0d9b None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:49.985285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3d8b4-bf5e-44f9-8f17-2445840e0d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:50.021205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 20/39] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:48:50.023324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-28a3d8b4-bf5e-44f9-8f17-2445840e0d9b None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:50.026345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-28a3d8b4-bf5e-44f9-8f17-2445840e0d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:48:50.065019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9737876-f1e9-46ee-8902-928fdd248de8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:50.129923 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 20/40] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:48:50.169038 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3d8b4-bf5e-44f9-8f17-2445840e0d9b None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:50.254794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9737876-f1e9-46ee-8902-928fdd248de8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:50.313113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee48d5-f3cb-4581-8a1b-f985088851b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:50.314117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee48d5-f3cb-4581-8a1b-f985088851b0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:50.314911 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee48d5-f3cb-4581-8a1b-f985088851b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:50.315203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee48d5-f3cb-4581-8a1b-f985088851b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:50.318229 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee48d5-f3cb-4581-8a1b-f985088851b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:50.319788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee48d5-f3cb-4581-8a1b-f985088851b0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:50.320887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3d8b4-bf5e-44f9-8f17-2445840e0d9b None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:50.321606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 21/41] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:48:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:48:50.328441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee48d5-f3cb-4581-8a1b-f985088851b0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:50.332464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:50.345985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:50.368127 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242d2d3-bb72-48e6-98e3-a6856d25feb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:50.369031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242d2d3-bb72-48e6-98e3-a6856d25feb1 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:50.369615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242d2d3-bb72-48e6-98e3-a6856d25feb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:50.369999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242d2d3-bb72-48e6-98e3-a6856d25feb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:50.370816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242d2d3-bb72-48e6-98e3-a6856d25feb1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:50.372607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242d2d3-bb72-48e6-98e3-a6856d25feb1 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:50.393211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Aug 7 00:48:50 2022] POST /identity/v3/roles => generated 225 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:48:50.455842 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee48d5-f3cb-4581-8a1b-f985088851b0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:50.498207 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4afcc-1c0c-4b9b-b9eb-83c22b45590b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:50.499124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4afcc-1c0c-4b9b-b9eb-83c22b45590b None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:50.499561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4afcc-1c0c-4b9b-b9eb-83c22b45590b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:50.500020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4afcc-1c0c-4b9b-b9eb-83c22b45590b None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:50.500904 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4afcc-1c0c-4b9b-b9eb-83c22b45590b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:50.502631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4afcc-1c0c-4b9b-b9eb-83c22b45590b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:50.553030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 22/43] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Aug 7 00:48:50 2022] POST /identity/v3/projects => generated 312 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:48:50.657558 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f0ef7-bc11-47c2-be48-60b11fe4c32c None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:50.658058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f0ef7-bc11-47c2-be48-60b11fe4c32c None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:50.658585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f0ef7-bc11-47c2-be48-60b11fe4c32c None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:50.661175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 22/44] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:48:50.670325 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9e816-945a-429a-b5a1-e875b552014d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:50.670990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9e816-945a-429a-b5a1-e875b552014d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:50.671330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9e816-945a-429a-b5a1-e875b552014d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:50.700790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-aba9e816-945a-429a-b5a1-e875b552014d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:50.702935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-aba9e816-945a-429a-b5a1-e875b552014d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:48:50.768050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:50.791662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 23/45] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:48:50.813789 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f0ef7-bc11-47c2-be48-60b11fe4c32c None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:50.938136 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f0ef7-bc11-47c2-be48-60b11fe4c32c None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:50.978625 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54686b62-100a-4c67-86a5-574fffa4cd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:50.979415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54686b62-100a-4c67-86a5-574fffa4cd21 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:50.979829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54686b62-100a-4c67-86a5-574fffa4cd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:50.980278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54686b62-100a-4c67-86a5-574fffa4cd21 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:50.981087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54686b62-100a-4c67-86a5-574fffa4cd21 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:50.982678 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54686b62-100a-4c67-86a5-574fffa4cd21 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:51.007935 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Aug 7 00:48:50 2022] POST /identity/v3/roles => generated 223 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:48:52.677375 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f52ae-6fcc-47e0-ae35-dbb29e478a8a None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:52.677964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f52ae-6fcc-47e0-ae35-dbb29e478a8a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:52.678337 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f52ae-6fcc-47e0-ae35-dbb29e478a8a None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:52.681877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:48:52.691170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f907-d1f9-441d-9f0c-c59f98d617ff None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:52.691792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f907-d1f9-441d-9f0c-c59f98d617ff None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:52.692410 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f907-d1f9-441d-9f0c-c59f98d617ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:52.712797 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5ec2f907-d1f9-441d-9f0c-c59f98d617ff None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:52.714052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5ec2f907-d1f9-441d-9f0c-c59f98d617ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:48:52.747547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:52.792312 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:48:52.816374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f52ae-6fcc-47e0-ae35-dbb29e478a8a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:53.001861 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f52ae-6fcc-47e0-ae35-dbb29e478a8a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:53.042317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d3bc0-0de1-421f-b54d-e771393c3495 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:53.042757 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d3bc0-0de1-421f-b54d-e771393c3495 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:53.042887 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713e175-d05f-428c-bb7c-6d412eef4b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:53.043199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d3bc0-0de1-421f-b54d-e771393c3495 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:53.043753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713e175-d05f-428c-bb7c-6d412eef4b6a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:53.044224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713e175-d05f-428c-bb7c-6d412eef4b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:53.044668 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713e175-d05f-428c-bb7c-6d412eef4b6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:53.045569 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 25/49] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:48:53.046544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713e175-d05f-428c-bb7c-6d412eef4b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:53.049333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713e175-d05f-428c-bb7c-6d412eef4b6a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:53.052374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 25/50] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:48:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:48:53.053717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37286275-cd31-49f0-9f9b-245ee0490216 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:53.054044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37286275-cd31-49f0-9f9b-245ee0490216 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:53.054359 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37286275-cd31-49f0-9f9b-245ee0490216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:53.059257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713e175-d05f-428c-bb7c-6d412eef4b6a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:53.076551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-37286275-cd31-49f0-9f9b-245ee0490216 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:53.077921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-37286275-cd31-49f0-9f9b-245ee0490216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:48:53.127573 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:53.162310 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 26/51] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:48:53.182794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713e175-d05f-428c-bb7c-6d412eef4b6a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:53.189632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37286275-cd31-49f0-9f9b-245ee0490216 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:53.231490 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824532b-d227-4bd2-bd1a-47cf70437ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:53.232505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824532b-d227-4bd2-bd1a-47cf70437ede None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:53.232961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824532b-d227-4bd2-bd1a-47cf70437ede None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:53.233416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824532b-d227-4bd2-bd1a-47cf70437ede None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:53.234486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824532b-d227-4bd2-bd1a-47cf70437ede None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:53.236613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824532b-d227-4bd2-bd1a-47cf70437ede None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:53.275434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1140 bytes} [Sun Aug 7 00:48:53 2022] POST /identity/v3/projects => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:48:53.328010 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:53.339520 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37286275-cd31-49f0-9f9b-245ee0490216 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:53.398247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80150ba-e010-4838-983e-5d5c4c1c940d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:53.400355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80150ba-e010-4838-983e-5d5c4c1c940d None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:53.400805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80150ba-e010-4838-983e-5d5c4c1c940d None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:53.401216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80150ba-e010-4838-983e-5d5c4c1c940d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:53.422482 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80150ba-e010-4838-983e-5d5c4c1c940d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-e80150ba-e010-4838-983e-5d5c4c1c940d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:48:53.435613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:48:53.437232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:48:53.439242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:48:53.439242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:48:53.439242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:48:53.439242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:48:53.439242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:48:53.439242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:48:53.439242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:48:53.439242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:48:53.439242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:48:53.439242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:48:53.439242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:48:53.439242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:48:53.439242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:48:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:48:53.446651 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824532b-d227-4bd2-bd1a-47cf70437ede None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:53.597325 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824532b-d227-4bd2-bd1a-47cf70437ede None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:53.612285 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:53.653855 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334313af-402e-4a97-bf82-3018b33585d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:53.654590 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334313af-402e-4a97-bf82-3018b33585d6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:53.654953 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334313af-402e-4a97-bf82-3018b33585d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:53.655314 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334313af-402e-4a97-bf82-3018b33585d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:53.656134 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334313af-402e-4a97-bf82-3018b33585d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:48:53.656521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334313af-402e-4a97-bf82-3018b33585d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:53.658018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334313af-402e-4a97-bf82-3018b33585d6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:53.668597 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 27/54] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:48:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:48:53.676415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80150ba-e010-4838-983e-5d5c4c1c940d None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:53.797923 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80150ba-e010-4838-983e-5d5c4c1c940d None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:53.843714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bf64c-0d6e-401e-8bbc-0ca1a6e11dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:53.844495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bf64c-0d6e-401e-8bbc-0ca1a6e11dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:53.844842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bf64c-0d6e-401e-8bbc-0ca1a6e11dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:53.845187 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bf64c-0d6e-401e-8bbc-0ca1a6e11dd0 None admin] PATH_INFO: `/v3/users/9aada59ce5bc4a1481277a87a82e45b5` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:53.846561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bf64c-0d6e-401e-8bbc-0ca1a6e11dd0 None admin] RBAC: Authorizing `identity:get_user(user_id=9aada59ce5bc4a1481277a87a82e45b5)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:53.848762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bf64c-0d6e-401e-8bbc-0ca1a6e11dd0 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:53.850857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:48:53 2022] GET /identity/v3/users/9aada59ce5bc4a1481277a87a82e45b5 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:48:53.857780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334313af-402e-4a97-bf82-3018b33585d6 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:54.009129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334313af-402e-4a97-bf82-3018b33585d6 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:54.051426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6ebbc-e077-415f-88bd-2f4dad4d063d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:54.052194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6ebbc-e077-415f-88bd-2f4dad4d063d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:54.052528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6ebbc-e077-415f-88bd-2f4dad4d063d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:54.052857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6ebbc-e077-415f-88bd-2f4dad4d063d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:54.054094 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6ebbc-e077-415f-88bd-2f4dad4d063d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:54.055674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6ebbc-e077-415f-88bd-2f4dad4d063d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:54.057424 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 28/56] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:48:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:48:54.063818 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bf64c-0d6e-401e-8bbc-0ca1a6e11dd0 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:54.093097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:54.189328 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bf64c-0d6e-401e-8bbc-0ca1a6e11dd0 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:54.230656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31865009-3daf-4f6b-ac19-ee585afc9716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:54.231402 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31865009-3daf-4f6b-ac19-ee585afc9716 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:54.231789 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31865009-3daf-4f6b-ac19-ee585afc9716 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:54.232187 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31865009-3daf-4f6b-ac19-ee585afc9716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:54.233125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31865009-3daf-4f6b-ac19-ee585afc9716 None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.domain.id=default, user.id=9aada59ce5bc4a1481277a87a82e45b5) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:48:54.233530 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31865009-3daf-4f6b-ac19-ee585afc9716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:54.235093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31865009-3daf-4f6b-ac19-ee585afc9716 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:54.243871 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1322 bytes} [Sun Aug 7 00:48:54 2022] GET /identity/v3/role_assignments?user.id=9aada59ce5bc4a1481277a87a82e45b5&scope.domain.id=default&role.id=638e1fc82db44124ae615c46408110a7 => generated 530 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:48:55.498515 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466e6e3-4c90-414e-ad8b-83a617d83338 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:55.499127 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466e6e3-4c90-414e-ad8b-83a617d83338 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:55.499127 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466e6e3-4c90-414e-ad8b-83a617d83338 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:55.500480 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 29/58] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:48:55.506406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9f251-c1bb-41ab-8d9f-afd9296cf3a7 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:55.506981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9f251-c1bb-41ab-8d9f-afd9296cf3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:55.506981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9f251-c1bb-41ab-8d9f-afd9296cf3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:55.528306 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-08b9f251-c1bb-41ab-8d9f-afd9296cf3a7 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:55.529567 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-08b9f251-c1bb-41ab-8d9f-afd9296cf3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:48:55.610784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 30/59] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:48:55.636853 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466e6e3-4c90-414e-ad8b-83a617d83338 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:55.679642 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:55.752808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466e6e3-4c90-414e-ad8b-83a617d83338 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:55.791298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223623c-7b82-46fc-a3c5-042956c22c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:55.791962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223623c-7b82-46fc-a3c5-042956c22c5a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:55.792252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223623c-7b82-46fc-a3c5-042956c22c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:55.792528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223623c-7b82-46fc-a3c5-042956c22c5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:55.793699 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223623c-7b82-46fc-a3c5-042956c22c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:55.795156 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223623c-7b82-46fc-a3c5-042956c22c5a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:55.796817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 30/60] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:48:55.802866 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9f251-c1bb-41ab-8d9f-afd9296cf3a7 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:55.823782 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:55.926697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9f251-c1bb-41ab-8d9f-afd9296cf3a7 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:55.968850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4b143-c190-40c3-a8b1-7019ed562b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:55.969485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4b143-c190-40c3-a8b1-7019ed562b34 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:55.969770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4b143-c190-40c3-a8b1-7019ed562b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:55.970042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4b143-c190-40c3-a8b1-7019ed562b34 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:55.970725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4b143-c190-40c3-a8b1-7019ed562b34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:48:55.972312 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4b143-c190-40c3-a8b1-7019ed562b34 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:48:56.002917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 31/61] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:48:55 2022] POST /identity/v3/users => generated 275 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:48:59.400220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c903487-fc49-4fd6-bc1c-8188a685eede None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:59.401550 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c903487-fc49-4fd6-bc1c-8188a685eede None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:59.402058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c903487-fc49-4fd6-bc1c-8188a685eede None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:59.403723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 31/62] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:48:59.409658 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80b547-19dc-4ea5-b2e6-0dcd874e96c4 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:59.410575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80b547-19dc-4ea5-b2e6-0dcd874e96c4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:59.411064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80b547-19dc-4ea5-b2e6-0dcd874e96c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:59.441157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-ee80b547-19dc-4ea5-b2e6-0dcd874e96c4 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:59.442749 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ee80b547-19dc-4ea5-b2e6-0dcd874e96c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:48:59.538844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 32/63] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:48:59.575129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c903487-fc49-4fd6-bc1c-8188a685eede None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:59.684148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa4d50-e7d8-4455-bbc2-b7159b995a10 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:59.684754 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa4d50-e7d8-4455-bbc2-b7159b995a10 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:59.685254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa4d50-e7d8-4455-bbc2-b7159b995a10 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:59.686886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 33/64] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:48:59.696832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0a5a3-17ef-4d3b-9a6c-213efa7cac76 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:59.698153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0a5a3-17ef-4d3b-9a6c-213efa7cac76 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:59.699161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0a5a3-17ef-4d3b-9a6c-213efa7cac76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:59.748357 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:59.765680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-55c0a5a3-17ef-4d3b-9a6c-213efa7cac76 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:59.767680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-55c0a5a3-17ef-4d3b-9a6c-213efa7cac76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:48:59.793545 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c903487-fc49-4fd6-bc1c-8188a685eede None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:48:59.798115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:48:59.863712 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7279d2-d033-4c7b-85a0-e636b0bbf608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:48:59.864408 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7279d2-d033-4c7b-85a0-e636b0bbf608 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:59.864816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7279d2-d033-4c7b-85a0-e636b0bbf608 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:59.865100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7279d2-d033-4c7b-85a0-e636b0bbf608 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:59.882709 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7279d2-d033-4c7b-85a0-e636b0bbf608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-db7279d2-d033-4c7b-85a0-e636b0bbf608 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:48:59.896601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:48:59.898827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:48:59.900829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:48:59.900829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:48:59.900829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:48:59.900829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:48:59.900829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:48:59.900829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:48:59.900829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:48:59.900829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:48:59.900829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:48:59.900829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:48:59.900829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:48:59.900829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:48:59.904503 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 32/65] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:48:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:48:59.909047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6e18e-f724-4f55-8583-2e297b080011 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:59.909792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6e18e-f724-4f55-8583-2e297b080011 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:59.910756 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6e18e-f724-4f55-8583-2e297b080011 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:59.914925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 33/66] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:48:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:48:59.916840 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6e18e-f724-4f55-8583-2e297b080011 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:48:59.930299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 34/67] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:48:59.931997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353e298-62d8-44ad-aa7a-9b3e752dc9e5 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:48:59.932663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353e298-62d8-44ad-aa7a-9b3e752dc9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:48:59.933141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353e298-62d8-44ad-aa7a-9b3e752dc9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:48:59.971152 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-6353e298-62d8-44ad-aa7a-9b3e752dc9e5 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:48:59.973086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-6353e298-62d8-44ad-aa7a-9b3e752dc9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:00.063569 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 35/68] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:00.066715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353e298-62d8-44ad-aa7a-9b3e752dc9e5 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:00.137108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d6e18e-f724-4f55-8583-2e297b080011 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:00.174232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:00.178679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bc851-01fd-413a-bdb5-da18e99bd63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:00.179541 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bc851-01fd-413a-bdb5-da18e99bd63f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:00.181302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bc851-01fd-413a-bdb5-da18e99bd63f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:00.181784 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bc851-01fd-413a-bdb5-da18e99bd63f None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:00.182946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bc851-01fd-413a-bdb5-da18e99bd63f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:00.183481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bc851-01fd-413a-bdb5-da18e99bd63f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:00.185970 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bc851-01fd-413a-bdb5-da18e99bd63f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:00.207938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:48:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:00.207938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7f8d-1926-4fda-bd68-b0ec9f637c10 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:00.207938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7f8d-1926-4fda-bd68-b0ec9f637c10 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:00.207938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7f8d-1926-4fda-bd68-b0ec9f637c10 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:00.207938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 35/70] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:00.207938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a7f8d-1926-4fda-bd68-b0ec9f637c10 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:00.238808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:00.250621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353e298-62d8-44ad-aa7a-9b3e752dc9e5 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:00.301414 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a4be5-996c-4f90-89dc-8c7fcadfae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:00.302072 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a4be5-996c-4f90-89dc-8c7fcadfae70 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:00.302366 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a4be5-996c-4f90-89dc-8c7fcadfae70 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:00.302634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a4be5-996c-4f90-89dc-8c7fcadfae70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:00.314828 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a4be5-996c-4f90-89dc-8c7fcadfae70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-010a4be5-996c-4f90-89dc-8c7fcadfae70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:00.320254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:00.322390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:00.324794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:00.324794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:00.324794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:00.324794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:00.324794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:00.324794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:00.324794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:00.324794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:00.324794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:00.324794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:00.324794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:00.324794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:00.324794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:00.324794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a4be5-996c-4f90-89dc-8c7fcadfae70 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:00.348603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a7f8d-1926-4fda-bd68-b0ec9f637c10 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:00.393323 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5d2ee-6750-47a1-8e1c-afe4cfac5749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:00.394237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5d2ee-6750-47a1-8e1c-afe4cfac5749 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:00.394691 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5d2ee-6750-47a1-8e1c-afe4cfac5749 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:00.395284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5d2ee-6750-47a1-8e1c-afe4cfac5749 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:00.410307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5d2ee-6750-47a1-8e1c-afe4cfac5749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e8e5d2ee-6750-47a1-8e1c-afe4cfac5749 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:00.417577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:00.419302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:00.421582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:00.421582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:00.421582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:00.421582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:00.421582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:00.421582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:00.421582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:00.421582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:00.421582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:00.421582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:00.421582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:00.421582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:00.421582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 36/72] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:49:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:00.426111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d70c0-e117-41d8-aa6c-8b0b7e3a56e2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:00.426615 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d70c0-e117-41d8-aa6c-8b0b7e3a56e2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:00.427222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d70c0-e117-41d8-aa6c-8b0b7e3a56e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:00.451262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9e3d70c0-e117-41d8-aa6c-8b0b7e3a56e2 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:00.453263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9e3d70c0-e117-41d8-aa6c-8b0b7e3a56e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:00.459150 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a4be5-996c-4f90-89dc-8c7fcadfae70 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:00.499735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:00.517467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66327fe3-cec9-4db9-a322-a8385a71d5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:00.518474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66327fe3-cec9-4db9-a322-a8385a71d5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:00.518934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66327fe3-cec9-4db9-a322-a8385a71d5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:00.519381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66327fe3-cec9-4db9-a322-a8385a71d5d3 None admin] PATH_INFO: `/v3/users/9aada59ce5bc4a1481277a87a82e45b5` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:00.521231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66327fe3-cec9-4db9-a322-a8385a71d5d3 None admin] RBAC: Authorizing `identity:get_user(user_id=9aada59ce5bc4a1481277a87a82e45b5)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:00.525133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66327fe3-cec9-4db9-a322-a8385a71d5d3 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:00.532058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:00 2022] GET /identity/v3/users/9aada59ce5bc4a1481277a87a82e45b5 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:00.532058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66327fe3-cec9-4db9-a322-a8385a71d5d3 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:00.567982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 37/74] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:00.567982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d70c0-e117-41d8-aa6c-8b0b7e3a56e2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:00.605651 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:00.671135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66327fe3-cec9-4db9-a322-a8385a71d5d3 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:00.716993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d70c0-e117-41d8-aa6c-8b0b7e3a56e2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:00.728906 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6b0a4-2cd1-43be-b262-0f0db441e5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:00.730087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6b0a4-2cd1-43be-b262-0f0db441e5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:00.730423 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6b0a4-2cd1-43be-b262-0f0db441e5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:00.730913 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6b0a4-2cd1-43be-b262-0f0db441e5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:00.732173 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6b0a4-2cd1-43be-b262-0f0db441e5b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:00.732712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6b0a4-2cd1-43be-b262-0f0db441e5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:00.735328 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6b0a4-2cd1-43be-b262-0f0db441e5b2 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:00.752113 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:00.752911 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6b0a4-2cd1-43be-b262-0f0db441e5b2 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:00.768571 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e183d-661e-4fa0-ae69-d967d298c547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:00.769357 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e183d-661e-4fa0-ae69-d967d298c547 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:00.769732 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e183d-661e-4fa0-ae69-d967d298c547 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:00.770078 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e183d-661e-4fa0-ae69-d967d298c547 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:00.770770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e183d-661e-4fa0-ae69-d967d298c547 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:00.771078 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e183d-661e-4fa0-ae69-d967d298c547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:00.772775 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e183d-661e-4fa0-ae69-d967d298c547 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:00.787897 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 38/76] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:49:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:00.787897 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e183d-661e-4fa0-ae69-d967d298c547 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:00.853167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:00.880511 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:00.905851 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e183d-661e-4fa0-ae69-d967d298c547 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:00.920257 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6b0a4-2cd1-43be-b262-0f0db441e5b2 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:00.946877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e256ae-5121-4d8e-bc0d-e31149f56b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:00.947526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e256ae-5121-4d8e-bc0d-e31149f56b72 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:00.947813 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e256ae-5121-4d8e-bc0d-e31149f56b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:00.948120 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e256ae-5121-4d8e-bc0d-e31149f56b72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:00.961623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e256ae-5121-4d8e-bc0d-e31149f56b72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:00.965086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa9ebe-ca81-4d79-98f9-bdf5ec01d8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:00.966040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa9ebe-ca81-4d79-98f9-bdf5ec01d8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:00.966499 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa9ebe-ca81-4d79-98f9-bdf5ec01d8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:00.966966 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa9ebe-ca81-4d79-98f9-bdf5ec01d8e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-81e256ae-5121-4d8e-bc0d-e31149f56b72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:00.971300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:00.972881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:00.974098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:00.974098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:00.974098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:00.974098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:00.974098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:00.974098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:00.974098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:00.974098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:00.974098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:00.974098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:00.974098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:00.974098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:00.974098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 39/77] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:00.974098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e256ae-5121-4d8e-bc0d-e31149f56b72 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:01.059198 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa9ebe-ca81-4d79-98f9-bdf5ec01d8e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:01.061916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa9ebe-ca81-4d79-98f9-bdf5ec01d8e8 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:01.127930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:01.129924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e256ae-5121-4d8e-bc0d-e31149f56b72 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:01.182356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 39/78] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:01.184399 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa9ebe-ca81-4d79-98f9-bdf5ec01d8e8 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:01.188570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bd617-4ea5-46ee-9ffc-f880e5e7ad51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:01.189226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bd617-4ea5-46ee-9ffc-f880e5e7ad51 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:01.189511 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bd617-4ea5-46ee-9ffc-f880e5e7ad51 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:01.189776 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bd617-4ea5-46ee-9ffc-f880e5e7ad51 None admin] PATH_INFO: `/v3/users/2bf11b0baf04484ca570c05d33f49c63` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:01.199569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:01.208600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bd617-4ea5-46ee-9ffc-f880e5e7ad51 None admin] RBAC: Authorizing `identity:get_user(user_id=2bf11b0baf04484ca570c05d33f49c63)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:01.210076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bd617-4ea5-46ee-9ffc-f880e5e7ad51 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:01.213069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 40/79] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:00 2022] GET /identity/v3/users/2bf11b0baf04484ca570c05d33f49c63 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:01.214298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982e3dd-de7f-4abf-bfb0-65048f360eac None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:01.214588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982e3dd-de7f-4abf-bfb0-65048f360eac None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:01.214868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982e3dd-de7f-4abf-bfb0-65048f360eac None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:01.216169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 41/80] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:01.216895 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982e3dd-de7f-4abf-bfb0-65048f360eac None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:01.322681 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa9ebe-ca81-4d79-98f9-bdf5ec01d8e8 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:01.367470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982e3dd-de7f-4abf-bfb0-65048f360eac None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:01.380477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2f49d-ec5e-498d-9605-85c61348e10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:01.381477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2f49d-ec5e-498d-9605-85c61348e10a None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:01.381934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2f49d-ec5e-498d-9605-85c61348e10a None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:01.382389 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2f49d-ec5e-498d-9605-85c61348e10a None admin] PATH_INFO: `/v3/users/2bf11b0baf04484ca570c05d33f49c63` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:01.385650 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2f49d-ec5e-498d-9605-85c61348e10a None admin] RBAC: Authorizing `identity:get_user(user_id=2bf11b0baf04484ca570c05d33f49c63)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:01.388097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2f49d-ec5e-498d-9605-85c61348e10a None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:01.390939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 40/81] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:01 2022] GET /identity/v3/users/2bf11b0baf04484ca570c05d33f49c63 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:01.391862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2f49d-ec5e-498d-9605-85c61348e10a None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:01.421800 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6a3f1-b5ef-4daf-a3fd-a47b62c9d9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:01.422628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6a3f1-b5ef-4daf-a3fd-a47b62c9d9ba None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:01.422884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6a3f1-b5ef-4daf-a3fd-a47b62c9d9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:01.423419 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6a3f1-b5ef-4daf-a3fd-a47b62c9d9ba None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:01.423641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:01.424414 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6a3f1-b5ef-4daf-a3fd-a47b62c9d9ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:01.424879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6a3f1-b5ef-4daf-a3fd-a47b62c9d9ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:01.426962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6a3f1-b5ef-4daf-a3fd-a47b62c9d9ba None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:01.439739 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 42/82] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:01.445065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140c52e-e5e4-4d12-b29d-a0f351fc5e63 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:01.446225 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140c52e-e5e4-4d12-b29d-a0f351fc5e63 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:01.446992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140c52e-e5e4-4d12-b29d-a0f351fc5e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:01.474687 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c140c52e-e5e4-4d12-b29d-a0f351fc5e63 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:01.476592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c140c52e-e5e4-4d12-b29d-a0f351fc5e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:01.543556 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2f49d-ec5e-498d-9605-85c61348e10a None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:01.568592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:01.588065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 43/83] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:01.589229 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140c52e-e5e4-4d12-b29d-a0f351fc5e63 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:01.593139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df145fa8-a995-4405-a8ea-76d4196863e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:01.593889 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df145fa8-a995-4405-a8ea-76d4196863e4 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:01.594250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df145fa8-a995-4405-a8ea-76d4196863e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:01.594605 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df145fa8-a995-4405-a8ea-76d4196863e4 None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:01.595879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df145fa8-a995-4405-a8ea-76d4196863e4 None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:01.597468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df145fa8-a995-4405-a8ea-76d4196863e4 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:01.599164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 41/84] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:01 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:01.599967 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df145fa8-a995-4405-a8ea-76d4196863e4 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:01.708502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:01.720545 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df145fa8-a995-4405-a8ea-76d4196863e4 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:01.761129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140c52e-e5e4-4d12-b29d-a0f351fc5e63 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:01.762523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced082b-0338-4c62-a250-106c86063eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:01.763153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced082b-0338-4c62-a250-106c86063eba None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:01.763436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced082b-0338-4c62-a250-106c86063eba None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:01.763713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced082b-0338-4c62-a250-106c86063eba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:01.802678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed148a-8095-48d5-8e63-bf635a0889bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:01.803313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed148a-8095-48d5-8e63-bf635a0889bb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:01.803603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed148a-8095-48d5-8e63-bf635a0889bb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:01.803879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed148a-8095-48d5-8e63-bf635a0889bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:01.866487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:01.866775 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced082b-0338-4c62-a250-106c86063eba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:01.871172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced082b-0338-4c62-a250-106c86063eba None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:01.880962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed148a-8095-48d5-8e63-bf635a0889bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:01.882477 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed148a-8095-48d5-8e63-bf635a0889bb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:02.003618 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:02.004444 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 44/85] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:02.005975 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed148a-8095-48d5-8e63-bf635a0889bb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:02.016811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 42/86] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:02.025955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced082b-0338-4c62-a250-106c86063eba None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:02.124032 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:02.144769 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed148a-8095-48d5-8e63-bf635a0889bb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:02.145034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced082b-0338-4c62-a250-106c86063eba None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:02.185363 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bd135-f9ad-4635-9dfd-6af273be8029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:02.186015 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bd135-f9ad-4635-9dfd-6af273be8029 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:02.186297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bd135-f9ad-4635-9dfd-6af273be8029 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:02.186572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bd135-f9ad-4635-9dfd-6af273be8029 None admin] PATH_INFO: `/v3/users/2bf11b0baf04484ca570c05d33f49c63` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:02.187774 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bd135-f9ad-4635-9dfd-6af273be8029 None admin] RBAC: Authorizing `identity:get_user(user_id=2bf11b0baf04484ca570c05d33f49c63)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:02.189291 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bd135-f9ad-4635-9dfd-6af273be8029 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:02.190055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739abf20-7b5a-46df-a6e6-812a3f7c8baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:02.190962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 45/87] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:02 2022] GET /identity/v3/users/2bf11b0baf04484ca570c05d33f49c63 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:02.191117 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739abf20-7b5a-46df-a6e6-812a3f7c8baf None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:02.191622 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739abf20-7b5a-46df-a6e6-812a3f7c8baf None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:02.191764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bd135-f9ad-4635-9dfd-6af273be8029 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:02.192164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739abf20-7b5a-46df-a6e6-812a3f7c8baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:02.193539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739abf20-7b5a-46df-a6e6-812a3f7c8baf None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=06d4e914e37a47ff940142feccfa5200, user.id=9aada59ce5bc4a1481277a87a82e45b5) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:02.194108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739abf20-7b5a-46df-a6e6-812a3f7c8baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:02.199207 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739abf20-7b5a-46df-a6e6-812a3f7c8baf None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:02.221943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 43/88] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:02 2022] GET /identity/v3/role_assignments?user.id=9aada59ce5bc4a1481277a87a82e45b5&scope.project.id=06d4e914e37a47ff940142feccfa5200&role.id=638e1fc82db44124ae615c46408110a7 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:02.221943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739abf20-7b5a-46df-a6e6-812a3f7c8baf None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:02.331364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:02.338763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bd135-f9ad-4635-9dfd-6af273be8029 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:02.398142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739abf20-7b5a-46df-a6e6-812a3f7c8baf None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:02.412332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e692b0f-5770-4677-99ad-6938ca9f5d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:02.412747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e692b0f-5770-4677-99ad-6938ca9f5d8b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:02.412897 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e692b0f-5770-4677-99ad-6938ca9f5d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:02.413152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e692b0f-5770-4677-99ad-6938ca9f5d8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:02.414832 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e692b0f-5770-4677-99ad-6938ca9f5d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:02.416395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e692b0f-5770-4677-99ad-6938ca9f5d8b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:02.418407 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 46/89] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:49:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:02.418973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e692b0f-5770-4677-99ad-6938ca9f5d8b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:02.455415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1091d-57ff-4301-9e9a-8edd42109cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:02.456093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1091d-57ff-4301-9e9a-8edd42109cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:02.456371 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1091d-57ff-4301-9e9a-8edd42109cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:02.456627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1091d-57ff-4301-9e9a-8edd42109cb9 None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:02.457862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1091d-57ff-4301-9e9a-8edd42109cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:02.459392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1091d-57ff-4301-9e9a-8edd42109cb9 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:02.460027 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:02.461698 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 44/90] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:02 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:02.468346 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1091d-57ff-4301-9e9a-8edd42109cb9 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:02.590720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e692b0f-5770-4677-99ad-6938ca9f5d8b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:02.623125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1091d-57ff-4301-9e9a-8edd42109cb9 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:02.646807 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9b9e6-046e-4a30-a33a-3e8b7f849f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:02.648353 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9b9e6-046e-4a30-a33a-3e8b7f849f38 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:02.649359 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9b9e6-046e-4a30-a33a-3e8b7f849f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:02.649626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9b9e6-046e-4a30-a33a-3e8b7f849f38 None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:02.651089 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9b9e6-046e-4a30-a33a-3e8b7f849f38 None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:02.652618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9b9e6-046e-4a30-a33a-3e8b7f849f38 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:02.654619 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 47/91] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:02 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:02.655395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9b9e6-046e-4a30-a33a-3e8b7f849f38 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:02.668917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:02.691678 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6e407-5080-42a6-978d-1891e1f1fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:02.692481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6e407-5080-42a6-978d-1891e1f1fd88 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:02.692907 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6e407-5080-42a6-978d-1891e1f1fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:02.693358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6e407-5080-42a6-978d-1891e1f1fd88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:02.801460 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:02.802858 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6e407-5080-42a6-978d-1891e1f1fd88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:02.806328 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6e407-5080-42a6-978d-1891e1f1fd88 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:02.814977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9b9e6-046e-4a30-a33a-3e8b7f849f38 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:02.870158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b6fee-33a8-4526-ae22-94d089a34720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:02.870964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b6fee-33a8-4526-ae22-94d089a34720 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:02.871378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b6fee-33a8-4526-ae22-94d089a34720 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:02.872620 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b6fee-33a8-4526-ae22-94d089a34720 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:02.872985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b6fee-33a8-4526-ae22-94d089a34720 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:02.874673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b6fee-33a8-4526-ae22-94d089a34720 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:02.908867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 48/92] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:49:02 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:49:02.913527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b6fee-33a8-4526-ae22-94d089a34720 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:03.013924 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 45/93] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:03.022166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6e407-5080-42a6-978d-1891e1f1fd88 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:03.080360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:03.164352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b6fee-33a8-4526-ae22-94d089a34720 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:03.236241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6e407-5080-42a6-978d-1891e1f1fd88 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:03.248495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c576816-8af5-4c2d-9f58-475718c9da75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:03.249399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c576816-8af5-4c2d-9f58-475718c9da75 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:03.249842 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c576816-8af5-4c2d-9f58-475718c9da75 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:03.250267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c576816-8af5-4c2d-9f58-475718c9da75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:03.251192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c576816-8af5-4c2d-9f58-475718c9da75 None admin] RBAC: Adding query filter params (role.id=93e4ae64906f4b0ea861a4ac4571f1d7, scope.project.id=06d4e914e37a47ff940142feccfa5200, user.id=2bf11b0baf04484ca570c05d33f49c63) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:03.251658 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c576816-8af5-4c2d-9f58-475718c9da75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:03.254073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c576816-8af5-4c2d-9f58-475718c9da75 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:03.263191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 49/94] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:02 2022] GET /identity/v3/role_assignments?user.id=2bf11b0baf04484ca570c05d33f49c63&scope.project.id=06d4e914e37a47ff940142feccfa5200&role.id=93e4ae64906f4b0ea861a4ac4571f1d7 => generated 259 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:03.264818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c576816-8af5-4c2d-9f58-475718c9da75 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:03.287528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:03.317645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b08d79-6780-4474-875f-40c394cff443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:03.318880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b08d79-6780-4474-875f-40c394cff443 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:03.319482 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b08d79-6780-4474-875f-40c394cff443 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:03.320259 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b08d79-6780-4474-875f-40c394cff443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:03.322676 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b08d79-6780-4474-875f-40c394cff443 None admin] RBAC: Adding query filter params (role.id=b94b02b271d44f1195f1093a6202a947, scope.project.id=06d4e914e37a47ff940142feccfa5200, user.id=2bf11b0baf04484ca570c05d33f49c63) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:03.323370 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b08d79-6780-4474-875f-40c394cff443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:03.326360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b08d79-6780-4474-875f-40c394cff443 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:03.338622 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 46/95] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:03 2022] GET /identity/v3/role_assignments?user.id=2bf11b0baf04484ca570c05d33f49c63&scope.project.id=06d4e914e37a47ff940142feccfa5200&role.id=b94b02b271d44f1195f1093a6202a947 => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:03.458375 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c576816-8af5-4c2d-9f58-475718c9da75 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:03.558030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bb444-ac1b-48d5-b0d1-58f42b16ba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:03.559457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bb444-ac1b-48d5-b0d1-58f42b16ba60 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:03.559926 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bb444-ac1b-48d5-b0d1-58f42b16ba60 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:03.560370 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bb444-ac1b-48d5-b0d1-58f42b16ba60 None admin] PATH_INFO: `/v3/projects/1f8d583814064471826ccf18ea8422e3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:03.564914 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bb444-ac1b-48d5-b0d1-58f42b16ba60 None admin] RBAC: Authorizing `identity:get_project(project_id=1f8d583814064471826ccf18ea8422e3)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:03.566781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bb444-ac1b-48d5-b0d1-58f42b16ba60 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:03.569124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 50/96] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:03 2022] GET /identity/v3/projects/1f8d583814064471826ccf18ea8422e3 => generated 312 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:03.578519 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b08d79-6780-4474-875f-40c394cff443 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:03.801207 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:03.834511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b08d79-6780-4474-875f-40c394cff443 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:03.906840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbdabd-5be0-447f-8b2e-a1290b5a9d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:03.907887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbdabd-5be0-447f-8b2e-a1290b5a9d0f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:03.908429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbdabd-5be0-447f-8b2e-a1290b5a9d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:03.908940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbdabd-5be0-447f-8b2e-a1290b5a9d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:03.910512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbdabd-5be0-447f-8b2e-a1290b5a9d0f None admin] RBAC: Adding query filter params (role.id=93e4ae64906f4b0ea861a4ac4571f1d7, scope.project.id=1f8d583814064471826ccf18ea8422e3, user.id=2bf11b0baf04484ca570c05d33f49c63) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:03.911066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbdabd-5be0-447f-8b2e-a1290b5a9d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:03.914059 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbdabd-5be0-447f-8b2e-a1290b5a9d0f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:03.925525 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 47/97] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:03 2022] GET /identity/v3/role_assignments?user.id=2bf11b0baf04484ca570c05d33f49c63&scope.project.id=1f8d583814064471826ccf18ea8422e3&role.id=93e4ae64906f4b0ea861a4ac4571f1d7 => generated 259 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:05.850609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dd3da-c0e9-4947-b572-85f2803135c7 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:05.851391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dd3da-c0e9-4947-b572-85f2803135c7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:05.851391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dd3da-c0e9-4947-b572-85f2803135c7 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:05.852972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 51/98] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:05.867463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e2c73-ff0b-478e-9728-cae39708385b None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:05.868497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e2c73-ff0b-478e-9728-cae39708385b None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:05.868497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e2c73-ff0b-478e-9728-cae39708385b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:05.903094 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-492e2c73-ff0b-478e-9728-cae39708385b None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:05.904279 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-492e2c73-ff0b-478e-9728-cae39708385b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:06.002446 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 48/99] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 07 00:49:06.075628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dd3da-c0e9-4947-b572-85f2803135c7 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:06.186999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:06.218039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dd3da-c0e9-4947-b572-85f2803135c7 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:06.270669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aea27f-9f75-4702-8cec-3501e022d523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:06.271420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aea27f-9f75-4702-8cec-3501e022d523 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:06.271704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aea27f-9f75-4702-8cec-3501e022d523 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:06.272036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aea27f-9f75-4702-8cec-3501e022d523 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:06.296393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aea27f-9f75-4702-8cec-3501e022d523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-51aea27f-9f75-4702-8cec-3501e022d523 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:06.301247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:06.304300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:06.308215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:06.308215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:06.308215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:06.308215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:06.308215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:06.308215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:06.308215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:06.308215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:06.308215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:06.308215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:06.308215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:06.308215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:06.308215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 52/100] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:49:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:49:06.319806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e2c73-ff0b-478e-9728-cae39708385b None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:06.451239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:06.477361 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e2c73-ff0b-478e-9728-cae39708385b None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:06.521747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c23d8-a25a-4fd4-afb6-e5a53c84891f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:06.522658 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c23d8-a25a-4fd4-afb6-e5a53c84891f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:06.522943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c23d8-a25a-4fd4-afb6-e5a53c84891f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:06.523218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c23d8-a25a-4fd4-afb6-e5a53c84891f None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:06.524298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c23d8-a25a-4fd4-afb6-e5a53c84891f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:06.524605 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c23d8-a25a-4fd4-afb6-e5a53c84891f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:06.526045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c23d8-a25a-4fd4-afb6-e5a53c84891f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:06.541331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 49/101] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:06.548981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aea27f-9f75-4702-8cec-3501e022d523 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:06.723415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aea27f-9f75-4702-8cec-3501e022d523 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:06.764374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610c36a-ed07-483d-9fc7-ae2a88afee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:06.765030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610c36a-ed07-483d-9fc7-ae2a88afee3d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:06.765314 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610c36a-ed07-483d-9fc7-ae2a88afee3d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:06.765591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610c36a-ed07-483d-9fc7-ae2a88afee3d None admin] PATH_INFO: `/v3/users/9aada59ce5bc4a1481277a87a82e45b5` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:06.766828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610c36a-ed07-483d-9fc7-ae2a88afee3d None admin] RBAC: Authorizing `identity:get_user(user_id=9aada59ce5bc4a1481277a87a82e45b5)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:06.768396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610c36a-ed07-483d-9fc7-ae2a88afee3d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:06.770077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 53/102] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:06 2022] GET /identity/v3/users/9aada59ce5bc4a1481277a87a82e45b5 => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:06.777497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c23d8-a25a-4fd4-afb6-e5a53c84891f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:06.934803 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c23d8-a25a-4fd4-afb6-e5a53c84891f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:06.985133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c1311-7847-4a0d-8a23-f9b84abaa6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:06.985694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c1311-7847-4a0d-8a23-f9b84abaa6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:06.985979 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c1311-7847-4a0d-8a23-f9b84abaa6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:06.986258 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c1311-7847-4a0d-8a23-f9b84abaa6c4 None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:06.993520 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c1311-7847-4a0d-8a23-f9b84abaa6c4 None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:06.995044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c1311-7847-4a0d-8a23-f9b84abaa6c4 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:06.996877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 50/103] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:06 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:07.003310 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610c36a-ed07-483d-9fc7-ae2a88afee3d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:07.020528 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67480472-c14e-4520-bfec-c592648c2712 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:07.020914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67480472-c14e-4520-bfec-c592648c2712 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:07.021152 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67480472-c14e-4520-bfec-c592648c2712 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:07.022743 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 51/104] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:07.031154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:07.033105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93547b51-02e0-42b8-8ed2-b397267a3971 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:07.033105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93547b51-02e0-42b8-8ed2-b397267a3971 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:07.033408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93547b51-02e0-42b8-8ed2-b397267a3971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:07.076412 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-93547b51-02e0-42b8-8ed2-b397267a3971 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:07.077661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-93547b51-02e0-42b8-8ed2-b397267a3971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:07.088802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:07.231936 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610c36a-ed07-483d-9fc7-ae2a88afee3d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:07.287687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 52/105] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:07.324740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c76d2-dbbe-438c-9568-3c8f35d0da13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:07.325454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c76d2-dbbe-438c-9568-3c8f35d0da13 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:07.325744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c76d2-dbbe-438c-9568-3c8f35d0da13 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:07.326028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c76d2-dbbe-438c-9568-3c8f35d0da13 None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200/users/9aada59ce5bc4a1481277a87a82e45b5/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:07.333594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c76d2-dbbe-438c-9568-3c8f35d0da13 None admin] RBAC: Authorizing `identity:create_grant(project_id=06d4e914e37a47ff940142feccfa5200, user_id=9aada59ce5bc4a1481277a87a82e45b5, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:07.335105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c76d2-dbbe-438c-9568-3c8f35d0da13 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:07.348557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93547b51-02e0-42b8-8ed2-b397267a3971 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:07.368114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 54/106] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:49:07 2022] PUT /identity/v3/projects/06d4e914e37a47ff940142feccfa5200/users/9aada59ce5bc4a1481277a87a82e45b5/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:49:07.484260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f8214-17b5-4126-affd-fca43264423f None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:07.484526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f8214-17b5-4126-affd-fca43264423f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:07.484655 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f8214-17b5-4126-affd-fca43264423f None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:07.486334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 55/107] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:07.492861 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653a0ef-4cbc-4e83-a93c-413935889edc None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:07.493354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653a0ef-4cbc-4e83-a93c-413935889edc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:07.493639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653a0ef-4cbc-4e83-a93c-413935889edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:07.545727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d653a0ef-4cbc-4e83-a93c-413935889edc None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:07.547576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d653a0ef-4cbc-4e83-a93c-413935889edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:07.638179 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93547b51-02e0-42b8-8ed2-b397267a3971 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:07.683682 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:07.701674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 56/108] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:49:07.703585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174b8fb-83de-465e-8971-ed19a43bc4a2 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:07.704184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174b8fb-83de-465e-8971-ed19a43bc4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:07.704701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174b8fb-83de-465e-8971-ed19a43bc4a2 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:07.707090 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 57/109] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:07.708800 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882149b-b809-4c9d-aa24-d07da672e0d7 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:07.709326 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882149b-b809-4c9d-aa24-d07da672e0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:07.710173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882149b-b809-4c9d-aa24-d07da672e0d7 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:07.712813 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 58/110] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:07.716261 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e84fe2-4ab8-4df3-8bb1-4292827a731f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:07.716819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e84fe2-4ab8-4df3-8bb1-4292827a731f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:07.717973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e84fe2-4ab8-4df3-8bb1-4292827a731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:07.742840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0976957-39cf-4817-a762-48f09fb9f789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:07.743507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0976957-39cf-4817-a762-48f09fb9f789 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:07.743784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0976957-39cf-4817-a762-48f09fb9f789 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:07.744115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0976957-39cf-4817-a762-48f09fb9f789 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:07.750513 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e8e84fe2-4ab8-4df3-8bb1-4292827a731f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:07.752207 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e8e84fe2-4ab8-4df3-8bb1-4292827a731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:07.755136 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:07.758486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0976957-39cf-4817-a762-48f09fb9f789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-a0976957-39cf-4817-a762-48f09fb9f789 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:07.765947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:07.766875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:07.767656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:07.767656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:07.767656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:07.767656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:07.767656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:07.767656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:07.767656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:07.767656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:07.767656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:07.767656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:07.767656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:07.767656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:07.771481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 53/111] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:07.771678 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0976957-39cf-4817-a762-48f09fb9f789 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:07.848549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 59/112] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:07.850144 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c2810-0ff7-4b47-af6b-bf17a173c6e5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:07.850504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c2810-0ff7-4b47-af6b-bf17a173c6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:07.850790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c2810-0ff7-4b47-af6b-bf17a173c6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:07.900277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-944c2810-0ff7-4b47-af6b-bf17a173c6e5 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:07.901931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-944c2810-0ff7-4b47-af6b-bf17a173c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:07.921116 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0976957-39cf-4817-a762-48f09fb9f789 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:07.976074 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa480886-f087-4f26-a7d8-9075cc986e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:07.977387 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa480886-f087-4f26-a7d8-9075cc986e5e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:07.977387 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa480886-f087-4f26-a7d8-9075cc986e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:07.977632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa480886-f087-4f26-a7d8-9075cc986e5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:07.979253 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa480886-f087-4f26-a7d8-9075cc986e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:07.981121 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa480886-f087-4f26-a7d8-9075cc986e5e None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:07.982767 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 54/113] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:49:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:07.982767 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa480886-f087-4f26-a7d8-9075cc986e5e None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:08.011955 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 60/114] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:08.011955 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c2810-0ff7-4b47-af6b-bf17a173c6e5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:08.081313 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:08.088218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:08.124073 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa480886-f087-4f26-a7d8-9075cc986e5e None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:08.162485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba9e7a-b618-4f8e-a59c-3a5cbd8d7547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:08.163160 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9e7a-b618-4f8e-a59c-3a5cbd8d7547 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:08.163441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9e7a-b618-4f8e-a59c-3a5cbd8d7547 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:08.163762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba9e7a-b618-4f8e-a59c-3a5cbd8d7547 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:08.165346 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba9e7a-b618-4f8e-a59c-3a5cbd8d7547 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:08.165649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba9e7a-b618-4f8e-a59c-3a5cbd8d7547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:08.167114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba9e7a-b618-4f8e-a59c-3a5cbd8d7547 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:08.171645 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c2810-0ff7-4b47-af6b-bf17a173c6e5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:08.177891 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 55/115] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:08.178915 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eab1ef-a290-4cf2-96af-74e5f00466d6 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:08.179208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eab1ef-a290-4cf2-96af-74e5f00466d6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:08.179542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eab1ef-a290-4cf2-96af-74e5f00466d6 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:08.181723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 56/116] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:08.186419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eab1ef-a290-4cf2-96af-74e5f00466d6 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:08.249416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b2f48-5268-4f14-a44c-167d77582b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:08.250927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b2f48-5268-4f14-a44c-167d77582b16 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:08.251712 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b2f48-5268-4f14-a44c-167d77582b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:08.252267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b2f48-5268-4f14-a44c-167d77582b16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:08.271991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b2f48-5268-4f14-a44c-167d77582b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-484b2f48-5268-4f14-a44c-167d77582b16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:08.282473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:08.283528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:08.284331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:08.284331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:08.284331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:08.284331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:08.284331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:08.284331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:08.284331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:08.284331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:08.284331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:08.284331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:08.284331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:08.284331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:08.284934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 61/117] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:08.291963 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b2f48-5268-4f14-a44c-167d77582b16 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:08.341248 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eab1ef-a290-4cf2-96af-74e5f00466d6 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:08.394445 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:08.404395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4b9f3-ea99-4e53-ad17-e3b0f26b1a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:08.405024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4b9f3-ea99-4e53-ad17-e3b0f26b1a3a None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:08.405400 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4b9f3-ea99-4e53-ad17-e3b0f26b1a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:08.405704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4b9f3-ea99-4e53-ad17-e3b0f26b1a3a None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:08.406708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4b9f3-ea99-4e53-ad17-e3b0f26b1a3a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:08.408528 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4b9f3-ea99-4e53-ad17-e3b0f26b1a3a None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:08.439104 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 57/118] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Aug 7 00:49:08 2022] POST /identity/v3/projects => generated 302 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:49:08.440539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035b03c-5e22-4cd1-befe-428b9f3784ee None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:08.440853 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035b03c-5e22-4cd1-befe-428b9f3784ee None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:08.441437 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035b03c-5e22-4cd1-befe-428b9f3784ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:08.457526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b2f48-5268-4f14-a44c-167d77582b16 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:08.464061 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-1035b03c-5e22-4cd1-befe-428b9f3784ee None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:08.466835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1035b03c-5e22-4cd1-befe-428b9f3784ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:08.483814 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:08.510828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567a8b9-eda1-46f9-8ba5-3cb32c62f32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:08.512453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567a8b9-eda1-46f9-8ba5-3cb32c62f32f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:08.512747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567a8b9-eda1-46f9-8ba5-3cb32c62f32f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:08.513028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567a8b9-eda1-46f9-8ba5-3cb32c62f32f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:08.528803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567a8b9-eda1-46f9-8ba5-3cb32c62f32f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-0567a8b9-eda1-46f9-8ba5-3cb32c62f32f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:08.534021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:08.534982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:08.535746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:08.535746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:08.535746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:08.535746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:08.535746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:08.535746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:08.535746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:08.535746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:08.535746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:08.535746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:08.535746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:08.535746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:08.535746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 62/119] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:08.536414 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567a8b9-eda1-46f9-8ba5-3cb32c62f32f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:08.576984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 58/120] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:08.584153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035b03c-5e22-4cd1-befe-428b9f3784ee None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:08.711722 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567a8b9-eda1-46f9-8ba5-3cb32c62f32f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:08.751192 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035b03c-5e22-4cd1-befe-428b9f3784ee None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:08.768871 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052e603-1b05-42ef-b649-7b8aa594588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:08.769664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:08.771592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052e603-1b05-42ef-b649-7b8aa594588b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:08.772390 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052e603-1b05-42ef-b649-7b8aa594588b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:08.772844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052e603-1b05-42ef-b649-7b8aa594588b None admin] PATH_INFO: `/v3/users/0d6d5f0e5b4349f4877d4d22af1545b8` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:08.798178 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71bb58-576e-4b01-b91d-7954081e7e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:08.798810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71bb58-576e-4b01-b91d-7954081e7e33 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:08.799120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71bb58-576e-4b01-b91d-7954081e7e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:08.799373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71bb58-576e-4b01-b91d-7954081e7e33 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:08.800099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71bb58-576e-4b01-b91d-7954081e7e33 None admin] RBAC: Adding query filter params (name=member) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:08.800373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052e603-1b05-42ef-b649-7b8aa594588b None admin] RBAC: Authorizing `identity:get_user(user_id=0d6d5f0e5b4349f4877d4d22af1545b8)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:08.800477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71bb58-576e-4b01-b91d-7954081e7e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:08.801815 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71bb58-576e-4b01-b91d-7954081e7e33 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:08.802339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052e603-1b05-42ef-b649-7b8aa594588b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:08.805754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 63/121] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:08 2022] GET /identity/v3/users/0d6d5f0e5b4349f4877d4d22af1545b8 => generated 289 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:08.811163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052e603-1b05-42ef-b649-7b8aa594588b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:08.818191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 59/122] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:08.823626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71bb58-576e-4b01-b91d-7954081e7e33 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:08.878765 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:08.972573 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71bb58-576e-4b01-b91d-7954081e7e33 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:08.978601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052e603-1b05-42ef-b649-7b8aa594588b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:09.015166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae3e4a-b2e6-497b-a6ff-00471d0b07d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:09.016111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae3e4a-b2e6-497b-a6ff-00471d0b07d2 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:09.016522 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae3e4a-b2e6-497b-a6ff-00471d0b07d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:09.016846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae3e4a-b2e6-497b-a6ff-00471d0b07d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:09.027283 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bd8f9-b3ac-44cb-8971-e539938fd8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:09.028596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bd8f9-b3ac-44cb-8971-e539938fd8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:09.029108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bd8f9-b3ac-44cb-8971-e539938fd8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:09.029594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bd8f9-b3ac-44cb-8971-e539938fd8b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:09.030800 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bd8f9-b3ac-44cb-8971-e539938fd8b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:09.031326 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bd8f9-b3ac-44cb-8971-e539938fd8b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:09.033828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bd8f9-b3ac-44cb-8971-e539938fd8b2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:09.038277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae3e4a-b2e6-497b-a6ff-00471d0b07d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:09.045656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 64/123] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-38ae3e4a-b2e6-497b-a6ff-00471d0b07d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:09.051142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:09.052080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:09.052862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:09.052862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:09.052862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:09.052862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:09.052862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:09.052862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:09.052862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:09.052862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:09.052862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:09.052862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:09.052862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:09.052862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:09.053448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 60/124] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:49:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:09.054665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bd8f9-b3ac-44cb-8971-e539938fd8b2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:09.054908 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae3e4a-b2e6-497b-a6ff-00471d0b07d2 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:09.122193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:09.187499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:09.192983 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bd8f9-b3ac-44cb-8971-e539938fd8b2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:09.224601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae3e4a-b2e6-497b-a6ff-00471d0b07d2 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:09.238844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248ef6f-cb6e-428f-9a89-5627016eeaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:09.239333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248ef6f-cb6e-428f-9a89-5627016eeaed None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:09.240483 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248ef6f-cb6e-428f-9a89-5627016eeaed None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:09.240930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248ef6f-cb6e-428f-9a89-5627016eeaed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:09.269054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651b7c0-16e8-4f09-b0f2-cad50fb067c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:09.270219 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651b7c0-16e8-4f09-b0f2-cad50fb067c9 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:09.270817 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651b7c0-16e8-4f09-b0f2-cad50fb067c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:09.271377 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651b7c0-16e8-4f09-b0f2-cad50fb067c9 None admin] PATH_INFO: `/v3/users/2bf11b0baf04484ca570c05d33f49c63` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:09.273953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651b7c0-16e8-4f09-b0f2-cad50fb067c9 None admin] RBAC: Authorizing `identity:get_user(user_id=2bf11b0baf04484ca570c05d33f49c63)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:09.276224 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651b7c0-16e8-4f09-b0f2-cad50fb067c9 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:09.278344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 61/125] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:09 2022] GET /identity/v3/users/2bf11b0baf04484ca570c05d33f49c63 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:09.279375 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651b7c0-16e8-4f09-b0f2-cad50fb067c9 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:09.328232 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248ef6f-cb6e-428f-9a89-5627016eeaed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:09.330451 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248ef6f-cb6e-428f-9a89-5627016eeaed None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:09.403510 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651b7c0-16e8-4f09-b0f2-cad50fb067c9 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:09.405605 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:09.445734 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b5661-ab18-4fe7-95ce-5ae9ac6f6d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:09.446767 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b5661-ab18-4fe7-95ce-5ae9ac6f6d40 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:09.447270 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b5661-ab18-4fe7-95ce-5ae9ac6f6d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:09.447792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b5661-ab18-4fe7-95ce-5ae9ac6f6d40 None admin] PATH_INFO: `/v3/users/2bf11b0baf04484ca570c05d33f49c63` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:09.449291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b5661-ab18-4fe7-95ce-5ae9ac6f6d40 None admin] RBAC: Authorizing `identity:get_user(user_id=2bf11b0baf04484ca570c05d33f49c63)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:09.451145 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b5661-ab18-4fe7-95ce-5ae9ac6f6d40 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:09.457783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 62/126] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:09 2022] GET /identity/v3/users/2bf11b0baf04484ca570c05d33f49c63 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:09.458942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b5661-ab18-4fe7-95ce-5ae9ac6f6d40 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:09.481043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:09.491852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 65/127] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:09.491852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248ef6f-cb6e-428f-9a89-5627016eeaed None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:09.586927 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b5661-ab18-4fe7-95ce-5ae9ac6f6d40 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:09.615381 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248ef6f-cb6e-428f-9a89-5627016eeaed None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:09.627234 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e6c08-ab0f-4b01-b1cc-0eb31f7cedc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:09.628173 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e6c08-ab0f-4b01-b1cc-0eb31f7cedc8 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:09.628600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e6c08-ab0f-4b01-b1cc-0eb31f7cedc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:09.629015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e6c08-ab0f-4b01-b1cc-0eb31f7cedc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:09.629932 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e6c08-ab0f-4b01-b1cc-0eb31f7cedc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:09.630426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e6c08-ab0f-4b01-b1cc-0eb31f7cedc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:09.632178 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e6c08-ab0f-4b01-b1cc-0eb31f7cedc8 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:09.645685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 63/128] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:49:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:09.647317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e6c08-ab0f-4b01-b1cc-0eb31f7cedc8 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:09.658574 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bd67c-b86f-4bd0-aa5e-0bf024c8510b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:09.659680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bd67c-b86f-4bd0-aa5e-0bf024c8510b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:09.659680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bd67c-b86f-4bd0-aa5e-0bf024c8510b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:09.659847 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bd67c-b86f-4bd0-aa5e-0bf024c8510b None admin] PATH_INFO: `/v3/projects/1f8d583814064471826ccf18ea8422e3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:09.661109 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bd67c-b86f-4bd0-aa5e-0bf024c8510b None admin] RBAC: Authorizing `identity:get_project(project_id=1f8d583814064471826ccf18ea8422e3)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:09.662760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bd67c-b86f-4bd0-aa5e-0bf024c8510b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:09.664618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 66/129] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:09 2022] GET /identity/v3/projects/1f8d583814064471826ccf18ea8422e3 => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:09.669936 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bd67c-b86f-4bd0-aa5e-0bf024c8510b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:09.688942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:09.757334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:09.781992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e6c08-ab0f-4b01-b1cc-0eb31f7cedc8 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:09.818341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bd67c-b86f-4bd0-aa5e-0bf024c8510b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:09.822070 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4baf9-5f95-47b6-83ee-229c7637ddf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:09.823214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4baf9-5f95-47b6-83ee-229c7637ddf7 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:09.823697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4baf9-5f95-47b6-83ee-229c7637ddf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:09.824230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4baf9-5f95-47b6-83ee-229c7637ddf7 None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:09.826474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4baf9-5f95-47b6-83ee-229c7637ddf7 None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:09.828208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4baf9-5f95-47b6-83ee-229c7637ddf7 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:09.829973 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 64/130] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:09 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:09.831599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4baf9-5f95-47b6-83ee-229c7637ddf7 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:09.872703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6dfbb-2675-44ec-bc7d-5620422b1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:09.873370 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6dfbb-2675-44ec-bc7d-5620422b1417 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:09.873659 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6dfbb-2675-44ec-bc7d-5620422b1417 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:09.874103 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6dfbb-2675-44ec-bc7d-5620422b1417 None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:09.875192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6dfbb-2675-44ec-bc7d-5620422b1417 None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:09.876733 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6dfbb-2675-44ec-bc7d-5620422b1417 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:09.878524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 67/131] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:09 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:09.878524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6dfbb-2675-44ec-bc7d-5620422b1417 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:09.986608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:09.990108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4baf9-5f95-47b6-83ee-229c7637ddf7 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:10.041823 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcd7b7-f5ef-40d6-8cf5-e80fdab29432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:10.042627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcd7b7-f5ef-40d6-8cf5-e80fdab29432 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:10.042963 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcd7b7-f5ef-40d6-8cf5-e80fdab29432 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:10.043201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcd7b7-f5ef-40d6-8cf5-e80fdab29432 None admin] PATH_INFO: `/v3/users/2bf11b0baf04484ca570c05d33f49c63` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:10.044475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcd7b7-f5ef-40d6-8cf5-e80fdab29432 None admin] RBAC: Authorizing `identity:get_user(user_id=2bf11b0baf04484ca570c05d33f49c63)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:10.044967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6dfbb-2675-44ec-bc7d-5620422b1417 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:10.046257 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcd7b7-f5ef-40d6-8cf5-e80fdab29432 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:10.048458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 65/132] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:09 2022] GET /identity/v3/users/2bf11b0baf04484ca570c05d33f49c63 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:10.049726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3959b3f-5bf7-4f29-95bf-8d91c66baafa None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:10.050017 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3959b3f-5bf7-4f29-95bf-8d91c66baafa None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:10.050292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3959b3f-5bf7-4f29-95bf-8d91c66baafa None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:10.052072 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 66/133] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:10.053144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3959b3f-5bf7-4f29-95bf-8d91c66baafa None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:10.103715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cc330-5cea-4118-9e9f-b74dc23d9393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:10.104915 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cc330-5cea-4118-9e9f-b74dc23d9393 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:10.105425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cc330-5cea-4118-9e9f-b74dc23d9393 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:10.105823 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cc330-5cea-4118-9e9f-b74dc23d9393 None admin] PATH_INFO: `/v3/projects/1f8d583814064471826ccf18ea8422e3/users/2bf11b0baf04484ca570c05d33f49c63/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:10.108820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cc330-5cea-4118-9e9f-b74dc23d9393 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f8d583814064471826ccf18ea8422e3, user_id=2bf11b0baf04484ca570c05d33f49c63, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:10.110604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cc330-5cea-4118-9e9f-b74dc23d9393 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:10.114419 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:10.129390 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 68/134] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:49:09 2022] PUT /identity/v3/projects/1f8d583814064471826ccf18ea8422e3/users/2bf11b0baf04484ca570c05d33f49c63/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:49:10.130121 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cc330-5cea-4118-9e9f-b74dc23d9393 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:10.230941 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3959b3f-5bf7-4f29-95bf-8d91c66baafa None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:10.302982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa940499-2fb1-425e-a4a7-9425f5a1258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:10.304140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa940499-2fb1-425e-a4a7-9425f5a1258d None admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:10.304690 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa940499-2fb1-425e-a4a7-9425f5a1258d None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:10.305174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa940499-2fb1-425e-a4a7-9425f5a1258d None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200/users/2bf11b0baf04484ca570c05d33f49c63/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:10.308711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa940499-2fb1-425e-a4a7-9425f5a1258d None admin] RBAC: Authorizing `identity:create_grant(project_id=06d4e914e37a47ff940142feccfa5200, user_id=2bf11b0baf04484ca570c05d33f49c63, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:10.311392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa940499-2fb1-425e-a4a7-9425f5a1258d None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:10.334163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cc330-5cea-4118-9e9f-b74dc23d9393 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:10.339495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 67/135] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:49:10 2022] PUT /identity/v3/projects/06d4e914e37a47ff940142feccfa5200/users/2bf11b0baf04484ca570c05d33f49c63/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:49:10.341141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa940499-2fb1-425e-a4a7-9425f5a1258d None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:10.395088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:10.416066 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcaad3-788e-4d2f-87ed-a7b0c3a206bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:10.417046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcaad3-788e-4d2f-87ed-a7b0c3a206bc None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:10.417488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcaad3-788e-4d2f-87ed-a7b0c3a206bc None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:10.417926 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcaad3-788e-4d2f-87ed-a7b0c3a206bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:10.419191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcaad3-788e-4d2f-87ed-a7b0c3a206bc None admin] RBAC: Adding query filter params (role.id=347f011f3e624778b2823ef73698f6ad, scope.project.id=06d4e914e37a47ff940142feccfa5200, user.id=0d6d5f0e5b4349f4877d4d22af1545b8) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:10.419688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcaad3-788e-4d2f-87ed-a7b0c3a206bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:10.429455 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcaad3-788e-4d2f-87ed-a7b0c3a206bc None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:10.449146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 69/136] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:10 2022] GET /identity/v3/role_assignments?user.id=0d6d5f0e5b4349f4877d4d22af1545b8&scope.project.id=06d4e914e37a47ff940142feccfa5200&role.id=347f011f3e624778b2823ef73698f6ad => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:10.451200 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5b715-9b8e-407a-a13a-72f37c881032 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:10.451699 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5b715-9b8e-407a-a13a-72f37c881032 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:10.452217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5b715-9b8e-407a-a13a-72f37c881032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:10.499236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7af5b715-9b8e-407a-a13a-72f37c881032 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:10.501187 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7af5b715-9b8e-407a-a13a-72f37c881032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:10.642952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:10.667995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa940499-2fb1-425e-a4a7-9425f5a1258d None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:10.672086 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 70/137] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:10.715223 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5b715-9b8e-407a-a13a-72f37c881032 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:10.725239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d281218-bc46-4de5-8ddb-86451f4424e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:10.725926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d281218-bc46-4de5-8ddb-86451f4424e0 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:10.726305 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d281218-bc46-4de5-8ddb-86451f4424e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:10.727322 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d281218-bc46-4de5-8ddb-86451f4424e0 None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:10.729162 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d281218-bc46-4de5-8ddb-86451f4424e0 None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:10.730662 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d281218-bc46-4de5-8ddb-86451f4424e0 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:10.732415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 68/138] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:10 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:10.738360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d281218-bc46-4de5-8ddb-86451f4424e0 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:10.913925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:10.917586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5b715-9b8e-407a-a13a-72f37c881032 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:10.920608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d281218-bc46-4de5-8ddb-86451f4424e0 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:10.982618 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022edb0c-da12-4bd5-baaa-3afd30ad207a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:10.984289 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022edb0c-da12-4bd5-baaa-3afd30ad207a None admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:10.985100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022edb0c-da12-4bd5-baaa-3afd30ad207a None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:10.985899 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022edb0c-da12-4bd5-baaa-3afd30ad207a None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200/users/2bf11b0baf04484ca570c05d33f49c63/roles/b94b02b271d44f1195f1093a6202a947` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:10.990162 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022edb0c-da12-4bd5-baaa-3afd30ad207a None admin] RBAC: Authorizing `identity:create_grant(project_id=06d4e914e37a47ff940142feccfa5200, user_id=2bf11b0baf04484ca570c05d33f49c63, role_id=b94b02b271d44f1195f1093a6202a947)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:10.992901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022edb0c-da12-4bd5-baaa-3afd30ad207a None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:11.009364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dac0b-26c6-4077-9b34-6e521011f163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:11.010037 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dac0b-26c6-4077-9b34-6e521011f163 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:11.010329 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dac0b-26c6-4077-9b34-6e521011f163 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:11.010596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dac0b-26c6-4077-9b34-6e521011f163 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:11.017615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 69/139] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:49:10 2022] PUT /identity/v3/projects/06d4e914e37a47ff940142feccfa5200/users/2bf11b0baf04484ca570c05d33f49c63/roles/b94b02b271d44f1195f1093a6202a947 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:49:11.049133 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dac0b-26c6-4077-9b34-6e521011f163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-5e7dac0b-26c6-4077-9b34-6e521011f163 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:11.053991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:11.055988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:11.057341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:11.057341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:11.057341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:11.057341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:11.057341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:11.057341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:11.057341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:11.057341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:11.057341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:11.057341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:11.057341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:11.057341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:11.057341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 71/140] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:49:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:49:11.070714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022edb0c-da12-4bd5-baaa-3afd30ad207a None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:11.152203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca591fb-7d3e-49c5-9603-3c021db909d0 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:11.152203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca591fb-7d3e-49c5-9603-3c021db909d0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:11.152456 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca591fb-7d3e-49c5-9603-3c021db909d0 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:11.153762 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 72/141] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:11.165637 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57ad0-bf68-40e7-b6ed-588c530c8275 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:11.165841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57ad0-bf68-40e7-b6ed-588c530c8275 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:11.166128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da57ad0-bf68-40e7-b6ed-588c530c8275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:11.215893 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022edb0c-da12-4bd5-baaa-3afd30ad207a None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:11.221124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7da57ad0-bf68-40e7-b6ed-588c530c8275 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:11.222377 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7da57ad0-bf68-40e7-b6ed-588c530c8275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:11.260412 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c537f-b397-424b-bb06-41ff76725fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:11.261413 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c537f-b397-424b-bb06-41ff76725fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:11.261992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c537f-b397-424b-bb06-41ff76725fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:11.262559 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c537f-b397-424b-bb06-41ff76725fc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:11.263616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c537f-b397-424b-bb06-41ff76725fc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:11.264174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c537f-b397-424b-bb06-41ff76725fc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:11.265879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c537f-b397-424b-bb06-41ff76725fc6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:11.277780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 70/142] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:11.284063 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c537f-b397-424b-bb06-41ff76725fc6 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:11.320886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:11.404320 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:11.451149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 73/143] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:11.461216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c537f-b397-424b-bb06-41ff76725fc6 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:11.502334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da57ad0-bf68-40e7-b6ed-588c530c8275 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:11.564197 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9c87b-d59f-410f-93ed-35191cfdc613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:11.565314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9c87b-d59f-410f-93ed-35191cfdc613 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:11.565796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9c87b-d59f-410f-93ed-35191cfdc613 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:11.566290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9c87b-d59f-410f-93ed-35191cfdc613 None admin] PATH_INFO: `/v3/users/9aada59ce5bc4a1481277a87a82e45b5` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:11.571284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9c87b-d59f-410f-93ed-35191cfdc613 None admin] RBAC: Authorizing `identity:get_user(user_id=9aada59ce5bc4a1481277a87a82e45b5)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:11.576561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9c87b-d59f-410f-93ed-35191cfdc613 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:11.580271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 71/144] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:11 2022] GET /identity/v3/users/9aada59ce5bc4a1481277a87a82e45b5 => generated 247 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:11.587795 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9c87b-d59f-410f-93ed-35191cfdc613 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:11.870271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da57ad0-bf68-40e7-b6ed-588c530c8275 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:11.917544 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:11.959501 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4e9a0-ad15-48fe-b8dc-62a94863ea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:11.960622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e9a0-ad15-48fe-b8dc-62a94863ea00 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:11.961169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e9a0-ad15-48fe-b8dc-62a94863ea00 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:11.961714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e9a0-ad15-48fe-b8dc-62a94863ea00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:11.963173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4e9a0-ad15-48fe-b8dc-62a94863ea00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:11.963519 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9c87b-d59f-410f-93ed-35191cfdc613 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:11.965147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4e9a0-ad15-48fe-b8dc-62a94863ea00 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:11.971821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 74/145] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:49:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:11.973066 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4e9a0-ad15-48fe-b8dc-62a94863ea00 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:12.035343 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683dca5e-8fc5-457f-8416-4d93bc7cae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:12.036006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dca5e-8fc5-457f-8416-4d93bc7cae4f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:12.036296 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dca5e-8fc5-457f-8416-4d93bc7cae4f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:12.036575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dca5e-8fc5-457f-8416-4d93bc7cae4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:12.105623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:12.126702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683dca5e-8fc5-457f-8416-4d93bc7cae4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:12.128789 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683dca5e-8fc5-457f-8416-4d93bc7cae4f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:12.202260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4e9a0-ad15-48fe-b8dc-62a94863ea00 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:12.234554 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:12.256154 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 72/146] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:12.263936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683dca5e-8fc5-457f-8416-4d93bc7cae4f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:12.280800 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b581c53-a357-44ec-b9f6-608b4623dc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:12.281458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581c53-a357-44ec-b9f6-608b4623dc4b None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:12.281737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581c53-a357-44ec-b9f6-608b4623dc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:12.282017 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581c53-a357-44ec-b9f6-608b4623dc4b None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:12.282702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b581c53-a357-44ec-b9f6-608b4623dc4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:12.284245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b581c53-a357-44ec-b9f6-608b4623dc4b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:12.324426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 75/147] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:49:11 2022] POST /identity/v3/users => generated 283 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:49:12.459580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683dca5e-8fc5-457f-8416-4d93bc7cae4f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:12.517214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce0483-7575-4d6b-b995-f120a9779330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:12.517877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce0483-7575-4d6b-b995-f120a9779330 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:12.518158 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce0483-7575-4d6b-b995-f120a9779330 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:12.518433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce0483-7575-4d6b-b995-f120a9779330 None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:12.519619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce0483-7575-4d6b-b995-f120a9779330 None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:12.521129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce0483-7575-4d6b-b995-f120a9779330 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:12.523652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 73/148] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:12 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:12.530415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b581c53-a357-44ec-b9f6-608b4623dc4b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:12.681148 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b581c53-a357-44ec-b9f6-608b4623dc4b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:12.682854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:12.739795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d0426-3ba8-4ace-8e84-d5efbd713d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:12.740353 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d0426-3ba8-4ace-8e84-d5efbd713d12 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:12.740635 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d0426-3ba8-4ace-8e84-d5efbd713d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:12.740917 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d0426-3ba8-4ace-8e84-d5efbd713d12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:12.742186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d0426-3ba8-4ace-8e84-d5efbd713d12 None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=06d4e914e37a47ff940142feccfa5200, user.id=9aada59ce5bc4a1481277a87a82e45b5) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:12.742564 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d0426-3ba8-4ace-8e84-d5efbd713d12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:12.744113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d0426-3ba8-4ace-8e84-d5efbd713d12 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:12.757090 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 76/149] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:12 2022] GET /identity/v3/role_assignments?user.id=9aada59ce5bc4a1481277a87a82e45b5&scope.project.id=06d4e914e37a47ff940142feccfa5200&role.id=638e1fc82db44124ae615c46408110a7 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:13.430741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc79670-eb8c-4d9a-a521-5454ebd473e7 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:13.431495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc79670-eb8c-4d9a-a521-5454ebd473e7 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:13.431495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc79670-eb8c-4d9a-a521-5454ebd473e7 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:13.433128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 74/150] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:49:13.442100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ec9f1-fd93-4d5a-8648-afd8caff93c3 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:13.443007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ec9f1-fd93-4d5a-8648-afd8caff93c3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:13.443007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ec9f1-fd93-4d5a-8648-afd8caff93c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:13.467316 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-8e5ec9f1-fd93-4d5a-8648-afd8caff93c3 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:13.468609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8e5ec9f1-fd93-4d5a-8648-afd8caff93c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:13.555276 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 77/151] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:13.591648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc79670-eb8c-4d9a-a521-5454ebd473e7 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:13.674122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:13.745755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc79670-eb8c-4d9a-a521-5454ebd473e7 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:13.795635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586a3f3-ba0d-45b6-b89e-e41533934194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:13.796342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586a3f3-ba0d-45b6-b89e-e41533934194 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:13.796631 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586a3f3-ba0d-45b6-b89e-e41533934194 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:13.796907 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586a3f3-ba0d-45b6-b89e-e41533934194 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:13.812764 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586a3f3-ba0d-45b6-b89e-e41533934194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-8586a3f3-ba0d-45b6-b89e-e41533934194 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:13.817805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:13.819934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:13.821771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:13.821771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:13.821771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:13.821771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:13.821771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:13.821771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:13.821771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:13.821771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:13.821771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:13.821771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:13.821771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:13.821771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:13.821771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 75/152] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:13.825192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ec9f1-fd93-4d5a-8648-afd8caff93c3 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:13.880314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f1ad1-522a-4a0c-bdfa-d67cd8f5d2e6 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:13.880732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f1ad1-522a-4a0c-bdfa-d67cd8f5d2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:13.880970 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f1ad1-522a-4a0c-bdfa-d67cd8f5d2e6 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:13.883085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 76/153] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:13.892622 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be832ee-4426-4778-a411-28f09335b15f None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:13.892997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be832ee-4426-4778-a411-28f09335b15f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:13.893292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be832ee-4426-4778-a411-28f09335b15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:13.926911 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-8be832ee-4426-4778-a411-28f09335b15f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:13.928316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8be832ee-4426-4778-a411-28f09335b15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:13.958853 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:13.966040 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ec9f1-fd93-4d5a-8648-afd8caff93c3 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:14.011298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676dc43-2b6e-4b57-a012-1e36b37c61a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:14.011832 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676dc43-2b6e-4b57-a012-1e36b37c61a2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:14.012178 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676dc43-2b6e-4b57-a012-1e36b37c61a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:14.012445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676dc43-2b6e-4b57-a012-1e36b37c61a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:14.013143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676dc43-2b6e-4b57-a012-1e36b37c61a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:14.013445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676dc43-2b6e-4b57-a012-1e36b37c61a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:14.014869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676dc43-2b6e-4b57-a012-1e36b37c61a2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:14.033269 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 78/154] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:14.038821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca81f6-91cd-4b27-b73e-6b8770faf007 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:14.039332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca81f6-91cd-4b27-b73e-6b8770faf007 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:14.039826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca81f6-91cd-4b27-b73e-6b8770faf007 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:14.043596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 79/155] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:14.052155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca81f6-91cd-4b27-b73e-6b8770faf007 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:14.071978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 77/156] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:49:14.073223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dcaf9-3d7e-499b-bed5-7f10dbfef584 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:14.073619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dcaf9-3d7e-499b-bed5-7f10dbfef584 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:14.073906 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dcaf9-3d7e-499b-bed5-7f10dbfef584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:14.098643 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-012dcaf9-3d7e-499b-bed5-7f10dbfef584 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:14.099962 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-012dcaf9-3d7e-499b-bed5-7f10dbfef584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:14.169586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:14.223033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 78/157] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:14.223952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dcaf9-3d7e-499b-bed5-7f10dbfef584 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:14.273350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca81f6-91cd-4b27-b73e-6b8770faf007 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:14.335119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7b3c8-9515-4add-a474-aac4ef0b144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:14.336146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7b3c8-9515-4add-a474-aac4ef0b144e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:14.336306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7b3c8-9515-4add-a474-aac4ef0b144e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:14.336731 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7b3c8-9515-4add-a474-aac4ef0b144e None admin] PATH_INFO: `/v3/users/2bf11b0baf04484ca570c05d33f49c63` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:14.339404 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7b3c8-9515-4add-a474-aac4ef0b144e None admin] RBAC: Authorizing `identity:get_user(user_id=2bf11b0baf04484ca570c05d33f49c63)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:14.339404 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7b3c8-9515-4add-a474-aac4ef0b144e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:14.341132 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 80/158] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:14 2022] GET /identity/v3/users/2bf11b0baf04484ca570c05d33f49c63 => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:14.342429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446e639-874f-4250-a9ec-f5e22ecb5b5d None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:14.342742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446e639-874f-4250-a9ec-f5e22ecb5b5d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:14.343039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446e639-874f-4250-a9ec-f5e22ecb5b5d None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:14.344666 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 81/159] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:14.345645 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446e639-874f-4250-a9ec-f5e22ecb5b5d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:14.389305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:14.430425 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dcaf9-3d7e-499b-bed5-7f10dbfef584 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:14.474659 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15b3ff-d545-4378-b460-ab24ea424079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:14.475822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15b3ff-d545-4378-b460-ab24ea424079 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:14.475822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15b3ff-d545-4378-b460-ab24ea424079 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:14.476493 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15b3ff-d545-4378-b460-ab24ea424079 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:14.489930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15b3ff-d545-4378-b460-ab24ea424079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-2d15b3ff-d545-4378-b460-ab24ea424079 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:14.495837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:14.499355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:14.502677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:14.502677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:14.502677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:14.502677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:14.502677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:14.502677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:14.502677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:14.502677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:14.502677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:14.502677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:14.502677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:14.502677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:14.502677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 79/160] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:14.502677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55fc18-2f49-4e2d-9b8a-b5ea504dc830 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:14.512585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55fc18-2f49-4e2d-9b8a-b5ea504dc830 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:14.512585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55fc18-2f49-4e2d-9b8a-b5ea504dc830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:14.541240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-aa55fc18-2f49-4e2d-9b8a-b5ea504dc830 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:14.542441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-aa55fc18-2f49-4e2d-9b8a-b5ea504dc830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:14.577725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446e639-874f-4250-a9ec-f5e22ecb5b5d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:14.605006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:14.680157 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8593c96-d2d0-4f60-98a7-c67fe0c11f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:14.680866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8593c96-d2d0-4f60-98a7-c67fe0c11f39 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:14.681225 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8593c96-d2d0-4f60-98a7-c67fe0c11f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:14.681480 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8593c96-d2d0-4f60-98a7-c67fe0c11f39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:14.713864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8593c96-d2d0-4f60-98a7-c67fe0c11f39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:14.714581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 80/161] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:14.715476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55fc18-2f49-4e2d-9b8a-b5ea504dc830 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-f8593c96-d2d0-4f60-98a7-c67fe0c11f39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:14.723819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:14.727839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:14.731391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:14.731391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:14.731391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:14.731391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:14.731391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:14.731391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:14.731391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:14.731391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:14.731391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:14.731391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:14.731391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:14.731391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:14.731391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 82/162] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:14.731391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8593c96-d2d0-4f60-98a7-c67fe0c11f39 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:14.923203 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55fc18-2f49-4e2d-9b8a-b5ea504dc830 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:14.961939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93df69e-a3ad-4cda-90dd-0d9af0f05388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:14.962631 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93df69e-a3ad-4cda-90dd-0d9af0f05388 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:14.962921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93df69e-a3ad-4cda-90dd-0d9af0f05388 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:14.963395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93df69e-a3ad-4cda-90dd-0d9af0f05388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:14.994057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:15.004643 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:15.052020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8593c96-d2d0-4f60-98a7-c67fe0c11f39 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:15.078226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93df69e-a3ad-4cda-90dd-0d9af0f05388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:15.080840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93df69e-a3ad-4cda-90dd-0d9af0f05388 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:15.138487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5027db-256a-4b4b-9673-e6059bb1586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:15.139457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5027db-256a-4b4b-9673-e6059bb1586e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:15.139937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5027db-256a-4b4b-9673-e6059bb1586e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:15.140391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5027db-256a-4b4b-9673-e6059bb1586e None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:15.142652 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5027db-256a-4b4b-9673-e6059bb1586e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:15.144041 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5027db-256a-4b4b-9673-e6059bb1586e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:15.147669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5027db-256a-4b4b-9673-e6059bb1586e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:15.173086 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 83/163] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:15.174334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5027db-256a-4b4b-9673-e6059bb1586e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:15.295807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 81/164] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:15.297055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93df69e-a3ad-4cda-90dd-0d9af0f05388 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:15.368439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:15.415265 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93df69e-a3ad-4cda-90dd-0d9af0f05388 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:15.464090 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5027db-256a-4b4b-9673-e6059bb1586e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:15.486191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6f16d-553e-4127-af23-c60c45d88ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:15.488755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6f16d-553e-4127-af23-c60c45d88ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:15.489514 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6f16d-553e-4127-af23-c60c45d88ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:15.490712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6f16d-553e-4127-af23-c60c45d88ae2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:15.513292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6f16d-553e-4127-af23-c60c45d88ae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-0db6f16d-553e-4127-af23-c60c45d88ae2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:15.522626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:15.524358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:15.525204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:15.525204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:15.525204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:15.525204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:15.525204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:15.525204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:15.525204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:15.525204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:15.525204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:15.525204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:15.525204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:15.525204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:15.528638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 82/165] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:49:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:15.531432 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6f16d-553e-4127-af23-c60c45d88ae2 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:15.550168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff258971-ec9c-4756-a66e-f6c81b35f271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:15.551236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff258971-ec9c-4756-a66e-f6c81b35f271 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:15.551785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff258971-ec9c-4756-a66e-f6c81b35f271 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:15.552308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff258971-ec9c-4756-a66e-f6c81b35f271 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:15.553237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff258971-ec9c-4756-a66e-f6c81b35f271 None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:15.553748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff258971-ec9c-4756-a66e-f6c81b35f271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:15.555962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff258971-ec9c-4756-a66e-f6c81b35f271 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:15.578760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 84/166] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:15.582277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff258971-ec9c-4756-a66e-f6c81b35f271 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:15.613688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:15.716337 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6f16d-553e-4127-af23-c60c45d88ae2 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:15.744485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:15.756118 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3413f0e-f022-4467-badd-6465a0ac1a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:15.756859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3413f0e-f022-4467-badd-6465a0ac1a70 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:15.757296 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3413f0e-f022-4467-badd-6465a0ac1a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:15.757601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3413f0e-f022-4467-badd-6465a0ac1a70 None admin] PATH_INFO: `/v3/users/0d6d5f0e5b4349f4877d4d22af1545b8` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:15.758953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3413f0e-f022-4467-badd-6465a0ac1a70 None admin] RBAC: Authorizing `identity:get_user(user_id=0d6d5f0e5b4349f4877d4d22af1545b8)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:15.760570 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3413f0e-f022-4467-badd-6465a0ac1a70 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:15.762437 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 83/167] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:15 2022] GET /identity/v3/users/0d6d5f0e5b4349f4877d4d22af1545b8 => generated 289 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:15.763936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3413f0e-f022-4467-badd-6465a0ac1a70 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:15.878709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3413f0e-f022-4467-badd-6465a0ac1a70 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:15.918427 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd63c0-a4ac-49eb-a07a-52f7d8ece48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:15.919122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd63c0-a4ac-49eb-a07a-52f7d8ece48b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:15.919405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd63c0-a4ac-49eb-a07a-52f7d8ece48b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:15.923942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd63c0-a4ac-49eb-a07a-52f7d8ece48b None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:15.923942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd63c0-a4ac-49eb-a07a-52f7d8ece48b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:15.923942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd63c0-a4ac-49eb-a07a-52f7d8ece48b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:15.923942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd63c0-a4ac-49eb-a07a-52f7d8ece48b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:15.933185 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 84/168] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:49:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:15.933783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd63c0-a4ac-49eb-a07a-52f7d8ece48b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:15.982065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff258971-ec9c-4756-a66e-f6c81b35f271 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:16.008543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:16.064250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd63c0-a4ac-49eb-a07a-52f7d8ece48b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:16.078666 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe100f-1172-4d32-9186-b43de4d17dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:16.079392 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe100f-1172-4d32-9186-b43de4d17dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:16.079677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe100f-1172-4d32-9186-b43de4d17dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:16.080001 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe100f-1172-4d32-9186-b43de4d17dd6 None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:16.081175 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe100f-1172-4d32-9186-b43de4d17dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:16.085890 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe100f-1172-4d32-9186-b43de4d17dd6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:16.087687 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 85/169] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:15 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:16.092814 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe100f-1172-4d32-9186-b43de4d17dd6 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:16.142164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89ad32-7bfd-40c2-bb4f-e96c72f4ac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:16.143034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89ad32-7bfd-40c2-bb4f-e96c72f4ac1f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:16.143317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89ad32-7bfd-40c2-bb4f-e96c72f4ac1f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:16.143591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89ad32-7bfd-40c2-bb4f-e96c72f4ac1f None admin] PATH_INFO: `/v3/users/2bf11b0baf04484ca570c05d33f49c63` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:16.146211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89ad32-7bfd-40c2-bb4f-e96c72f4ac1f None admin] RBAC: Authorizing `identity:get_user(user_id=2bf11b0baf04484ca570c05d33f49c63)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:16.150070 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89ad32-7bfd-40c2-bb4f-e96c72f4ac1f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:16.151827 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 85/170] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:15 2022] GET /identity/v3/users/2bf11b0baf04484ca570c05d33f49c63 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:16.153698 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89ad32-7bfd-40c2-bb4f-e96c72f4ac1f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:16.249570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:16.314892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89ad32-7bfd-40c2-bb4f-e96c72f4ac1f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:16.315952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe100f-1172-4d32-9186-b43de4d17dd6 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:16.365217 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:16.396824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa75cd-9dd0-4971-a308-9719773fa9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:16.398033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa75cd-9dd0-4971-a308-9719773fa9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:16.398443 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa75cd-9dd0-4971-a308-9719773fa9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:16.398840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa75cd-9dd0-4971-a308-9719773fa9b1 None admin] PATH_INFO: `/v3/users/2bf11b0baf04484ca570c05d33f49c63` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:16.400569 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa75cd-9dd0-4971-a308-9719773fa9b1 None admin] RBAC: Authorizing `identity:get_user(user_id=2bf11b0baf04484ca570c05d33f49c63)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:16.402227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa75cd-9dd0-4971-a308-9719773fa9b1 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:16.404512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 86/171] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:16 2022] GET /identity/v3/users/2bf11b0baf04484ca570c05d33f49c63 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:16.407860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa75cd-9dd0-4971-a308-9719773fa9b1 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:16.438167 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffe548-1ad7-4a1b-98a2-f66ed6e1df5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:16.439249 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffe548-1ad7-4a1b-98a2-f66ed6e1df5a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:16.439739 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffe548-1ad7-4a1b-98a2-f66ed6e1df5a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:16.440235 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffe548-1ad7-4a1b-98a2-f66ed6e1df5a None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:16.448711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffe548-1ad7-4a1b-98a2-f66ed6e1df5a None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:16.451483 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffe548-1ad7-4a1b-98a2-f66ed6e1df5a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:16.454975 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 86/172] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:16 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:16.456589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffe548-1ad7-4a1b-98a2-f66ed6e1df5a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:16.585343 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa75cd-9dd0-4971-a308-9719773fa9b1 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:16.707100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a2177-2158-4077-bcdd-4e9bfce282cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:16.708202 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a2177-2158-4077-bcdd-4e9bfce282cd None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:16.708716 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a2177-2158-4077-bcdd-4e9bfce282cd None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:16.709165 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a2177-2158-4077-bcdd-4e9bfce282cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:16.710144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a2177-2158-4077-bcdd-4e9bfce282cd None admin] RBAC: Adding query filter params (role.id=93e4ae64906f4b0ea861a4ac4571f1d7, scope.project.id=06d4e914e37a47ff940142feccfa5200, user.id=2bf11b0baf04484ca570c05d33f49c63) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:16.710670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a2177-2158-4077-bcdd-4e9bfce282cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:16.712414 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a2177-2158-4077-bcdd-4e9bfce282cd None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:16.719774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 87/173] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:16 2022] GET /identity/v3/role_assignments?user.id=2bf11b0baf04484ca570c05d33f49c63&scope.project.id=06d4e914e37a47ff940142feccfa5200&role.id=93e4ae64906f4b0ea861a4ac4571f1d7 => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:16.721456 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8407a26-e27d-4c03-b21b-40cdeaf033cd None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:16.721993 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8407a26-e27d-4c03-b21b-40cdeaf033cd None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:16.722485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8407a26-e27d-4c03-b21b-40cdeaf033cd None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:16.724170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 88/174] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:16.725213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8407a26-e27d-4c03-b21b-40cdeaf033cd None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:16.759529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffe548-1ad7-4a1b-98a2-f66ed6e1df5a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:16.913928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e6360-7de2-4c21-8de6-f3e407975487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:16.915119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e6360-7de2-4c21-8de6-f3e407975487 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:16.915403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e6360-7de2-4c21-8de6-f3e407975487 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:16.915951 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e6360-7de2-4c21-8de6-f3e407975487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:16.924316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:16.970021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:17.026173 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8407a26-e27d-4c03-b21b-40cdeaf033cd None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:17.069089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9dd75-30b6-4e57-bc14-c60ea1a8dff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:17.071568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9dd75-30b6-4e57-bc14-c60ea1a8dff7 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:17.072101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9dd75-30b6-4e57-bc14-c60ea1a8dff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:17.072574 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9dd75-30b6-4e57-bc14-c60ea1a8dff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:17.073354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e6360-7de2-4c21-8de6-f3e407975487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:17.074860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e6360-7de2-4c21-8de6-f3e407975487 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:17.169379 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9dd75-30b6-4e57-bc14-c60ea1a8dff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:17.171286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9dd75-30b6-4e57-bc14-c60ea1a8dff7 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:17.212108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 87/175] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:17.213135 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e6360-7de2-4c21-8de6-f3e407975487 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:17.244531 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:17.267316 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:17.302198 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 89/176] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:17.303849 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f67309-6186-4841-b953-d9d189b31abe None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:17.304901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f67309-6186-4841-b953-d9d189b31abe None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:17.305398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f67309-6186-4841-b953-d9d189b31abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:17.324866 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-13f67309-6186-4841-b953-d9d189b31abe None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:17.326081 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-13f67309-6186-4841-b953-d9d189b31abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:17.334419 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e6360-7de2-4c21-8de6-f3e407975487 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:17.387662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619aa251-164c-4c5f-8b13-83ce3fc0e0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:17.388399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aa251-164c-4c5f-8b13-83ce3fc0e0da None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:17.388688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aa251-164c-4c5f-8b13-83ce3fc0e0da None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:17.388965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aa251-164c-4c5f-8b13-83ce3fc0e0da None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200/users/0d6d5f0e5b4349f4877d4d22af1545b8/roles/347f011f3e624778b2823ef73698f6ad` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:17.393011 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619aa251-164c-4c5f-8b13-83ce3fc0e0da None admin] RBAC: Authorizing `identity:create_grant(project_id=06d4e914e37a47ff940142feccfa5200, user_id=0d6d5f0e5b4349f4877d4d22af1545b8, role_id=347f011f3e624778b2823ef73698f6ad)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:17.395302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619aa251-164c-4c5f-8b13-83ce3fc0e0da None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:17.420038 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 88/177] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:49:17 2022] PUT /identity/v3/projects/06d4e914e37a47ff940142feccfa5200/users/0d6d5f0e5b4349f4877d4d22af1545b8/roles/347f011f3e624778b2823ef73698f6ad => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:49:17.420038 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619aa251-164c-4c5f-8b13-83ce3fc0e0da None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:17.432846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 90/178] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:17.434979 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35230114-33e7-4094-a92d-a9c043f4a213 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:17.435519 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35230114-33e7-4094-a92d-a9c043f4a213 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:17.436002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35230114-33e7-4094-a92d-a9c043f4a213 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:17.437987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 91/179] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:17.439473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35230114-33e7-4094-a92d-a9c043f4a213 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:17.597007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619aa251-164c-4c5f-8b13-83ce3fc0e0da None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:17.599442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:17.614248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:17.628186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35230114-33e7-4094-a92d-a9c043f4a213 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:17.673534 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44748c5f-f8dd-41ed-a5fe-128aaaacd8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:17.673878 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b7e30-a9e2-4c2b-a1e4-cf04ac7f978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:17.674493 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b7e30-a9e2-4c2b-a1e4-cf04ac7f978c None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:17.674590 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44748c5f-f8dd-41ed-a5fe-128aaaacd8ef None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:17.674769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b7e30-a9e2-4c2b-a1e4-cf04ac7f978c None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:17.675036 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b7e30-a9e2-4c2b-a1e4-cf04ac7f978c None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:17.675127 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44748c5f-f8dd-41ed-a5fe-128aaaacd8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:17.675558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44748c5f-f8dd-41ed-a5fe-128aaaacd8ef None admin] PATH_INFO: `/v3/projects/1f8d583814064471826ccf18ea8422e3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:17.676360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b7e30-a9e2-4c2b-a1e4-cf04ac7f978c None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:17.677634 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44748c5f-f8dd-41ed-a5fe-128aaaacd8ef None admin] RBAC: Authorizing `identity:get_project(project_id=1f8d583814064471826ccf18ea8422e3)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:17.678129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b7e30-a9e2-4c2b-a1e4-cf04ac7f978c None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:17.680088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 92/180] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:17 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:17.680602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44748c5f-f8dd-41ed-a5fe-128aaaacd8ef None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:17.681599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93caeb-a04c-4044-b2df-551dfca1c651 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:17.682066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93caeb-a04c-4044-b2df-551dfca1c651 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:17.682490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93caeb-a04c-4044-b2df-551dfca1c651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:17.683363 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 89/181] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:17 2022] GET /identity/v3/projects/1f8d583814064471826ccf18ea8422e3 => generated 312 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:17.684752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44748c5f-f8dd-41ed-a5fe-128aaaacd8ef None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:17.708173 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-bf93caeb-a04c-4044-b2df-551dfca1c651 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:17.710368 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-bf93caeb-a04c-4044-b2df-551dfca1c651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:17.816093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 93/182] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:17.824281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ab81b-d277-4e96-af97-de87fabb62f4 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:17.824764 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ab81b-d277-4e96-af97-de87fabb62f4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:17.825356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ab81b-d277-4e96-af97-de87fabb62f4 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:17.827135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 94/183] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:17.828055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ab81b-d277-4e96-af97-de87fabb62f4 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:17.855382 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44748c5f-f8dd-41ed-a5fe-128aaaacd8ef None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:17.902927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd1852-d89b-45b6-a303-ddc06cd9ff79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:17.904144 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1852-d89b-45b6-a303-ddc06cd9ff79 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:17.904429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1852-d89b-45b6-a303-ddc06cd9ff79 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:17.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1852-d89b-45b6-a303-ddc06cd9ff79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:17.917126 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd1852-d89b-45b6-a303-ddc06cd9ff79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-5fcd1852-d89b-45b6-a303-ddc06cd9ff79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:17.922426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:17.924409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:17.926138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:17.926138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:17.926138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:17.926138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:17.926138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:17.926138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:17.926138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:17.926138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:17.926138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:17.926138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:17.926138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:17.926138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:17.926138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 90/184] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:49:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:17.926138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd1852-d89b-45b6-a303-ddc06cd9ff79 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:17.966993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:17.978829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:18.012533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ab81b-d277-4e96-af97-de87fabb62f4 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:18.069669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd1852-d89b-45b6-a303-ddc06cd9ff79 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:18.075777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13fd1f-c5ed-4d2d-be63-8c61061558db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:18.076887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13fd1f-c5ed-4d2d-be63-8c61061558db None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:18.077390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13fd1f-c5ed-4d2d-be63-8c61061558db None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:18.077892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13fd1f-c5ed-4d2d-be63-8c61061558db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:18.079232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13fd1f-c5ed-4d2d-be63-8c61061558db None admin] RBAC: Adding query filter params (role.id=b94b02b271d44f1195f1093a6202a947, scope.project.id=06d4e914e37a47ff940142feccfa5200, user.id=2bf11b0baf04484ca570c05d33f49c63) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:18.079805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13fd1f-c5ed-4d2d-be63-8c61061558db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:18.082314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13fd1f-c5ed-4d2d-be63-8c61061558db None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:18.103991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 95/185] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:17 2022] GET /identity/v3/role_assignments?user.id=2bf11b0baf04484ca570c05d33f49c63&scope.project.id=06d4e914e37a47ff940142feccfa5200&role.id=b94b02b271d44f1195f1093a6202a947 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:18.103991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4c893-9375-4ac0-b4d3-eaae9d0cc606 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:18.103991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4c893-9375-4ac0-b4d3-eaae9d0cc606 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:18.103991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4c893-9375-4ac0-b4d3-eaae9d0cc606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:18.117328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38653b1-e993-4726-af46-2b6b34b932f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:18.118255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38653b1-e993-4726-af46-2b6b34b932f8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:18.118645 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38653b1-e993-4726-af46-2b6b34b932f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:18.119105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38653b1-e993-4726-af46-2b6b34b932f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:18.120471 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38653b1-e993-4726-af46-2b6b34b932f8 None admin] RBAC: Adding query filter params (role.id=93e4ae64906f4b0ea861a4ac4571f1d7, scope.project.id=1f8d583814064471826ccf18ea8422e3, user.id=2bf11b0baf04484ca570c05d33f49c63) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:18.120930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38653b1-e993-4726-af46-2b6b34b932f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:18.123780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38653b1-e993-4726-af46-2b6b34b932f8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:18.131934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-08a4c893-9375-4ac0-b4d3-eaae9d0cc606 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:18.134077 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-08a4c893-9375-4ac0-b4d3-eaae9d0cc606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:18.136098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 91/186] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:17 2022] GET /identity/v3/role_assignments?user.id=2bf11b0baf04484ca570c05d33f49c63&scope.project.id=1f8d583814064471826ccf18ea8422e3&role.id=93e4ae64906f4b0ea861a4ac4571f1d7 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:18.138083 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38653b1-e993-4726-af46-2b6b34b932f8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:18.289272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 96/187] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:18.291146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4c893-9375-4ac0-b4d3-eaae9d0cc606 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:18.405160 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:18.410655 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38653b1-e993-4726-af46-2b6b34b932f8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:18.461721 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48be9ce-629e-49e9-9877-8767866b6b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:18.462481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48be9ce-629e-49e9-9877-8767866b6b0f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:18.462778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48be9ce-629e-49e9-9877-8767866b6b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:18.463052 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48be9ce-629e-49e9-9877-8767866b6b0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:18.474802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:18.480345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48be9ce-629e-49e9-9877-8767866b6b0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e48be9ce-629e-49e9-9877-8767866b6b0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:18.486481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:18.488753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:18.490226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:18.490226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:18.490226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:18.490226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:18.490226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:18.490226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:18.490226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:18.490226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:18.490226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:18.490226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:18.490226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:18.490226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:18.490226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 92/188] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:49:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:18.490226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48be9ce-629e-49e9-9877-8767866b6b0f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:18.546361 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4c893-9375-4ac0-b4d3-eaae9d0cc606 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:18.607376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68eeed-03e4-4a17-a20d-4e40e970015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:18.608584 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68eeed-03e4-4a17-a20d-4e40e970015f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:18.609043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68eeed-03e4-4a17-a20d-4e40e970015f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:18.609517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68eeed-03e4-4a17-a20d-4e40e970015f None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:18.610747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68eeed-03e4-4a17-a20d-4e40e970015f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:18.611298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68eeed-03e4-4a17-a20d-4e40e970015f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:18.614033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68eeed-03e4-4a17-a20d-4e40e970015f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:18.626149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 97/189] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:18.626747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68eeed-03e4-4a17-a20d-4e40e970015f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:18.696205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48be9ce-629e-49e9-9877-8767866b6b0f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:18.756629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184e064-6c06-4592-b4de-74bff13972ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:18.757779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184e064-6c06-4592-b4de-74bff13972ac None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:18.758189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184e064-6c06-4592-b4de-74bff13972ac None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:18.758601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184e064-6c06-4592-b4de-74bff13972ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:18.760706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184e064-6c06-4592-b4de-74bff13972ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:18.762690 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184e064-6c06-4592-b4de-74bff13972ac None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:18.765549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 93/190] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:49:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:18.766801 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184e064-6c06-4592-b4de-74bff13972ac None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:18.777825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68eeed-03e4-4a17-a20d-4e40e970015f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:18.817021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:18.825105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcc54c-d869-4751-a22c-37a1662c952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:18.826157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcc54c-d869-4751-a22c-37a1662c952b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:18.826668 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcc54c-d869-4751-a22c-37a1662c952b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:18.828719 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcc54c-d869-4751-a22c-37a1662c952b None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:18.828719 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcc54c-d869-4751-a22c-37a1662c952b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:18.829037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcc54c-d869-4751-a22c-37a1662c952b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:18.831705 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcc54c-d869-4751-a22c-37a1662c952b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:18.843347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:18.854861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 98/191] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:49:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:18.854861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcc54c-d869-4751-a22c-37a1662c952b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:18.923220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184e064-6c06-4592-b4de-74bff13972ac None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:18.970969 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66288e50-b844-40e8-add3-a4b9868964d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:18.971616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66288e50-b844-40e8-add3-a4b9868964d8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:18.971892 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66288e50-b844-40e8-add3-a4b9868964d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:18.972220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66288e50-b844-40e8-add3-a4b9868964d8 None admin] PATH_INFO: `/v3/users/7630899e2fc54b939129d47ec76c1b03` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:18.991245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66288e50-b844-40e8-add3-a4b9868964d8 None admin] RBAC: Authorizing `identity:get_user(user_id=7630899e2fc54b939129d47ec76c1b03)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:18.994135 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66288e50-b844-40e8-add3-a4b9868964d8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:19.002718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 94/192] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:18 2022] GET /identity/v3/users/7630899e2fc54b939129d47ec76c1b03 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:19.002718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66288e50-b844-40e8-add3-a4b9868964d8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:19.018996 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcc54c-d869-4751-a22c-37a1662c952b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:19.060591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626deb7-72cc-4cf9-83af-381723f18ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:19.061202 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626deb7-72cc-4cf9-83af-381723f18ac5 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:19.061474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626deb7-72cc-4cf9-83af-381723f18ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:19.061744 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626deb7-72cc-4cf9-83af-381723f18ac5 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:19.062395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626deb7-72cc-4cf9-83af-381723f18ac5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:19.063866 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626deb7-72cc-4cf9-83af-381723f18ac5 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:19.100052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 99/193] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:49:18 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:49:19.100052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626deb7-72cc-4cf9-83af-381723f18ac5 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:19.173781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:19.192229 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66288e50-b844-40e8-add3-a4b9868964d8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:19.213851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:19.243554 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af58582-81af-47f8-b160-c1e3d09ceba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:19.244567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af58582-81af-47f8-b160-c1e3d09ceba5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:19.245033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af58582-81af-47f8-b160-c1e3d09ceba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:19.245469 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af58582-81af-47f8-b160-c1e3d09ceba5 None admin] PATH_INFO: `/v3/users/7630899e2fc54b939129d47ec76c1b03` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:19.247029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af58582-81af-47f8-b160-c1e3d09ceba5 None admin] RBAC: Authorizing `identity:get_user(user_id=7630899e2fc54b939129d47ec76c1b03)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:19.248855 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af58582-81af-47f8-b160-c1e3d09ceba5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:19.251105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 95/194] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:18 2022] GET /identity/v3/users/7630899e2fc54b939129d47ec76c1b03 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:19.261377 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af58582-81af-47f8-b160-c1e3d09ceba5 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:19.280596 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626deb7-72cc-4cf9-83af-381723f18ac5 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:19.344485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f7bf7-9b57-4e03-b4e3-a67d473c3a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:19.345452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f7bf7-9b57-4e03-b4e3-a67d473c3a40 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:19.345916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f7bf7-9b57-4e03-b4e3-a67d473c3a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:19.346377 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f7bf7-9b57-4e03-b4e3-a67d473c3a40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:19.443248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af58582-81af-47f8-b160-c1e3d09ceba5 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:19.474404 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f7bf7-9b57-4e03-b4e3-a67d473c3a40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:19.478749 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f7bf7-9b57-4e03-b4e3-a67d473c3a40 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:19.505845 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a086f-7b75-4b88-be79-ae7d49e2f6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:19.506487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a086f-7b75-4b88-be79-ae7d49e2f6ef None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:19.506764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a086f-7b75-4b88-be79-ae7d49e2f6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:19.508047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a086f-7b75-4b88-be79-ae7d49e2f6ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:19.542928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:19.596735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:19.613034 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a086f-7b75-4b88-be79-ae7d49e2f6ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:19.615053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a086f-7b75-4b88-be79-ae7d49e2f6ef None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:19.713638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 100/195] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:19.715053 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cdf3b-f7b6-42a6-b328-2a2ecfa33ba4 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:19.715421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cdf3b-f7b6-42a6-b328-2a2ecfa33ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:19.715765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cdf3b-f7b6-42a6-b328-2a2ecfa33ba4 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:19.717267 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 101/196] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:19.722984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3566034-52a6-4ba8-95ac-886da354c482 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:19.723379 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3566034-52a6-4ba8-95ac-886da354c482 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:19.723720 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3566034-52a6-4ba8-95ac-886da354c482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:19.745155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-a3566034-52a6-4ba8-95ac-886da354c482 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:19.746453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a3566034-52a6-4ba8-95ac-886da354c482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:19.775246 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 96/197] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:19.776099 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a086f-7b75-4b88-be79-ae7d49e2f6ef None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:19.825246 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 102/198] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:49:19.826196 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3566034-52a6-4ba8-95ac-886da354c482 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:19.865255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:19.928181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a086f-7b75-4b88-be79-ae7d49e2f6ef None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:19.948978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:19.973252 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3566034-52a6-4ba8-95ac-886da354c482 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:19.974474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b330b6a-31d3-4344-aa57-47193c1a92a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:19.975515 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b330b6a-31d3-4344-aa57-47193c1a92a0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:19.977439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b330b6a-31d3-4344-aa57-47193c1a92a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:19.977995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b330b6a-31d3-4344-aa57-47193c1a92a0 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:19.979464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b330b6a-31d3-4344-aa57-47193c1a92a0 None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:19.981226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b330b6a-31d3-4344-aa57-47193c1a92a0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:19.983656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 97/199] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:19 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:19.985379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b330b6a-31d3-4344-aa57-47193c1a92a0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:20.024921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379c815-42a0-4a55-ba01-a16ab3711df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:20.025821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379c815-42a0-4a55-ba01-a16ab3711df8 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:20.026110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379c815-42a0-4a55-ba01-a16ab3711df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:20.026387 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379c815-42a0-4a55-ba01-a16ab3711df8 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:20.027742 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379c815-42a0-4a55-ba01-a16ab3711df8 None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:20.030003 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379c815-42a0-4a55-ba01-a16ab3711df8 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:20.032325 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 103/200] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:19 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:20.033826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379c815-42a0-4a55-ba01-a16ab3711df8 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:20.121351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b330b6a-31d3-4344-aa57-47193c1a92a0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:20.152099 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:20.171435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e052ba-b9f3-4610-a30a-e4db1ed28c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:20.172499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e052ba-b9f3-4610-a30a-e4db1ed28c38 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:20.172947 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e052ba-b9f3-4610-a30a-e4db1ed28c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:20.173356 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e052ba-b9f3-4610-a30a-e4db1ed28c38 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:20.178427 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379c815-42a0-4a55-ba01-a16ab3711df8 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:20.188625 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e052ba-b9f3-4610-a30a-e4db1ed28c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-51e052ba-b9f3-4610-a30a-e4db1ed28c38 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:20.196602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:20.197670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:20.198457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:20.198457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:20.198457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:20.198457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:20.198457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:20.198457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:20.198457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:20.198457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:20.198457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:20.198457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:20.198457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:20.198457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:20.200725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 98/201] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:20.201824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e052ba-b9f3-4610-a30a-e4db1ed28c38 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:20.238535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07871ce2-7014-4b07-846b-70a351a650b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:20.239699 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07871ce2-7014-4b07-846b-70a351a650b6 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:20.240409 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07871ce2-7014-4b07-846b-70a351a650b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:20.241107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07871ce2-7014-4b07-846b-70a351a650b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:20.243358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07871ce2-7014-4b07-846b-70a351a650b6 None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=59fff2f6945340d0895b4123f3f1cc4a, user.id=7630899e2fc54b939129d47ec76c1b03) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:20.244067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07871ce2-7014-4b07-846b-70a351a650b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:20.247291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07871ce2-7014-4b07-846b-70a351a650b6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:20.258972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 104/202] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:20 2022] GET /identity/v3/role_assignments?user.id=7630899e2fc54b939129d47ec76c1b03&scope.project.id=59fff2f6945340d0895b4123f3f1cc4a&role.id=638e1fc82db44124ae615c46408110a7 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:20.260941 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07871ce2-7014-4b07-846b-70a351a650b6 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:20.305846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:20.338979 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e052ba-b9f3-4610-a30a-e4db1ed28c38 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:20.387538 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67599cf2-7496-4e61-9474-ec4da4cd83c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:20.388764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67599cf2-7496-4e61-9474-ec4da4cd83c1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:20.389407 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67599cf2-7496-4e61-9474-ec4da4cd83c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:20.390028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67599cf2-7496-4e61-9474-ec4da4cd83c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:20.392370 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67599cf2-7496-4e61-9474-ec4da4cd83c1 None admin] RBAC: Adding query filter params (role.id=b94b02b271d44f1195f1093a6202a947, scope.project.id=59fff2f6945340d0895b4123f3f1cc4a, user.id=7630899e2fc54b939129d47ec76c1b03) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:20.392370 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67599cf2-7496-4e61-9474-ec4da4cd83c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:20.395578 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67599cf2-7496-4e61-9474-ec4da4cd83c1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:20.408286 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 99/203] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:20 2022] GET /identity/v3/role_assignments?user.id=7630899e2fc54b939129d47ec76c1b03&scope.project.id=59fff2f6945340d0895b4123f3f1cc4a&role.id=b94b02b271d44f1195f1093a6202a947 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:20.459059 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07871ce2-7014-4b07-846b-70a351a650b6 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:20.535730 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac544c88-6445-4163-b8e2-6803f92a9a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:20.536546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac544c88-6445-4163-b8e2-6803f92a9a70 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:20.536860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac544c88-6445-4163-b8e2-6803f92a9a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:20.537134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac544c88-6445-4163-b8e2-6803f92a9a70 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:20.538909 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac544c88-6445-4163-b8e2-6803f92a9a70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:20.539453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac544c88-6445-4163-b8e2-6803f92a9a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:20.542109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac544c88-6445-4163-b8e2-6803f92a9a70 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:20.569634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 105/204] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:20.578922 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67599cf2-7496-4e61-9474-ec4da4cd83c1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:20.711394 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:20.810711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67599cf2-7496-4e61-9474-ec4da4cd83c1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:20.874079 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544c50f-e8c4-4526-82be-517a49e348ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:20.875166 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544c50f-e8c4-4526-82be-517a49e348ac None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:20.875654 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544c50f-e8c4-4526-82be-517a49e348ac None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:20.876169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544c50f-e8c4-4526-82be-517a49e348ac None admin] PATH_INFO: `/v3/users/0d6d5f0e5b4349f4877d4d22af1545b8` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:20.878233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544c50f-e8c4-4526-82be-517a49e348ac None admin] RBAC: Authorizing `identity:get_user(user_id=0d6d5f0e5b4349f4877d4d22af1545b8)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:20.885561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544c50f-e8c4-4526-82be-517a49e348ac None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:20.889158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 100/205] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:20 2022] GET /identity/v3/users/0d6d5f0e5b4349f4877d4d22af1545b8 => generated 289 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:20.901729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac544c88-6445-4163-b8e2-6803f92a9a70 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:21.119661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:21.171354 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac544c88-6445-4163-b8e2-6803f92a9a70 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:21.259800 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b7a67-b99e-4664-8722-8364cfc19705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:21.260777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b7a67-b99e-4664-8722-8364cfc19705 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:21.261248 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b7a67-b99e-4664-8722-8364cfc19705 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:21.261724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b7a67-b99e-4664-8722-8364cfc19705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:21.403793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b7a67-b99e-4664-8722-8364cfc19705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:21.406602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b7a67-b99e-4664-8722-8364cfc19705 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:21.589366 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:21.617352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 106/206] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:21.629080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544c50f-e8c4-4526-82be-517a49e348ac None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:21.760807 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544c50f-e8c4-4526-82be-517a49e348ac None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:21.777366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:21.812662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c615f42-c021-4039-9824-daadd0dec386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:21.813304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c615f42-c021-4039-9824-daadd0dec386 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:21.813582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c615f42-c021-4039-9824-daadd0dec386 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:21.813853 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c615f42-c021-4039-9824-daadd0dec386 None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:21.815021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c615f42-c021-4039-9824-daadd0dec386 None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:21.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c615f42-c021-4039-9824-daadd0dec386 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:21.818182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 101/207] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:21 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:21.826020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b7a67-b99e-4664-8722-8364cfc19705 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:22.082594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b7a67-b99e-4664-8722-8364cfc19705 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:22.144084 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a92f5-d41c-4be1-8a82-17c6de70814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:22.148119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f985a0-850b-4c4b-9d95-8bc64e03a534 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:22.149134 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f985a0-850b-4c4b-9d95-8bc64e03a534 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:22.149624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f985a0-850b-4c4b-9d95-8bc64e03a534 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:22.152306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 102/208] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:22.152427 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a92f5-d41c-4be1-8a82-17c6de70814f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:22.152950 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a92f5-d41c-4be1-8a82-17c6de70814f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:22.153454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a92f5-d41c-4be1-8a82-17c6de70814f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:22.154978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a92f5-d41c-4be1-8a82-17c6de70814f None admin] RBAC: Adding query filter params (role.id=347f011f3e624778b2823ef73698f6ad, scope.project.id=06d4e914e37a47ff940142feccfa5200, user.id=0d6d5f0e5b4349f4877d4d22af1545b8) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:22.155554 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a92f5-d41c-4be1-8a82-17c6de70814f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:22.160019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf9081-8436-4e0c-90b0-7922d40b3f31 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:22.160527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf9081-8436-4e0c-90b0-7922d40b3f31 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:22.161016 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf9081-8436-4e0c-90b0-7922d40b3f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:22.167226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a92f5-d41c-4be1-8a82-17c6de70814f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:22.191304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 107/209] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:21 2022] GET /identity/v3/role_assignments?user.id=0d6d5f0e5b4349f4877d4d22af1545b8&scope.project.id=06d4e914e37a47ff940142feccfa5200&role.id=347f011f3e624778b2823ef73698f6ad => generated 608 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:22.208204 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5bcf9081-8436-4e0c-90b0-7922d40b3f31 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:22.211108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5bcf9081-8436-4e0c-90b0-7922d40b3f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:22.310592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 103/210] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:22.358110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a92f5-d41c-4be1-8a82-17c6de70814f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:22.426742 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:22.530923 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a92f5-d41c-4be1-8a82-17c6de70814f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:22.603841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d10e09-ab48-4286-8be9-418236c6dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:22.604548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d10e09-ab48-4286-8be9-418236c6dd99 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:22.604832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d10e09-ab48-4286-8be9-418236c6dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:22.605109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d10e09-ab48-4286-8be9-418236c6dd99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:22.621793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d10e09-ab48-4286-8be9-418236c6dd99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-71d10e09-ab48-4286-8be9-418236c6dd99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:22.627153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:22.628146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:22.628952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:22.628952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:22.628952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:22.628952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:22.628952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:22.628952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:22.628952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:22.628952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:22.628952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:22.628952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:22.628952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:22.628952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:22.628952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 108/211] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:22.638968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf9081-8436-4e0c-90b0-7922d40b3f31 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:22.818561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf9081-8436-4e0c-90b0-7922d40b3f31 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:22.831867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:22.859702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89129936-565f-481b-b3cb-4ede8c9b61a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:22.860365 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89129936-565f-481b-b3cb-4ede8c9b61a6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:22.860649 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89129936-565f-481b-b3cb-4ede8c9b61a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:22.860927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89129936-565f-481b-b3cb-4ede8c9b61a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:22.861617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89129936-565f-481b-b3cb-4ede8c9b61a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:22.861922 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89129936-565f-481b-b3cb-4ede8c9b61a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:22.863387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89129936-565f-481b-b3cb-4ede8c9b61a6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:22.874350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 104/212] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:22.880381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d10e09-ab48-4286-8be9-418236c6dd99 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:23.026807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d10e09-ab48-4286-8be9-418236c6dd99 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:23.031396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:23.081378 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa318f-5678-466c-adca-eb8bd41162d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:23.082312 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa318f-5678-466c-adca-eb8bd41162d3 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:23.082741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa318f-5678-466c-adca-eb8bd41162d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:23.083594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa318f-5678-466c-adca-eb8bd41162d3 None admin] PATH_INFO: `/v3/users/31ec65dc69ce4be49ac5ba552e874c26` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:23.105058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa318f-5678-466c-adca-eb8bd41162d3 None admin] RBAC: Authorizing `identity:get_user(user_id=31ec65dc69ce4be49ac5ba552e874c26)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:23.107692 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa318f-5678-466c-adca-eb8bd41162d3 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:23.110926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 109/213] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:22 2022] GET /identity/v3/users/31ec65dc69ce4be49ac5ba552e874c26 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:23.120177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89129936-565f-481b-b3cb-4ede8c9b61a6 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:23.161407 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f4763-3079-4527-b0e0-ecf2e4a58e87 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:23.161765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f4763-3079-4527-b0e0-ecf2e4a58e87 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:23.162207 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f4763-3079-4527-b0e0-ecf2e4a58e87 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:23.165348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 110/214] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:23.173508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a645e3-136d-4417-b13a-032a18c6ec9f None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:23.173967 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a645e3-136d-4417-b13a-032a18c6ec9f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:23.174418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a645e3-136d-4417-b13a-032a18c6ec9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:23.204073 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-96a645e3-136d-4417-b13a-032a18c6ec9f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:23.206104 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-96a645e3-136d-4417-b13a-032a18c6ec9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:23.297337 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89129936-565f-481b-b3cb-4ede8c9b61a6 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:23.316754 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 111/215] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:23.319416 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51f427-ebcd-413c-8c7b-e38b735f3a19 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:23.319881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51f427-ebcd-413c-8c7b-e38b735f3a19 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:23.320379 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51f427-ebcd-413c-8c7b-e38b735f3a19 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:23.323144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 112/216] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:23.333877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9a9a-f9d9-41fe-872c-c4ef53311d73 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:23.334524 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9a9a-f9d9-41fe-872c-c4ef53311d73 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:23.335339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9a9a-f9d9-41fe-872c-c4ef53311d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:23.365391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-f96e9a9a-f9d9-41fe-872c-c4ef53311d73 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:23.367326 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f96e9a9a-f9d9-41fe-872c-c4ef53311d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:23.368031 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179700fb-8f4e-4d82-842a-5d5b8c461a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:23.369344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179700fb-8f4e-4d82-842a-5d5b8c461a92 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:23.370051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179700fb-8f4e-4d82-842a-5d5b8c461a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:23.370847 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179700fb-8f4e-4d82-842a-5d5b8c461a92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:23.435834 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:23.472974 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179700fb-8f4e-4d82-842a-5d5b8c461a92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:23.474419 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179700fb-8f4e-4d82-842a-5d5b8c461a92 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:23.491732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 113/217] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:49:23.498818 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e9a9a-f9d9-41fe-872c-c4ef53311d73 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:23.545824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:23.611652 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 105/218] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:23.612978 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d30e8-031e-438f-8285-2a975780e195 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:23.613264 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d30e8-031e-438f-8285-2a975780e195 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:23.613540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d30e8-031e-438f-8285-2a975780e195 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:23.614835 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 106/219] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:23.615542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d30e8-031e-438f-8285-2a975780e195 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:23.655099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e9a9a-f9d9-41fe-872c-c4ef53311d73 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:23.704288 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:23.709657 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af1608-f418-4b52-a416-aecad733f931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:23.710403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af1608-f418-4b52-a416-aecad733f931 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:23.710714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af1608-f418-4b52-a416-aecad733f931 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:23.711166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af1608-f418-4b52-a416-aecad733f931 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:23.712850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af1608-f418-4b52-a416-aecad733f931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:23.714355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af1608-f418-4b52-a416-aecad733f931 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:23.716071 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 114/220] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:49:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:23.717294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a7f9-2ef2-4055-9ab0-35cc46aad473 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:23.717574 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a7f9-2ef2-4055-9ab0-35cc46aad473 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:23.717852 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a7f9-2ef2-4055-9ab0-35cc46aad473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:23.737242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-9d44a7f9-2ef2-4055-9ab0-35cc46aad473 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:23.738470 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9d44a7f9-2ef2-4055-9ab0-35cc46aad473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:23.750819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d30e8-031e-438f-8285-2a975780e195 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:23.803834 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3c0e7-a55f-4ac9-8903-8868de4b0ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:23.805441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3c0e7-a55f-4ac9-8903-8868de4b0ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:23.805903 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3c0e7-a55f-4ac9-8903-8868de4b0ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:23.806337 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3c0e7-a55f-4ac9-8903-8868de4b0ac4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:23.813239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 115/221] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:23.814189 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44a7f9-2ef2-4055-9ab0-35cc46aad473 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:23.823222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3c0e7-a55f-4ac9-8903-8868de4b0ac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-bae3c0e7-a55f-4ac9-8903-8868de4b0ac4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:23.828822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:23.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:23.833568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:23.833568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:23.833568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:23.833568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:23.833568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:23.833568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:23.833568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:23.833568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:23.833568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:23.833568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:23.833568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:23.833568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:23.833568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 107/222] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:49:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:23.838453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3c0e7-a55f-4ac9-8903-8868de4b0ac4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:23.847241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:23.956569 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44a7f9-2ef2-4055-9ab0-35cc46aad473 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:23.972214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3c0e7-a55f-4ac9-8903-8868de4b0ac4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:24.008529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ed076-0311-4f7d-b55e-5c9af3b39a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:24.009539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed076-0311-4f7d-b55e-5c9af3b39a9f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:24.010016 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed076-0311-4f7d-b55e-5c9af3b39a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:24.010381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ed076-0311-4f7d-b55e-5c9af3b39a9f None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:24.010581 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:24.012360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ed076-0311-4f7d-b55e-5c9af3b39a9f None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:24.014873 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ed076-0311-4f7d-b55e-5c9af3b39a9f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:24.017968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 116/223] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:23 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:24.018593 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485e827-179d-433e-96f8-9018625955f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:24.019187 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ed076-0311-4f7d-b55e-5c9af3b39a9f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:24.019560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485e827-179d-433e-96f8-9018625955f7 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:24.020055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485e827-179d-433e-96f8-9018625955f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:24.020521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485e827-179d-433e-96f8-9018625955f7 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:24.021621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485e827-179d-433e-96f8-9018625955f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:24.024506 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485e827-179d-433e-96f8-9018625955f7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:24.055015 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 108/224] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:49:23 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:49:24.056143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485e827-179d-433e-96f8-9018625955f7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:24.154149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:24.173497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ed076-0311-4f7d-b55e-5c9af3b39a9f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:24.218555 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca91e6-2d3f-46dd-b058-442e549b3c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:24.219452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca91e6-2d3f-46dd-b058-442e549b3c79 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:24.219848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca91e6-2d3f-46dd-b058-442e549b3c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:24.220228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca91e6-2d3f-46dd-b058-442e549b3c79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:24.223134 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485e827-179d-433e-96f8-9018625955f7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:24.234182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca91e6-2d3f-46dd-b058-442e549b3c79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-18ca91e6-2d3f-46dd-b058-442e549b3c79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:24.240355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:24.241484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:24.242398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:24.242398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:24.242398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:24.242398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:24.242398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:24.242398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:24.242398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:24.242398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:24.242398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:24.242398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:24.242398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:24.242398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:24.249031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 117/225] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:49:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:24.249988 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca91e6-2d3f-46dd-b058-442e549b3c79 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:24.277029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc6fc6-de78-429c-85cd-c9bce99addb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:24.278237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc6fc6-de78-429c-85cd-c9bce99addb4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:24.278678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc6fc6-de78-429c-85cd-c9bce99addb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:24.279108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc6fc6-de78-429c-85cd-c9bce99addb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:24.280010 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc6fc6-de78-429c-85cd-c9bce99addb4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:24.281046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc6fc6-de78-429c-85cd-c9bce99addb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:24.282991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc6fc6-de78-429c-85cd-c9bce99addb4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:24.302798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 109/226] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:49:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:24.302798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc6fc6-de78-429c-85cd-c9bce99addb4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:24.394838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:24.422731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca91e6-2d3f-46dd-b058-442e549b3c79 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:24.478220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea32e8-ffac-444b-8172-921dd27140ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:24.478785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea32e8-ffac-444b-8172-921dd27140ec None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:24.479066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea32e8-ffac-444b-8172-921dd27140ec None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:24.479338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea32e8-ffac-444b-8172-921dd27140ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:24.480151 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea32e8-ffac-444b-8172-921dd27140ec None admin] RBAC: Adding query filter params (role.id=93e4ae64906f4b0ea861a4ac4571f1d7, scope.project.id=59fff2f6945340d0895b4123f3f1cc4a, user.id=31ec65dc69ce4be49ac5ba552e874c26) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:24.480464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea32e8-ffac-444b-8172-921dd27140ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:24.482120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea32e8-ffac-444b-8172-921dd27140ec None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:24.489497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 118/227] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:24 2022] GET /identity/v3/role_assignments?user.id=31ec65dc69ce4be49ac5ba552e874c26&scope.project.id=59fff2f6945340d0895b4123f3f1cc4a&role.id=93e4ae64906f4b0ea861a4ac4571f1d7 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:24.490464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea32e8-ffac-444b-8172-921dd27140ec None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:24.510902 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:24.513660 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc6fc6-de78-429c-85cd-c9bce99addb4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:24.594902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55194e2d-8067-4724-8484-a523d5f13734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:24.596037 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55194e2d-8067-4724-8484-a523d5f13734 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:24.596339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55194e2d-8067-4724-8484-a523d5f13734 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:24.596622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55194e2d-8067-4724-8484-a523d5f13734 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:24.597714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55194e2d-8067-4724-8484-a523d5f13734 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:24.598033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55194e2d-8067-4724-8484-a523d5f13734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:24.599496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55194e2d-8067-4724-8484-a523d5f13734 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:24.612758 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 110/228] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:24.620291 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55194e2d-8067-4724-8484-a523d5f13734 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:24.651942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea32e8-ffac-444b-8172-921dd27140ec None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:24.749162 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22001cf0-cbf7-4ba4-8101-c391cb72ef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:24.749715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22001cf0-cbf7-4ba4-8101-c391cb72ef4b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:24.749994 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22001cf0-cbf7-4ba4-8101-c391cb72ef4b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:24.750268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22001cf0-cbf7-4ba4-8101-c391cb72ef4b None admin] PATH_INFO: `/v3/users/7630899e2fc54b939129d47ec76c1b03` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:24.753813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22001cf0-cbf7-4ba4-8101-c391cb72ef4b None admin] RBAC: Authorizing `identity:get_user(user_id=7630899e2fc54b939129d47ec76c1b03)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:24.753813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22001cf0-cbf7-4ba4-8101-c391cb72ef4b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:24.757629 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 119/229] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:24 2022] GET /identity/v3/users/7630899e2fc54b939129d47ec76c1b03 => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:24.767048 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22001cf0-cbf7-4ba4-8101-c391cb72ef4b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:24.875509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55194e2d-8067-4724-8484-a523d5f13734 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:24.890027 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22001cf0-cbf7-4ba4-8101-c391cb72ef4b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:24.904706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:24.925236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:24.940531 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f180965-cf99-484b-a5f0-ac8b33e4faef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:24.941198 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f180965-cf99-484b-a5f0-ac8b33e4faef None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:24.941470 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f180965-cf99-484b-a5f0-ac8b33e4faef None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:24.941753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f180965-cf99-484b-a5f0-ac8b33e4faef None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:24.944023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f180965-cf99-484b-a5f0-ac8b33e4faef None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:24.946210 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f180965-cf99-484b-a5f0-ac8b33e4faef None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:24.951627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 120/230] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:24 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:24.963019 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f180965-cf99-484b-a5f0-ac8b33e4faef None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:24.994920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5aeea-d537-49a5-8b4e-a972916d7738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:24.996491 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5aeea-d537-49a5-8b4e-a972916d7738 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:24.997234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5aeea-d537-49a5-8b4e-a972916d7738 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:24.997957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5aeea-d537-49a5-8b4e-a972916d7738 None admin] PATH_INFO: `/v3/users/7630899e2fc54b939129d47ec76c1b03` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:25.002806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5aeea-d537-49a5-8b4e-a972916d7738 None admin] RBAC: Authorizing `identity:get_user(user_id=7630899e2fc54b939129d47ec76c1b03)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:25.007972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5aeea-d537-49a5-8b4e-a972916d7738 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:25.014124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 111/231] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:24 2022] GET /identity/v3/users/7630899e2fc54b939129d47ec76c1b03 => generated 283 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:25.023026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5aeea-d537-49a5-8b4e-a972916d7738 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:25.129932 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f180965-cf99-484b-a5f0-ac8b33e4faef None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:25.174036 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea139619-3700-4b8b-9d5e-0a7b679d9446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:25.174975 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea139619-3700-4b8b-9d5e-0a7b679d9446 None admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:25.174975 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea139619-3700-4b8b-9d5e-0a7b679d9446 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:25.175448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea139619-3700-4b8b-9d5e-0a7b679d9446 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a/users/7630899e2fc54b939129d47ec76c1b03/roles/b94b02b271d44f1195f1093a6202a947` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:25.177875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea139619-3700-4b8b-9d5e-0a7b679d9446 None admin] RBAC: Authorizing `identity:create_grant(project_id=59fff2f6945340d0895b4123f3f1cc4a, user_id=7630899e2fc54b939129d47ec76c1b03, role_id=b94b02b271d44f1195f1093a6202a947)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:25.179459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea139619-3700-4b8b-9d5e-0a7b679d9446 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:25.197045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 121/232] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:49:24 2022] PUT /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a/users/7630899e2fc54b939129d47ec76c1b03/roles/b94b02b271d44f1195f1093a6202a947 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:49:25.293726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5aeea-d537-49a5-8b4e-a972916d7738 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:25.345000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56040d2a-29a1-448d-a810-d542b4385307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:25.345720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56040d2a-29a1-448d-a810-d542b4385307 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:25.346003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56040d2a-29a1-448d-a810-d542b4385307 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:25.346334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56040d2a-29a1-448d-a810-d542b4385307 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:25.347614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56040d2a-29a1-448d-a810-d542b4385307 None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:25.349213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56040d2a-29a1-448d-a810-d542b4385307 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:25.351331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 112/233] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:25 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:25.358288 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea139619-3700-4b8b-9d5e-0a7b679d9446 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:25.388475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:25.598670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea139619-3700-4b8b-9d5e-0a7b679d9446 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:25.665424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623ba7e-8f8e-416f-8c02-0db38c3270b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:25.666561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623ba7e-8f8e-416f-8c02-0db38c3270b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:25.667045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623ba7e-8f8e-416f-8c02-0db38c3270b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:25.667521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623ba7e-8f8e-416f-8c02-0db38c3270b6 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a/users/7630899e2fc54b939129d47ec76c1b03/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:25.677380 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623ba7e-8f8e-416f-8c02-0db38c3270b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=59fff2f6945340d0895b4123f3f1cc4a, user_id=7630899e2fc54b939129d47ec76c1b03, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:25.681284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623ba7e-8f8e-416f-8c02-0db38c3270b6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:25.708303 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 122/234] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:49:25 2022] PUT /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a/users/7630899e2fc54b939129d47ec76c1b03/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:49:27.373606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8ed1d-2e8e-4d1c-81ed-ff4af183dfd8 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:27.374133 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8ed1d-2e8e-4d1c-81ed-ff4af183dfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:27.374133 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8ed1d-2e8e-4d1c-81ed-ff4af183dfd8 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:27.375705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 113/235] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:27.386091 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4745f03-a668-4125-b450-cc7ae716c258 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:27.386091 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4745f03-a668-4125-b450-cc7ae716c258 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:27.386091 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4745f03-a668-4125-b450-cc7ae716c258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:27.404556 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-f4745f03-a668-4125-b450-cc7ae716c258 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:27.406153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f4745f03-a668-4125-b450-cc7ae716c258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:27.485680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:27.493134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 123/236] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:49:27.518159 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8ed1d-2e8e-4d1c-81ed-ff4af183dfd8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:27.654367 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:27.792418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8ed1d-2e8e-4d1c-81ed-ff4af183dfd8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:27.841690 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e732e83-8b53-46e8-908a-d0bf5c4d4802 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:27.842331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e732e83-8b53-46e8-908a-d0bf5c4d4802 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:27.842806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e732e83-8b53-46e8-908a-d0bf5c4d4802 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:27.844504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 124/237] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:49:27.850062 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abfd63-0567-41ae-8884-577bf7b230d2 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:27.851260 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abfd63-0567-41ae-8884-577bf7b230d2 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:27.851740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abfd63-0567-41ae-8884-577bf7b230d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:27.857654 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc616b67-fbc2-4b1b-9ac1-dcda11468bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:27.858732 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc616b67-fbc2-4b1b-9ac1-dcda11468bea None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:27.859220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc616b67-fbc2-4b1b-9ac1-dcda11468bea None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:27.859701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc616b67-fbc2-4b1b-9ac1-dcda11468bea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:27.873331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-f5abfd63-0567-41ae-8884-577bf7b230d2 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:27.874890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f5abfd63-0567-41ae-8884-577bf7b230d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:27.879300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc616b67-fbc2-4b1b-9ac1-dcda11468bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-fc616b67-fbc2-4b1b-9ac1-dcda11468bea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:27.889186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:27.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:27.891007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:27.891007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:27.891007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:27.891007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:27.891007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:27.891007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:27.891007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:27.891007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:27.891007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:27.891007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:27.891007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:27.891007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:27.894254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 114/238] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:49:27.905013 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc616b67-fbc2-4b1b-9ac1-dcda11468bea None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:28.023929 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 125/239] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:49:28.046833 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abfd63-0567-41ae-8884-577bf7b230d2 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:28.119955 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc616b67-fbc2-4b1b-9ac1-dcda11468bea None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:28.134330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:28.174705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0786e-54a3-42b6-95f0-b25642a6a545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:28.175363 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0786e-54a3-42b6-95f0-b25642a6a545 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:28.175647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0786e-54a3-42b6-95f0-b25642a6a545 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:28.175942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0786e-54a3-42b6-95f0-b25642a6a545 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:28.176635 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0786e-54a3-42b6-95f0-b25642a6a545 None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:28.176938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0786e-54a3-42b6-95f0-b25642a6a545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:28.180232 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0786e-54a3-42b6-95f0-b25642a6a545 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:28.200143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 115/240] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:28.202770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6aa42-c99b-4beb-8f38-9a0cf8f57017 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:28.203342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6aa42-c99b-4beb-8f38-9a0cf8f57017 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:28.204646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6aa42-c99b-4beb-8f38-9a0cf8f57017 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:28.206515 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 116/241] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:28.207620 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6aa42-c99b-4beb-8f38-9a0cf8f57017 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:28.214755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abfd63-0567-41ae-8884-577bf7b230d2 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:28.262283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:28.279071 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5253cc1-cb22-4166-9f11-426ba2bbe336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:28.280105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5253cc1-cb22-4166-9f11-426ba2bbe336 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:28.280543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5253cc1-cb22-4166-9f11-426ba2bbe336 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:28.280965 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5253cc1-cb22-4166-9f11-426ba2bbe336 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:28.300292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5253cc1-cb22-4166-9f11-426ba2bbe336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-e5253cc1-cb22-4166-9f11-426ba2bbe336 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:28.309186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:28.310190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:28.310987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:28.310987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:28.310987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:28.310987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:28.310987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:28.310987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:28.310987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:28.310987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:28.310987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:28.310987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:28.310987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:28.310987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:28.312208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 126/242] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:49:28.317639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5f55-f87f-41cc-9987-dc57730f46b8 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:28.317975 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5f55-f87f-41cc-9987-dc57730f46b8 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:28.318390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5f55-f87f-41cc-9987-dc57730f46b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:28.347475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-35bc5f55-f87f-41cc-9987-dc57730f46b8 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:28.348813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-35bc5f55-f87f-41cc-9987-dc57730f46b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:28.368229 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6aa42-c99b-4beb-8f38-9a0cf8f57017 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:28.423410 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58d7a1-ee08-455a-9a7c-2f3c0bf7d14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:28.425845 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58d7a1-ee08-455a-9a7c-2f3c0bf7d14e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:28.426353 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58d7a1-ee08-455a-9a7c-2f3c0bf7d14e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:28.427020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58d7a1-ee08-455a-9a7c-2f3c0bf7d14e None admin] PATH_INFO: `/v3/users/31ec65dc69ce4be49ac5ba552e874c26` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:28.430632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58d7a1-ee08-455a-9a7c-2f3c0bf7d14e None admin] RBAC: Authorizing `identity:get_user(user_id=31ec65dc69ce4be49ac5ba552e874c26)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:28.432244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58d7a1-ee08-455a-9a7c-2f3c0bf7d14e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:28.439965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 117/243] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:28 2022] GET /identity/v3/users/31ec65dc69ce4be49ac5ba552e874c26 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:28.439965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58d7a1-ee08-455a-9a7c-2f3c0bf7d14e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:28.441185 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 127/244] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:28.443721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5f55-f87f-41cc-9987-dc57730f46b8 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:28.495891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:28.590369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5f55-f87f-41cc-9987-dc57730f46b8 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:28.611653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:28.618681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58d7a1-ee08-455a-9a7c-2f3c0bf7d14e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:28.634691 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf650c-6088-4390-b7ee-601528fbc0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:28.635747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf650c-6088-4390-b7ee-601528fbc0bf None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:28.636255 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf650c-6088-4390-b7ee-601528fbc0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:28.636727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf650c-6088-4390-b7ee-601528fbc0bf None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:28.638266 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf650c-6088-4390-b7ee-601528fbc0bf None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:28.640034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf650c-6088-4390-b7ee-601528fbc0bf None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:28.647545 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 128/245] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:28 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:28.649779 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf650c-6088-4390-b7ee-601528fbc0bf None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:28.685715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc26d7-2700-4977-a3df-2367af5de0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:28.686859 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc26d7-2700-4977-a3df-2367af5de0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:28.688028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc26d7-2700-4977-a3df-2367af5de0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:28.688524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc26d7-2700-4977-a3df-2367af5de0a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:28.689846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc26d7-2700-4977-a3df-2367af5de0a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:28.690243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc26d7-2700-4977-a3df-2367af5de0a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:28.697112 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc26d7-2700-4977-a3df-2367af5de0a1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:28.713672 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 118/246] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:28.715401 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc26d7-2700-4977-a3df-2367af5de0a1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:28.772972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf650c-6088-4390-b7ee-601528fbc0bf None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:28.813589 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1e078-57fe-4256-9a25-9a89097955d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:28.814494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1e078-57fe-4256-9a25-9a89097955d5 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:28.814945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1e078-57fe-4256-9a25-9a89097955d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:28.815416 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1e078-57fe-4256-9a25-9a89097955d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:28.816953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1e078-57fe-4256-9a25-9a89097955d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:28.818642 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1e078-57fe-4256-9a25-9a89097955d5 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:28.821582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 129/247] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:49:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:28.822728 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1e078-57fe-4256-9a25-9a89097955d5 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:28.888339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:28.915946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:28.921743 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc26d7-2700-4977-a3df-2367af5de0a1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:28.946660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1e078-57fe-4256-9a25-9a89097955d5 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:28.988594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f5e4d-ef51-4280-811a-ebdc3a814b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:28.990191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f5e4d-ef51-4280-811a-ebdc3a814b0f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:28.990452 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61833f83-42bb-494d-9d47-4e74b148b785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:28.991100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f5e4d-ef51-4280-811a-ebdc3a814b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:28.991806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f5e4d-ef51-4280-811a-ebdc3a814b0f None admin] PATH_INFO: `/v3/users/0ba565893b024f0db9ae230d3bea0f7d` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:28.992952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833f83-42bb-494d-9d47-4e74b148b785 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:28.993559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833f83-42bb-494d-9d47-4e74b148b785 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:28.994075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833f83-42bb-494d-9d47-4e74b148b785 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a/users/31ec65dc69ce4be49ac5ba552e874c26/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:28.999045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61833f83-42bb-494d-9d47-4e74b148b785 None admin] RBAC: Authorizing `identity:create_grant(project_id=59fff2f6945340d0895b4123f3f1cc4a, user_id=31ec65dc69ce4be49ac5ba552e874c26, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:29.000839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61833f83-42bb-494d-9d47-4e74b148b785 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:29.020065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f5e4d-ef51-4280-811a-ebdc3a814b0f None admin] RBAC: Authorizing `identity:get_user(user_id=0ba565893b024f0db9ae230d3bea0f7d)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:29.024132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f5e4d-ef51-4280-811a-ebdc3a814b0f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:29.032543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 130/248] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:28 2022] GET /identity/v3/users/0ba565893b024f0db9ae230d3bea0f7d => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:29.032779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 119/249] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:49:28 2022] PUT /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a/users/31ec65dc69ce4be49ac5ba552e874c26/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:49:29.032939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f5e4d-ef51-4280-811a-ebdc3a814b0f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:29.033069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a4567-400b-4c42-9321-2df31e616a09 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:29.033069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a4567-400b-4c42-9321-2df31e616a09 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:29.033069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a4567-400b-4c42-9321-2df31e616a09 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:29.033426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 120/250] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:29.035696 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eb27f-c76d-4962-9ca6-8bbdd4aec36c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:29.036019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eb27f-c76d-4962-9ca6-8bbdd4aec36c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:29.036297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eb27f-c76d-4962-9ca6-8bbdd4aec36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:29.057745 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5b0eb27f-c76d-4962-9ca6-8bbdd4aec36c None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:29.058995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5b0eb27f-c76d-4962-9ca6-8bbdd4aec36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:29.160100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 121/251] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:29.161146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0eb27f-c76d-4962-9ca6-8bbdd4aec36c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:29.228849 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f5e4d-ef51-4280-811a-ebdc3a814b0f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:29.247683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:29.275494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c366862-e135-4975-b2fb-3ac2c6ba2176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:29.276142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c366862-e135-4975-b2fb-3ac2c6ba2176 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:29.276421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c366862-e135-4975-b2fb-3ac2c6ba2176 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:29.276691 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c366862-e135-4975-b2fb-3ac2c6ba2176 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:29.277372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c366862-e135-4975-b2fb-3ac2c6ba2176 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:29.278859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c366862-e135-4975-b2fb-3ac2c6ba2176 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:29.311281 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:29.315007 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 131/252] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:49:29 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:49:29.318392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45feb6a-dad3-4aa7-bd37-531787c22190 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:29.318929 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45feb6a-dad3-4aa7-bd37-531787c22190 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:29.319977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45feb6a-dad3-4aa7-bd37-531787c22190 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:29.322880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 132/253] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:29.327487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0eb27f-c76d-4962-9ca6-8bbdd4aec36c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:29.329672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45feb6a-dad3-4aa7-bd37-531787c22190 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:29.379890 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd317707-16b7-4be7-906d-446887bc1b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:29.381461 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd317707-16b7-4be7-906d-446887bc1b32 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:29.382898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd317707-16b7-4be7-906d-446887bc1b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:29.383402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd317707-16b7-4be7-906d-446887bc1b32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:29.491360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd317707-16b7-4be7-906d-446887bc1b32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:29.494135 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd317707-16b7-4be7-906d-446887bc1b32 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:29.548725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45feb6a-dad3-4aa7-bd37-531787c22190 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:29.606302 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655cf0c-5e86-4a15-8c69-8badf4ed2371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:29.607343 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655cf0c-5e86-4a15-8c69-8badf4ed2371 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:29.607624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655cf0c-5e86-4a15-8c69-8badf4ed2371 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:29.607885 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655cf0c-5e86-4a15-8c69-8badf4ed2371 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:29.623806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655cf0c-5e86-4a15-8c69-8badf4ed2371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-8655cf0c-5e86-4a15-8c69-8badf4ed2371 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:29.629182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:29.630799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:29.632713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:29.632713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:29.632713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:29.632713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:29.632713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:29.632713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:29.632713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:29.632713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:29.632713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:29.632713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:29.632713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:29.632713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:29.635680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 133/254] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:49:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:29.641473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251af2fd-419f-4d60-b2ee-8bae97d0fe7d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:29.641761 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251af2fd-419f-4d60-b2ee-8bae97d0fe7d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:29.643969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251af2fd-419f-4d60-b2ee-8bae97d0fe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:29.664437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:29.671658 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-251af2fd-419f-4d60-b2ee-8bae97d0fe7d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:29.674261 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-251af2fd-419f-4d60-b2ee-8bae97d0fe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:29.688000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 122/255] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:29.693001 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd317707-16b7-4be7-906d-446887bc1b32 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:29.713907 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:29.799058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 134/256] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:29.801507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251af2fd-419f-4d60-b2ee-8bae97d0fe7d None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:29.872068 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd317707-16b7-4be7-906d-446887bc1b32 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:29.954884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35a8f8-c8d0-4112-8b9e-0846717bdb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:29.955587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35a8f8-c8d0-4112-8b9e-0846717bdb41 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:29.955869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35a8f8-c8d0-4112-8b9e-0846717bdb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:29.956191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35a8f8-c8d0-4112-8b9e-0846717bdb41 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:29.956848 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35a8f8-c8d0-4112-8b9e-0846717bdb41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:29.957150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35a8f8-c8d0-4112-8b9e-0846717bdb41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:29.958546 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35a8f8-c8d0-4112-8b9e-0846717bdb41 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:29.969503 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251af2fd-419f-4d60-b2ee-8bae97d0fe7d None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:29.979258 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 123/257] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:49:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:29.980256 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35a8f8-c8d0-4112-8b9e-0846717bdb41 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:30.066404 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb3349-41c0-4df6-8562-e70b1381e4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:30.068699 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb3349-41c0-4df6-8562-e70b1381e4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:30.070026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb3349-41c0-4df6-8562-e70b1381e4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:30.070809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb3349-41c0-4df6-8562-e70b1381e4a6 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:30.073503 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb3349-41c0-4df6-8562-e70b1381e4a6 None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:30.076973 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb3349-41c0-4df6-8562-e70b1381e4a6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:30.081877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 135/258] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:29 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:30.083772 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb3349-41c0-4df6-8562-e70b1381e4a6 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:30.132632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:30.181132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:30.295293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35a8f8-c8d0-4112-8b9e-0846717bdb41 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:30.296692 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb3349-41c0-4df6-8562-e70b1381e4a6 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:30.338210 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101a483-76f6-41b2-af7e-3b4dac58b967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:30.339196 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101a483-76f6-41b2-af7e-3b4dac58b967 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:30.339984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101a483-76f6-41b2-af7e-3b4dac58b967 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:30.340476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101a483-76f6-41b2-af7e-3b4dac58b967 None admin] PATH_INFO: `/v3/users/7630899e2fc54b939129d47ec76c1b03` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:30.341929 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101a483-76f6-41b2-af7e-3b4dac58b967 None admin] RBAC: Authorizing `identity:get_user(user_id=7630899e2fc54b939129d47ec76c1b03)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:30.344240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101a483-76f6-41b2-af7e-3b4dac58b967 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:30.346142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 136/259] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:30 2022] GET /identity/v3/users/7630899e2fc54b939129d47ec76c1b03 => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:30.347153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101a483-76f6-41b2-af7e-3b4dac58b967 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:30.401015 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74567a72-bb08-431f-8256-14f231b337ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:30.401732 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74567a72-bb08-431f-8256-14f231b337ea None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:30.402081 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74567a72-bb08-431f-8256-14f231b337ea None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:30.402353 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74567a72-bb08-431f-8256-14f231b337ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:30.436581 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74567a72-bb08-431f-8256-14f231b337ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-74567a72-bb08-431f-8256-14f231b337ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:30.441961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:30.442913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:30.448418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:30.448418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:30.448418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:30.448418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:30.448418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:30.448418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:30.448418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:30.448418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:30.448418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:30.448418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:30.448418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:30.448418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:30.448418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 124/260] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:49:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 464 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:30.448418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74567a72-bb08-431f-8256-14f231b337ea None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:30.476275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:30.486355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101a483-76f6-41b2-af7e-3b4dac58b967 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:30.530357 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4ca81-659e-4ee8-b872-25d1380e347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:30.531385 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4ca81-659e-4ee8-b872-25d1380e347f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:30.531869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4ca81-659e-4ee8-b872-25d1380e347f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:30.532376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4ca81-659e-4ee8-b872-25d1380e347f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:30.533310 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4ca81-659e-4ee8-b872-25d1380e347f None admin] RBAC: Adding query filter params (role.id=347f011f3e624778b2823ef73698f6ad, scope.project.id=59fff2f6945340d0895b4123f3f1cc4a, user.id=0ba565893b024f0db9ae230d3bea0f7d) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:30.533811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4ca81-659e-4ee8-b872-25d1380e347f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:30.535521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4ca81-659e-4ee8-b872-25d1380e347f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:30.543839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 137/261] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:30 2022] GET /identity/v3/role_assignments?user.id=0ba565893b024f0db9ae230d3bea0f7d&scope.project.id=59fff2f6945340d0895b4123f3f1cc4a&role.id=347f011f3e624778b2823ef73698f6ad => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:30.545087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4ca81-659e-4ee8-b872-25d1380e347f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:30.672449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4ca81-659e-4ee8-b872-25d1380e347f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:30.728909 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c928bd4-f1a1-46e1-8ea6-fce5ceac0698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:30.729992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c928bd4-f1a1-46e1-8ea6-fce5ceac0698 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:30.730504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c928bd4-f1a1-46e1-8ea6-fce5ceac0698 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:30.730978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c928bd4-f1a1-46e1-8ea6-fce5ceac0698 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:30.731892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c928bd4-f1a1-46e1-8ea6-fce5ceac0698 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:30.732434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c928bd4-f1a1-46e1-8ea6-fce5ceac0698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:30.734085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c928bd4-f1a1-46e1-8ea6-fce5ceac0698 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:30.755453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 138/262] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:30.765431 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c928bd4-f1a1-46e1-8ea6-fce5ceac0698 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:30.823225 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74567a72-bb08-431f-8256-14f231b337ea None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:30.824840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:30.846930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:30.905446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195b129-c231-4f06-8caa-bf20c082c3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:30.906008 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195b129-c231-4f06-8caa-bf20c082c3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:30.906293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195b129-c231-4f06-8caa-bf20c082c3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:30.906570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195b129-c231-4f06-8caa-bf20c082c3f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:31.043595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195b129-c231-4f06-8caa-bf20c082c3f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:31.045491 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195b129-c231-4f06-8caa-bf20c082c3f1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:31.046859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c928bd4-f1a1-46e1-8ea6-fce5ceac0698 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:31.135315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff0273-c731-4e0c-bd34-42c31ec597de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:31.136419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff0273-c731-4e0c-bd34-42c31ec597de None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:31.136908 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff0273-c731-4e0c-bd34-42c31ec597de None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:31.137636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff0273-c731-4e0c-bd34-42c31ec597de None admin] PATH_INFO: `/v3/users/7630899e2fc54b939129d47ec76c1b03` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:31.145232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff0273-c731-4e0c-bd34-42c31ec597de None admin] RBAC: Authorizing `identity:get_user(user_id=7630899e2fc54b939129d47ec76c1b03)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:31.148806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff0273-c731-4e0c-bd34-42c31ec597de None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:31.151892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 139/263] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:30 2022] GET /identity/v3/users/7630899e2fc54b939129d47ec76c1b03 => generated 283 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:31.160635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff0273-c731-4e0c-bd34-42c31ec597de None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:31.238838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 125/264] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:31.245353 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195b129-c231-4f06-8caa-bf20c082c3f1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:31.273665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:31.423478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:31.448185 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff0273-c731-4e0c-bd34-42c31ec597de None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:31.464304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195b129-c231-4f06-8caa-bf20c082c3f1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:31.521437 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd5ff0-626f-4734-9ff6-e7280593861f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:31.523269 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd5ff0-626f-4734-9ff6-e7280593861f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:31.523773 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd5ff0-626f-4734-9ff6-e7280593861f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:31.524791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd5ff0-626f-4734-9ff6-e7280593861f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:31.567070 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce03e4-8434-4fcd-957b-35565019c851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:31.568241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce03e4-8434-4fcd-957b-35565019c851 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:31.569306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce03e4-8434-4fcd-957b-35565019c851 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:31.569869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce03e4-8434-4fcd-957b-35565019c851 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:31.575224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce03e4-8434-4fcd-957b-35565019c851 None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:31.578585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce03e4-8434-4fcd-957b-35565019c851 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:31.582303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 126/265] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:31 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:31.591570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce03e4-8434-4fcd-957b-35565019c851 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:31.771348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd5ff0-626f-4734-9ff6-e7280593861f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:31.774424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd5ff0-626f-4734-9ff6-e7280593861f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:31.830946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:31.867893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce03e4-8434-4fcd-957b-35565019c851 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:31.937772 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8f463-e7c4-4ecf-b760-45ebb7d1e062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:31.938416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8f463-e7c4-4ecf-b760-45ebb7d1e062 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:31.938701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8f463-e7c4-4ecf-b760-45ebb7d1e062 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:31.938980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8f463-e7c4-4ecf-b760-45ebb7d1e062 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:31.939732 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8f463-e7c4-4ecf-b760-45ebb7d1e062 None admin] RBAC: Adding query filter params (role.id=b94b02b271d44f1195f1093a6202a947, scope.project.id=59fff2f6945340d0895b4123f3f1cc4a, user.id=7630899e2fc54b939129d47ec76c1b03) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:31.940076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8f463-e7c4-4ecf-b760-45ebb7d1e062 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:31.941572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8f463-e7c4-4ecf-b760-45ebb7d1e062 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:31.955812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 127/266] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:31 2022] GET /identity/v3/role_assignments?user.id=7630899e2fc54b939129d47ec76c1b03&scope.project.id=59fff2f6945340d0895b4123f3f1cc4a&role.id=b94b02b271d44f1195f1093a6202a947 => generated 608 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:32.029248 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:32.073925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 140/267] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 914 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:49:32.082327 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8f463-e7c4-4ecf-b760-45ebb7d1e062 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:32.134678 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691de05-19cd-4827-b171-e969ae3f2c8f None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:32.137202 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691de05-19cd-4827-b171-e969ae3f2c8f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:32.137202 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691de05-19cd-4827-b171-e969ae3f2c8f None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:32.138298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 141/268] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:32.159725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f0d9a-5fe2-4df0-ad5f-b1952bba6527 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:32.160232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f0d9a-5fe2-4df0-ad5f-b1952bba6527 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:32.160652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f0d9a-5fe2-4df0-ad5f-b1952bba6527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:32.208667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-2a3f0d9a-5fe2-4df0-ad5f-b1952bba6527 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:32.211308 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2a3f0d9a-5fe2-4df0-ad5f-b1952bba6527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:32.351984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 142/269] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:32.368389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8f463-e7c4-4ecf-b760-45ebb7d1e062 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:32.427058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f0d9a-5fe2-4df0-ad5f-b1952bba6527 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:32.464422 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d17ff6-b198-4cc9-aec6-c809f8c24a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:32.465984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d17ff6-b198-4cc9-aec6-c809f8c24a60 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:32.466808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d17ff6-b198-4cc9-aec6-c809f8c24a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:32.467747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d17ff6-b198-4cc9-aec6-c809f8c24a60 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:32.471938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d17ff6-b198-4cc9-aec6-c809f8c24a60 None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:32.471938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d17ff6-b198-4cc9-aec6-c809f8c24a60 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:32.473384 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 128/270] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:32 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:32.487542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d17ff6-b198-4cc9-aec6-c809f8c24a60 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:32.511775 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:32.620811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f0d9a-5fe2-4df0-ad5f-b1952bba6527 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:32.677222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:32.687535 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d17ff6-b198-4cc9-aec6-c809f8c24a60 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:32.728205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7474d15-e37f-4f96-a1b7-e4cedca8f855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:32.728837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7474d15-e37f-4f96-a1b7-e4cedca8f855 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:32.729120 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7474d15-e37f-4f96-a1b7-e4cedca8f855 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:32.729398 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7474d15-e37f-4f96-a1b7-e4cedca8f855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:32.730161 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7474d15-e37f-4f96-a1b7-e4cedca8f855 None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=59fff2f6945340d0895b4123f3f1cc4a, user.id=7630899e2fc54b939129d47ec76c1b03) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:32.730475 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7474d15-e37f-4f96-a1b7-e4cedca8f855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:32.732098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7474d15-e37f-4f96-a1b7-e4cedca8f855 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:32.738876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 129/271] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:32 2022] GET /identity/v3/role_assignments?user.id=7630899e2fc54b939129d47ec76c1b03&scope.project.id=59fff2f6945340d0895b4123f3f1cc4a&role.id=638e1fc82db44124ae615c46408110a7 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:32.769509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaad80-7900-4336-92b6-f20a48c80699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:32.770183 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaad80-7900-4336-92b6-f20a48c80699 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:32.770465 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaad80-7900-4336-92b6-f20a48c80699 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:32.770741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaad80-7900-4336-92b6-f20a48c80699 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:32.787095 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccaad80-7900-4336-92b6-f20a48c80699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-3ccaad80-7900-4336-92b6-f20a48c80699 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:32.793616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:32.795372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:32.796995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:32.796995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:32.796995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:32.796995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:32.796995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:32.796995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:32.796995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:32.796995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:32.796995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:32.796995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:32.796995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:32.796995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:32.796995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 143/272] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:49:32.801655 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7474d15-e37f-4f96-a1b7-e4cedca8f855 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:32.898447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:32.928661 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7474d15-e37f-4f96-a1b7-e4cedca8f855 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:32.970047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4aacb-d430-450f-8982-acc6e6f4fb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:32.970691 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4aacb-d430-450f-8982-acc6e6f4fb7b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:32.970975 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4aacb-d430-450f-8982-acc6e6f4fb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:32.971253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4aacb-d430-450f-8982-acc6e6f4fb7b None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:32.971973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4aacb-d430-450f-8982-acc6e6f4fb7b None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:32.972284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4aacb-d430-450f-8982-acc6e6f4fb7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:32.973719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4aacb-d430-450f-8982-acc6e6f4fb7b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:32.984681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 130/273] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:32.990573 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaad80-7900-4336-92b6-f20a48c80699 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:33.025025 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ca9b6-5f5d-4605-873a-6a2b3078e0eb None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:33.025435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ca9b6-5f5d-4605-873a-6a2b3078e0eb None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:33.025588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ca9b6-5f5d-4605-873a-6a2b3078e0eb None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:33.027020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 131/274] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:49:33.032992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fb81d-3530-4b90-8d23-69b2e431082c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:33.033347 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fb81d-3530-4b90-8d23-69b2e431082c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:33.033549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fb81d-3530-4b90-8d23-69b2e431082c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:33.053958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-613fb81d-3530-4b90-8d23-69b2e431082c None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:33.055253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-613fb81d-3530-4b90-8d23-69b2e431082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:33.149318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 132/275] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:49:33.186533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fb81d-3530-4b90-8d23-69b2e431082c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:33.192396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaad80-7900-4336-92b6-f20a48c80699 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:33.268034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b1893-4882-4a66-bddb-a7ccf1829e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:33.270508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b1893-4882-4a66-bddb-a7ccf1829e08 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:33.271317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b1893-4882-4a66-bddb-a7ccf1829e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:33.272966 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b1893-4882-4a66-bddb-a7ccf1829e08 None admin] PATH_INFO: `/v3/users/31ec65dc69ce4be49ac5ba552e874c26` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:33.275726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b1893-4882-4a66-bddb-a7ccf1829e08 None admin] RBAC: Authorizing `identity:get_user(user_id=31ec65dc69ce4be49ac5ba552e874c26)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:33.279418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b1893-4882-4a66-bddb-a7ccf1829e08 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:33.283155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 144/276] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:32 2022] GET /identity/v3/users/31ec65dc69ce4be49ac5ba552e874c26 => generated 297 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:33.290872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b1893-4882-4a66-bddb-a7ccf1829e08 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:33.337041 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:33.398972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:33.429760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fb81d-3530-4b90-8d23-69b2e431082c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:33.492438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa219a-7733-4deb-a028-fa0de54bf8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:33.493242 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa219a-7733-4deb-a028-fa0de54bf8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:33.493613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa219a-7733-4deb-a028-fa0de54bf8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:33.494028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa219a-7733-4deb-a028-fa0de54bf8d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:33.496598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b1893-4882-4a66-bddb-a7ccf1829e08 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:33.513135 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa219a-7733-4deb-a028-fa0de54bf8d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-6dfa219a-7733-4deb-a028-fa0de54bf8d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:33.522585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:33.524446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:33.526059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:33.526059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:33.526059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:33.526059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:33.526059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:33.526059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:33.526059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:33.526059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:33.526059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:33.526059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:33.526059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:33.526059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:33.526059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 133/277] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:49:33.527356 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb68b5-9df1-4048-a7f4-8bbd3d13c3a8 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:33.527491 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb68b5-9df1-4048-a7f4-8bbd3d13c3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:33.528527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb68b5-9df1-4048-a7f4-8bbd3d13c3a8 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:33.532354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 134/278] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:33.534775 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb68b5-9df1-4048-a7f4-8bbd3d13c3a8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:33.561586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61887dcd-06ea-42a8-b2af-1860fe51770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:33.562968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61887dcd-06ea-42a8-b2af-1860fe51770b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:33.562968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61887dcd-06ea-42a8-b2af-1860fe51770b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:33.563349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61887dcd-06ea-42a8-b2af-1860fe51770b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:33.664611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61887dcd-06ea-42a8-b2af-1860fe51770b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:33.666748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61887dcd-06ea-42a8-b2af-1860fe51770b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:33.726043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb68b5-9df1-4048-a7f4-8bbd3d13c3a8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:33.750391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:33.781643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:33.795654 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db071b-92b8-4749-b668-f3c7ef28869f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:33.796660 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db071b-92b8-4749-b668-f3c7ef28869f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:33.797327 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db071b-92b8-4749-b668-f3c7ef28869f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:33.797734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db071b-92b8-4749-b668-f3c7ef28869f None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:33.798860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db071b-92b8-4749-b668-f3c7ef28869f None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:33.799486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db071b-92b8-4749-b668-f3c7ef28869f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:33.802222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db071b-92b8-4749-b668-f3c7ef28869f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:33.824465 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 135/279] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:33.824465 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605223d7-bfc4-41e3-af2a-dcf57e7958dc None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:33.824465 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605223d7-bfc4-41e3-af2a-dcf57e7958dc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:33.824465 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605223d7-bfc4-41e3-af2a-dcf57e7958dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:33.848173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-605223d7-bfc4-41e3-af2a-dcf57e7958dc None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:33.849986 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-605223d7-bfc4-41e3-af2a-dcf57e7958dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:33.864729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 145/280] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:33.868661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61887dcd-06ea-42a8-b2af-1860fe51770b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:33.967569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 136/281] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:33.969191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605223d7-bfc4-41e3-af2a-dcf57e7958dc None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:34.048024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61887dcd-06ea-42a8-b2af-1860fe51770b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:34.097742 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621c50e-2071-48a0-b026-fbe20e2d9c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:34.098565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621c50e-2071-48a0-b026-fbe20e2d9c16 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:34.098964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621c50e-2071-48a0-b026-fbe20e2d9c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:34.099316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621c50e-2071-48a0-b026-fbe20e2d9c16 None admin] PATH_INFO: `/v3/users/5edc2caaab474e538bf130ccd31f1704` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:34.111866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605223d7-bfc4-41e3-af2a-dcf57e7958dc None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:34.118110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621c50e-2071-48a0-b026-fbe20e2d9c16 None admin] RBAC: Authorizing `identity:get_user(user_id=5edc2caaab474e538bf130ccd31f1704)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:34.119684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621c50e-2071-48a0-b026-fbe20e2d9c16 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:34.121971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 146/282] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:33 2022] GET /identity/v3/users/5edc2caaab474e538bf130ccd31f1704 => generated 293 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:34.122674 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621c50e-2071-48a0-b026-fbe20e2d9c16 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:34.128298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:34.147284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:34.173369 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453ebd7-4076-4ed9-a46a-1a1c76520eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:34.174478 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ebd7-4076-4ed9-a46a-1a1c76520eec None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:34.174975 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ebd7-4076-4ed9-a46a-1a1c76520eec None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:34.175464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453ebd7-4076-4ed9-a46a-1a1c76520eec None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:34.177553 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453ebd7-4076-4ed9-a46a-1a1c76520eec None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:34.181161 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453ebd7-4076-4ed9-a46a-1a1c76520eec None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:34.184581 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 137/283] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:33 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:34.186758 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c7096-3f76-4c0e-8ebb-60498bbe8fb5 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:34.187259 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c7096-3f76-4c0e-8ebb-60498bbe8fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:34.187747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c7096-3f76-4c0e-8ebb-60498bbe8fb5 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:34.190349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 138/284] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:34.191735 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c7096-3f76-4c0e-8ebb-60498bbe8fb5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:34.246161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621c50e-2071-48a0-b026-fbe20e2d9c16 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:34.294863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf73a6c-ada7-427f-985f-63f58ab4700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:34.295498 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf73a6c-ada7-427f-985f-63f58ab4700e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:34.295773 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf73a6c-ada7-427f-985f-63f58ab4700e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:34.296106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf73a6c-ada7-427f-985f-63f58ab4700e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:34.297280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf73a6c-ada7-427f-985f-63f58ab4700e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:34.298915 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf73a6c-ada7-427f-985f-63f58ab4700e None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:34.301735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 147/285] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:49:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:34.301735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf73a6c-ada7-427f-985f-63f58ab4700e None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:34.331969 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c7096-3f76-4c0e-8ebb-60498bbe8fb5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:34.373050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88c55e-8aa0-4099-85f8-f6676f16169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:34.373673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88c55e-8aa0-4099-85f8-f6676f16169f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:34.373954 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88c55e-8aa0-4099-85f8-f6676f16169f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:34.374226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88c55e-8aa0-4099-85f8-f6676f16169f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:34.374964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88c55e-8aa0-4099-85f8-f6676f16169f None admin] RBAC: Adding query filter params (role.id=93e4ae64906f4b0ea861a4ac4571f1d7, user.id=5edc2caaab474e538bf130ccd31f1704, scope.system=all) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:34.375272 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88c55e-8aa0-4099-85f8-f6676f16169f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:34.376744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88c55e-8aa0-4099-85f8-f6676f16169f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:34.382761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 139/286] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Aug 7 00:49:34 2022] GET /identity/v3/role_assignments?user.id=5edc2caaab474e538bf130ccd31f1704&scope.system=all&role.id=93e4ae64906f4b0ea861a4ac4571f1d7 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:34.384037 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae209e-4d91-418c-a849-0d327d17e1e7 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:34.384393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae209e-4d91-418c-a849-0d327d17e1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:34.384574 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae209e-4d91-418c-a849-0d327d17e1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:34.405291 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-8dae209e-4d91-418c-a849-0d327d17e1e7 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:34.406564 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8dae209e-4d91-418c-a849-0d327d17e1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:34.423132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:34.468729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf73a6c-ada7-427f-985f-63f58ab4700e None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:34.472504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:34.503350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 140/287] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:34.504663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae209e-4d91-418c-a849-0d327d17e1e7 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:34.528376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d758bf-6153-418e-9359-0be39ff6ab55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:34.529349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d758bf-6153-418e-9359-0be39ff6ab55 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:34.529801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d758bf-6153-418e-9359-0be39ff6ab55 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:34.530376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d758bf-6153-418e-9359-0be39ff6ab55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:34.531298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d758bf-6153-418e-9359-0be39ff6ab55 None admin] RBAC: Adding query filter params (role.id=93e4ae64906f4b0ea861a4ac4571f1d7, scope.project.id=59fff2f6945340d0895b4123f3f1cc4a, user.id=31ec65dc69ce4be49ac5ba552e874c26) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:34.531804 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d758bf-6153-418e-9359-0be39ff6ab55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:34.534632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d758bf-6153-418e-9359-0be39ff6ab55 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:34.545512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 148/288] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:34 2022] GET /identity/v3/role_assignments?user.id=31ec65dc69ce4be49ac5ba552e874c26&scope.project.id=59fff2f6945340d0895b4123f3f1cc4a&role.id=93e4ae64906f4b0ea861a4ac4571f1d7 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:34.552268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d758bf-6153-418e-9359-0be39ff6ab55 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:34.702830 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d758bf-6153-418e-9359-0be39ff6ab55 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:34.712939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae209e-4d91-418c-a849-0d327d17e1e7 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:34.749559 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebdd98-75d9-4d27-a591-bc4ce9e02975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:34.750479 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebdd98-75d9-4d27-a591-bc4ce9e02975 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:34.750933 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebdd98-75d9-4d27-a591-bc4ce9e02975 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:34.751369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebdd98-75d9-4d27-a591-bc4ce9e02975 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:34.755170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:34.767441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebdd98-75d9-4d27-a591-bc4ce9e02975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-4cebdd98-75d9-4d27-a591-bc4ce9e02975 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:34.774810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:34.775982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:34.776945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:34.776945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:34.776945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:34.776945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:34.776945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:34.776945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:34.776945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:34.776945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:34.776945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:34.776945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:34.776945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:34.776945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:34.779188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 149/289] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:34.784748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d1b40-1007-46ba-b189-b898d9ff50eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:34.785595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d1b40-1007-46ba-b189-b898d9ff50eb None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:34.786025 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d1b40-1007-46ba-b189-b898d9ff50eb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:34.786425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d1b40-1007-46ba-b189-b898d9ff50eb None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:34.787942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d1b40-1007-46ba-b189-b898d9ff50eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:34.789530 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebdd98-75d9-4d27-a591-bc4ce9e02975 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:34.792084 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d1b40-1007-46ba-b189-b898d9ff50eb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:34.830166 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 141/290] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:49:34 2022] POST /identity/v3/users => generated 293 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:49:35.013511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebdd98-75d9-4d27-a591-bc4ce9e02975 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:35.061793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112d603-e096-42e0-8e99-58726d18982f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:35.062432 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112d603-e096-42e0-8e99-58726d18982f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:35.062712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112d603-e096-42e0-8e99-58726d18982f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:35.062986 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112d603-e096-42e0-8e99-58726d18982f None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:35.063700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112d603-e096-42e0-8e99-58726d18982f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:35.064070 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112d603-e096-42e0-8e99-58726d18982f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:35.065501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112d603-e096-42e0-8e99-58726d18982f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:35.076786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 150/291] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:35.082741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d1b40-1007-46ba-b189-b898d9ff50eb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:35.132311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:35.222950 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d1b40-1007-46ba-b189-b898d9ff50eb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:35.275680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164642d9-45b5-4783-996e-9005c5931a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:35.276856 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164642d9-45b5-4783-996e-9005c5931a94 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:35.277352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164642d9-45b5-4783-996e-9005c5931a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:35.277804 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164642d9-45b5-4783-996e-9005c5931a94 None admin] PATH_INFO: `/v3/users/0ba565893b024f0db9ae230d3bea0f7d` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:35.279946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164642d9-45b5-4783-996e-9005c5931a94 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba565893b024f0db9ae230d3bea0f7d)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:35.282623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164642d9-45b5-4783-996e-9005c5931a94 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:35.285529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 142/292] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:35 2022] GET /identity/v3/users/0ba565893b024f0db9ae230d3bea0f7d => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:35.294549 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112d603-e096-42e0-8e99-58726d18982f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:35.416112 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:35.499798 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112d603-e096-42e0-8e99-58726d18982f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:35.567776 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e69e1b-52bb-4067-9afe-af60d03e7561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:35.569074 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e69e1b-52bb-4067-9afe-af60d03e7561 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:35.569753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e69e1b-52bb-4067-9afe-af60d03e7561 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:35.570231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e69e1b-52bb-4067-9afe-af60d03e7561 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:35.572344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e69e1b-52bb-4067-9afe-af60d03e7561 None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:35.575096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e69e1b-52bb-4067-9afe-af60d03e7561 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:35.578626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 151/293] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:35 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:35.588694 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164642d9-45b5-4783-996e-9005c5931a94 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:35.791422 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164642d9-45b5-4783-996e-9005c5931a94 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:35.804744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:35.861391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bf885-b7f4-4ee6-beb2-85efb0b31427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:35.862553 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf885-b7f4-4ee6-beb2-85efb0b31427 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:35.863043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf885-b7f4-4ee6-beb2-85efb0b31427 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:35.863522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf885-b7f4-4ee6-beb2-85efb0b31427 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a/users/0ba565893b024f0db9ae230d3bea0f7d/roles/347f011f3e624778b2823ef73698f6ad` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:35.867388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bf885-b7f4-4ee6-beb2-85efb0b31427 None admin] RBAC: Authorizing `identity:create_grant(project_id=59fff2f6945340d0895b4123f3f1cc4a, user_id=0ba565893b024f0db9ae230d3bea0f7d, role_id=347f011f3e624778b2823ef73698f6ad)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:35.870362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bf885-b7f4-4ee6-beb2-85efb0b31427 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:35.897667 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 143/294] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:49:35 2022] PUT /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a/users/0ba565893b024f0db9ae230d3bea0f7d/roles/347f011f3e624778b2823ef73698f6ad => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:49:37.364029 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22619283-c5d7-4b06-ac63-0c8c60c5ceea None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:37.364614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22619283-c5d7-4b06-ac63-0c8c60c5ceea None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:37.364884 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22619283-c5d7-4b06-ac63-0c8c60c5ceea None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:37.368113 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 152/295] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:37.374034 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46d4d0-3847-4231-a0d3-b913d759e145 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:37.374995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46d4d0-3847-4231-a0d3-b913d759e145 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:37.375477 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46d4d0-3847-4231-a0d3-b913d759e145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:37.398914 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6d46d4d0-3847-4231-a0d3-b913d759e145 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:37.400536 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6d46d4d0-3847-4231-a0d3-b913d759e145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:37.480368 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e5d57-c31a-4519-bd01-987a558e26c9 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:37.481034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e5d57-c31a-4519-bd01-987a558e26c9 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:37.481564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e5d57-c31a-4519-bd01-987a558e26c9 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:37.487950 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 144/297] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:37.488617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 153/297] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:37.494092 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21e1a6-b765-4f4b-84eb-794a6c3d282e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:37.494692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21e1a6-b765-4f4b-84eb-794a6c3d282e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:37.495164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21e1a6-b765-4f4b-84eb-794a6c3d282e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:37.513586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e5d57-c31a-4519-bd01-987a558e26c9 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:37.516114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3b21e1a6-b765-4f4b-84eb-794a6c3d282e None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:37.517889 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3b21e1a6-b765-4f4b-84eb-794a6c3d282e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:37.627953 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 145/298] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:37.660419 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21e1a6-b765-4f4b-84eb-794a6c3d282e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:37.683270 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e5d57-c31a-4519-bd01-987a558e26c9 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:37.721633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:37.725753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:37.740060 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136562b-df97-4b28-92f3-ca7df3777847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:37.741393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136562b-df97-4b28-92f3-ca7df3777847 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:37.741846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136562b-df97-4b28-92f3-ca7df3777847 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:37.742488 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136562b-df97-4b28-92f3-ca7df3777847 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:37.745022 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136562b-df97-4b28-92f3-ca7df3777847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:37.746748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136562b-df97-4b28-92f3-ca7df3777847 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:37.754129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 154/299] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:49:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:37.755372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136562b-df97-4b28-92f3-ca7df3777847 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:37.830313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21e1a6-b765-4f4b-84eb-794a6c3d282e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:37.872075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664539f-551c-4bb6-abc0-681b213e5bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:37.873129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664539f-551c-4bb6-abc0-681b213e5bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:37.873573 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664539f-551c-4bb6-abc0-681b213e5bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:37.873848 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664539f-551c-4bb6-abc0-681b213e5bc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:37.893792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664539f-551c-4bb6-abc0-681b213e5bc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-a664539f-551c-4bb6-abc0-681b213e5bc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:37.904703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:37.908018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:37.908881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:37.908881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:37.908881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:37.908881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:37.908881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:37.908881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:37.908881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:37.908881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:37.908881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:37.908881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:37.908881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:37.908881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:37.908881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 146/300] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:49:37.915934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664539f-551c-4bb6-abc0-681b213e5bc7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:37.955245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136562b-df97-4b28-92f3-ca7df3777847 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:38.043617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ec3be-b64d-4abd-adb6-b98832fd3eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:38.045874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ec3be-b64d-4abd-adb6-b98832fd3eca None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:38.046689 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ec3be-b64d-4abd-adb6-b98832fd3eca None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:38.047944 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ec3be-b64d-4abd-adb6-b98832fd3eca None admin] PATH_INFO: `/v3/groups` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:38.049739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ec3be-b64d-4abd-adb6-b98832fd3eca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:38.053551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ec3be-b64d-4abd-adb6-b98832fd3eca None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:38.059889 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:38.086554 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664539f-551c-4bb6-abc0-681b213e5bc7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:38.089449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 155/301] 10.222.0.20 () {60 vars in 1134 bytes} [Sun Aug 7 00:49:37 2022] POST /identity/v3/groups => generated 229 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:49:38.186795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635fb59-2bf4-4c36-ab80-bde0463caa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:38.188698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635fb59-2bf4-4c36-ab80-bde0463caa71 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:38.189629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635fb59-2bf4-4c36-ab80-bde0463caa71 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:38.190391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635fb59-2bf4-4c36-ab80-bde0463caa71 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:38.192252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635fb59-2bf4-4c36-ab80-bde0463caa71 None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:38.193197 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635fb59-2bf4-4c36-ab80-bde0463caa71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:38.197189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635fb59-2bf4-4c36-ab80-bde0463caa71 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:38.222322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 147/302] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:38.238619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ec3be-b64d-4abd-adb6-b98832fd3eca None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:38.281467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901e958-57ab-401f-a8dd-f48c032da56a None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:38.282495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901e958-57ab-401f-a8dd-f48c032da56a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:38.283265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901e958-57ab-401f-a8dd-f48c032da56a None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:38.286728 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 148/303] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:38.293344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d887f-7d85-44dd-a3d2-fe95b01e204c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:38.293588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d887f-7d85-44dd-a3d2-fe95b01e204c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:38.294627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d887f-7d85-44dd-a3d2-fe95b01e204c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:38.324072 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0c7d887f-7d85-44dd-a3d2-fe95b01e204c None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:38.326528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0c7d887f-7d85-44dd-a3d2-fe95b01e204c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:38.356708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:38.443162 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ec3be-b64d-4abd-adb6-b98832fd3eca None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:38.478885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 149/304] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:38.510766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de81bf2-190b-4d17-9284-478fa47f9ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:38.512484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de81bf2-190b-4d17-9284-478fa47f9ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:38.513231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de81bf2-190b-4d17-9284-478fa47f9ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:38.513994 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de81bf2-190b-4d17-9284-478fa47f9ce3 None admin] PATH_INFO: `/v3/users/5edc2caaab474e538bf130ccd31f1704` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:38.516437 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de81bf2-190b-4d17-9284-478fa47f9ce3 None admin] RBAC: Authorizing `identity:get_user(user_id=5edc2caaab474e538bf130ccd31f1704)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:38.519188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d887f-7d85-44dd-a3d2-fe95b01e204c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:38.521656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de81bf2-190b-4d17-9284-478fa47f9ce3 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:38.524697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 156/305] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:38 2022] GET /identity/v3/users/5edc2caaab474e538bf130ccd31f1704 => generated 293 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:38.533072 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de81bf2-190b-4d17-9284-478fa47f9ce3 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:38.710468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:38.723996 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de81bf2-190b-4d17-9284-478fa47f9ce3 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:38.763067 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d887f-7d85-44dd-a3d2-fe95b01e204c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:38.766193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:38.784155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de867c61-17e7-4a24-804c-75e1ef562a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:38.785055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de867c61-17e7-4a24-804c-75e1ef562a15 None admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:38.785520 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de867c61-17e7-4a24-804c-75e1ef562a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:38.785948 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de867c61-17e7-4a24-804c-75e1ef562a15 None admin] PATH_INFO: `/v3/system/users/5edc2caaab474e538bf130ccd31f1704/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:38.788461 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de867c61-17e7-4a24-804c-75e1ef562a15 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5edc2caaab474e538bf130ccd31f1704, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:38.790282 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de867c61-17e7-4a24-804c-75e1ef562a15 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:38.804142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 157/306] 10.222.0.20 () {58 vars in 1334 bytes} [Sun Aug 7 00:49:38 2022] PUT /identity/v3/system/users/5edc2caaab474e538bf130ccd31f1704/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:49:38.808443 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9cb5a-b374-45c8-b993-0b231cd6defb None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:38.809552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9cb5a-b374-45c8-b993-0b231cd6defb None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:38.810215 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9cb5a-b374-45c8-b993-0b231cd6defb None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:38.813359 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 158/307] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:38.816891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a6237-9d6b-4ed4-8d35-d774babba8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:38.818414 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6237-9d6b-4ed4-8d35-d774babba8ae None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:38.820363 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6237-9d6b-4ed4-8d35-d774babba8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:38.820797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6237-9d6b-4ed4-8d35-d774babba8ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:38.821284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7151e-dc1b-44a8-b2fb-71e0d5f603a3 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:38.821963 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7151e-dc1b-44a8-b2fb-71e0d5f603a3 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:38.822913 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7151e-dc1b-44a8-b2fb-71e0d5f603a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:38.835842 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a6237-9d6b-4ed4-8d35-d774babba8ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-941a6237-9d6b-4ed4-8d35-d774babba8ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:38.841171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:38.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:38.844587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:38.844587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:38.844587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:38.844587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:38.844587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:38.844587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:38.844587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:38.844587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:38.844587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:38.844587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:38.844587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:38.844587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:38.845972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 150/308] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:49:38.857912 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a6237-9d6b-4ed4-8d35-d774babba8ae None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:38.862538 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-44d7151e-dc1b-44a8-b2fb-71e0d5f603a3 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:38.866486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-44d7151e-dc1b-44a8-b2fb-71e0d5f603a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:39.012216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 159/309] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:39.038750 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7151e-dc1b-44a8-b2fb-71e0d5f603a3 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:39.064026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a6237-9d6b-4ed4-8d35-d774babba8ae None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:39.130637 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999711d6-b114-4082-b75e-fbe29e0ea329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:39.132267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999711d6-b114-4082-b75e-fbe29e0ea329 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:39.132720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999711d6-b114-4082-b75e-fbe29e0ea329 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:39.133174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999711d6-b114-4082-b75e-fbe29e0ea329 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:39.134533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999711d6-b114-4082-b75e-fbe29e0ea329 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:39.135046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999711d6-b114-4082-b75e-fbe29e0ea329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:39.138386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999711d6-b114-4082-b75e-fbe29e0ea329 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:39.149341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:39.160182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 151/310] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:39.167162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999711d6-b114-4082-b75e-fbe29e0ea329 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:39.245736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7151e-dc1b-44a8-b2fb-71e0d5f603a3 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:39.277329 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:39.314320 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c8f81-23e5-4282-a2ec-2048d75b64d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:39.315785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c8f81-23e5-4282-a2ec-2048d75b64d7 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:39.316516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c8f81-23e5-4282-a2ec-2048d75b64d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:39.317164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c8f81-23e5-4282-a2ec-2048d75b64d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:39.337956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c8f81-23e5-4282-a2ec-2048d75b64d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-f35c8f81-23e5-4282-a2ec-2048d75b64d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:39.347646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:39.350233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:39.352043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:39.352043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:39.352043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:39.352043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:39.352043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:39.352043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:39.352043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:39.352043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:39.352043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:39.352043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:39.352043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:39.352043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:39.355491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 160/311] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:39.364323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c8f81-23e5-4282-a2ec-2048d75b64d7 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:39.375939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999711d6-b114-4082-b75e-fbe29e0ea329 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:39.418162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ccf24-26b0-4ac4-87bd-a3d13cb4161c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:39.418976 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ccf24-26b0-4ac4-87bd-a3d13cb4161c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:39.419354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ccf24-26b0-4ac4-87bd-a3d13cb4161c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:39.419733 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ccf24-26b0-4ac4-87bd-a3d13cb4161c None admin] PATH_INFO: `/v3/users/2f3571b9bab643c497ecad196e4aaa9b` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:39.438201 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ccf24-26b0-4ac4-87bd-a3d13cb4161c None admin] RBAC: Authorizing `identity:get_user(user_id=2f3571b9bab643c497ecad196e4aaa9b)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:39.439834 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ccf24-26b0-4ac4-87bd-a3d13cb4161c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:39.442156 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 152/312] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:39 2022] GET /identity/v3/users/2f3571b9bab643c497ecad196e4aaa9b => generated 293 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:39.449535 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ccf24-26b0-4ac4-87bd-a3d13cb4161c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:39.555815 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c8f81-23e5-4282-a2ec-2048d75b64d7 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:39.581412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:39.597870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468841cf-2d7e-4be3-887d-6d38e59a8044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:39.598626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468841cf-2d7e-4be3-887d-6d38e59a8044 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:39.598978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468841cf-2d7e-4be3-887d-6d38e59a8044 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:39.599316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468841cf-2d7e-4be3-887d-6d38e59a8044 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:39.601536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468841cf-2d7e-4be3-887d-6d38e59a8044 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:39.601536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468841cf-2d7e-4be3-887d-6d38e59a8044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:39.602690 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468841cf-2d7e-4be3-887d-6d38e59a8044 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:39.613021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 161/313] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:39.619217 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468841cf-2d7e-4be3-887d-6d38e59a8044 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:39.673065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ccf24-26b0-4ac4-87bd-a3d13cb4161c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:39.681517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:39.750051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d3468-f6e5-406e-b84d-ee806779f592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:39.751073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d3468-f6e5-406e-b84d-ee806779f592 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:39.751720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d3468-f6e5-406e-b84d-ee806779f592 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:39.752425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d3468-f6e5-406e-b84d-ee806779f592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:39.754155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d3468-f6e5-406e-b84d-ee806779f592 None admin] RBAC: Adding query filter params (role.id=347f011f3e624778b2823ef73698f6ad, user.id=2f3571b9bab643c497ecad196e4aaa9b, scope.system=all) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:39.755175 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d3468-f6e5-406e-b84d-ee806779f592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:39.758960 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d3468-f6e5-406e-b84d-ee806779f592 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:39.761751 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468841cf-2d7e-4be3-887d-6d38e59a8044 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:39.769919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 153/314] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Aug 7 00:49:39 2022] GET /identity/v3/role_assignments?user.id=2f3571b9bab643c497ecad196e4aaa9b&scope.system=all&role.id=347f011f3e624778b2823ef73698f6ad => generated 226 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:39.804214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c59e7-ebf4-4759-ad25-43c3dd674611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:39.804891 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c59e7-ebf4-4759-ad25-43c3dd674611 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:39.805191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c59e7-ebf4-4759-ad25-43c3dd674611 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:39.805442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c59e7-ebf4-4759-ad25-43c3dd674611 None admin] PATH_INFO: `/v3/users/0ba565893b024f0db9ae230d3bea0f7d` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:39.806922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c59e7-ebf4-4759-ad25-43c3dd674611 None admin] RBAC: Authorizing `identity:get_user(user_id=0ba565893b024f0db9ae230d3bea0f7d)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:39.808439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c59e7-ebf4-4759-ad25-43c3dd674611 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:39.810559 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 162/315] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:39 2022] GET /identity/v3/users/0ba565893b024f0db9ae230d3bea0f7d => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:39.816515 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d3468-f6e5-406e-b84d-ee806779f592 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:39.953291 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d3468-f6e5-406e-b84d-ee806779f592 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:39.988478 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:40.006720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdd426-663f-46fc-8e70-301b5c86bfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:40.007408 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdd426-663f-46fc-8e70-301b5c86bfba None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:40.007886 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdd426-663f-46fc-8e70-301b5c86bfba None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:40.008279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdd426-663f-46fc-8e70-301b5c86bfba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:40.125279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdd426-663f-46fc-8e70-301b5c86bfba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:40.127999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdd426-663f-46fc-8e70-301b5c86bfba None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:40.258868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 154/316] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:49:40.264731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c59e7-ebf4-4759-ad25-43c3dd674611 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:40.381235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c59e7-ebf4-4759-ad25-43c3dd674611 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:40.389218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:40.419745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975808-0ce8-47db-8d95-e94ed8a9b6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:40.420435 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975808-0ce8-47db-8d95-e94ed8a9b6dc None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:40.420717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975808-0ce8-47db-8d95-e94ed8a9b6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:40.420992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975808-0ce8-47db-8d95-e94ed8a9b6dc None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:40.422211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80975808-0ce8-47db-8d95-e94ed8a9b6dc None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:40.423690 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80975808-0ce8-47db-8d95-e94ed8a9b6dc None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:40.425442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 163/317] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:40 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:40.432392 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdd426-663f-46fc-8e70-301b5c86bfba None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:40.472298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:40.486276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29804ce6-11a0-4cc8-ad4f-7d12a67b3492 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:40.486633 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29804ce6-11a0-4cc8-ad4f-7d12a67b3492 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:40.486827 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29804ce6-11a0-4cc8-ad4f-7d12a67b3492 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:40.488488 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 164/318] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:49:40.494665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3f92d-fa40-4bce-8144-8ffdc4f0fd0b None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:40.494860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3f92d-fa40-4bce-8144-8ffdc4f0fd0b None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:40.495100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3f92d-fa40-4bce-8144-8ffdc4f0fd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:40.515539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3ff3f92d-fa40-4bce-8144-8ffdc4f0fd0b None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:40.516831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3ff3f92d-fa40-4bce-8144-8ffdc4f0fd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:40.561526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdd426-663f-46fc-8e70-301b5c86bfba None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:40.604003 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 165/319] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:49:40.607818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77151f9-44af-4241-b80e-37afda22f9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:40.609268 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77151f9-44af-4241-b80e-37afda22f9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:40.609755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77151f9-44af-4241-b80e-37afda22f9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:40.610322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77151f9-44af-4241-b80e-37afda22f9b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:40.611281 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77151f9-44af-4241-b80e-37afda22f9b2 None admin] RBAC: Adding query filter params (role.id=347f011f3e624778b2823ef73698f6ad, scope.project.id=59fff2f6945340d0895b4123f3f1cc4a, user.id=0ba565893b024f0db9ae230d3bea0f7d) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:40.611804 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77151f9-44af-4241-b80e-37afda22f9b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:40.613519 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77151f9-44af-4241-b80e-37afda22f9b2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:40.621716 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3f92d-fa40-4bce-8144-8ffdc4f0fd0b None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:40.627059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 155/320] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:49:40 2022] GET /identity/v3/role_assignments?user.id=0ba565893b024f0db9ae230d3bea0f7d&scope.project.id=59fff2f6945340d0895b4123f3f1cc4a&role.id=347f011f3e624778b2823ef73698f6ad => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:40.760886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3f92d-fa40-4bce-8144-8ffdc4f0fd0b None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:40.764302 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:40.807550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9482a1f-4102-4c30-9758-2ab13a940ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:40.808685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9482a1f-4102-4c30-9758-2ab13a940ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:40.809194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9482a1f-4102-4c30-9758-2ab13a940ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:40.809681 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9482a1f-4102-4c30-9758-2ab13a940ff9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:40.811271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9482a1f-4102-4c30-9758-2ab13a940ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:40.813238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9482a1f-4102-4c30-9758-2ab13a940ff9 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:40.815652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 166/321] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:49:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:40.821986 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77151f9-44af-4241-b80e-37afda22f9b2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:40.967543 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:40.989444 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77151f9-44af-4241-b80e-37afda22f9b2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:41.030746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27ff90-8712-47ea-9960-80155904deb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:41.031364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27ff90-8712-47ea-9960-80155904deb8 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:41.031631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27ff90-8712-47ea-9960-80155904deb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:41.031942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27ff90-8712-47ea-9960-80155904deb8 None admin] PATH_INFO: `/v3/groups` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:41.032624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27ff90-8712-47ea-9960-80155904deb8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:41.034053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27ff90-8712-47ea-9960-80155904deb8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:41.055687 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 156/322] 10.222.0.20 () {60 vars in 1134 bytes} [Sun Aug 7 00:49:40 2022] POST /identity/v3/groups => generated 226 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:49:41.089626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52e72f-5593-4ac2-a7dd-3d4cefc93712 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:41.089885 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52e72f-5593-4ac2-a7dd-3d4cefc93712 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:41.090216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52e72f-5593-4ac2-a7dd-3d4cefc93712 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:41.091962 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 167/323] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:49:41.097854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9586be-eda8-465e-99c6-c1f8699fdbdc None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:41.098139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9586be-eda8-465e-99c6-c1f8699fdbdc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:41.098438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9586be-eda8-465e-99c6-c1f8699fdbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:41.121378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-cf9586be-eda8-465e-99c6-c1f8699fdbdc None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:41.122631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cf9586be-eda8-465e-99c6-c1f8699fdbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:41.213572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 157/324] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:49:41.237925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52e72f-5593-4ac2-a7dd-3d4cefc93712 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:41.376776 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52e72f-5593-4ac2-a7dd-3d4cefc93712 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:41.419128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061eeaf-3aef-43c4-9bc2-bcf143c15d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:41.419845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061eeaf-3aef-43c4-9bc2-bcf143c15d6e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:41.420168 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061eeaf-3aef-43c4-9bc2-bcf143c15d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:41.420439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061eeaf-3aef-43c4-9bc2-bcf143c15d6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:41.433567 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061eeaf-3aef-43c4-9bc2-bcf143c15d6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-1061eeaf-3aef-43c4-9bc2-bcf143c15d6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:41.438429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:41.440175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:41.441765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:41.441765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:41.441765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:41.441765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:41.441765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:41.441765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:41.441765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:41.441765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:41.441765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:41.441765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:41.441765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:41.441765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:41.442930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 168/325] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:41.447121 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9586be-eda8-465e-99c6-c1f8699fdbdc None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:41.548178 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:41.579630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9586be-eda8-465e-99c6-c1f8699fdbdc None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:41.637947 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa77a8a-4082-4fa1-9acf-dca32bbb9fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:41.639322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa77a8a-4082-4fa1-9acf-dca32bbb9fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:41.639820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa77a8a-4082-4fa1-9acf-dca32bbb9fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:41.640332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa77a8a-4082-4fa1-9acf-dca32bbb9fc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:41.641216 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa77a8a-4082-4fa1-9acf-dca32bbb9fc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:41.642116 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa77a8a-4082-4fa1-9acf-dca32bbb9fc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:41.644987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa77a8a-4082-4fa1-9acf-dca32bbb9fc2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:41.656632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 158/326] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:41.665267 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061eeaf-3aef-43c4-9bc2-bcf143c15d6e None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:41.731068 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:41.804291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061eeaf-3aef-43c4-9bc2-bcf143c15d6e None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:41.846360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c80b8-6dcc-4c4b-895b-b98562b448c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:41.847055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c80b8-6dcc-4c4b-895b-b98562b448c9 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:41.847331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c80b8-6dcc-4c4b-895b-b98562b448c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:41.847602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c80b8-6dcc-4c4b-895b-b98562b448c9 None admin] PATH_INFO: `/v3/users/5edc2caaab474e538bf130ccd31f1704` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:41.848871 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c80b8-6dcc-4c4b-895b-b98562b448c9 None admin] RBAC: Authorizing `identity:get_user(user_id=5edc2caaab474e538bf130ccd31f1704)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:41.850414 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c80b8-6dcc-4c4b-895b-b98562b448c9 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:41.852430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 169/327] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:41 2022] GET /identity/v3/users/5edc2caaab474e538bf130ccd31f1704 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:41.861371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa77a8a-4082-4fa1-9acf-dca32bbb9fc2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:42.033293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa77a8a-4082-4fa1-9acf-dca32bbb9fc2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:42.090177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddf19e-440d-459b-a1d2-9c2cee0b8824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:42.091153 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddf19e-440d-459b-a1d2-9c2cee0b8824 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:42.091647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddf19e-440d-459b-a1d2-9c2cee0b8824 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:42.092141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddf19e-440d-459b-a1d2-9c2cee0b8824 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:42.093102 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddf19e-440d-459b-a1d2-9c2cee0b8824 None admin] RBAC: Adding query filter params (role.id=93e4ae64906f4b0ea861a4ac4571f1d7, user.id=5edc2caaab474e538bf130ccd31f1704, scope.system=all) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:42.093612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddf19e-440d-459b-a1d2-9c2cee0b8824 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:42.095288 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddf19e-440d-459b-a1d2-9c2cee0b8824 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:42.103110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:42.117778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 159/328] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Aug 7 00:49:41 2022] GET /identity/v3/role_assignments?user.id=5edc2caaab474e538bf130ccd31f1704&scope.system=all&role.id=93e4ae64906f4b0ea861a4ac4571f1d7 => generated 510 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:42.198571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedb5ed-4228-4c85-bf47-6fd0943177e3 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:42.198906 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedb5ed-4228-4c85-bf47-6fd0943177e3 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:42.199123 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedb5ed-4228-4c85-bf47-6fd0943177e3 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:42.200865 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 170/329] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:42.209014 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322203f-ae14-4d52-b502-613a0f115000 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:42.209916 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322203f-ae14-4d52-b502-613a0f115000 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:42.210761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322203f-ae14-4d52-b502-613a0f115000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:42.237883 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b322203f-ae14-4d52-b502-613a0f115000 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:42.239467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b322203f-ae14-4d52-b502-613a0f115000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:42.330192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 160/330] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:42.368634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedb5ed-4228-4c85-bf47-6fd0943177e3 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:42.516110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:42.517408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedb5ed-4228-4c85-bf47-6fd0943177e3 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:42.570656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d5406-4df4-40ca-ba77-1869882fb361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:42.571771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d5406-4df4-40ca-ba77-1869882fb361 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:42.572294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d5406-4df4-40ca-ba77-1869882fb361 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:42.572804 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d5406-4df4-40ca-ba77-1869882fb361 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:42.601281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d5406-4df4-40ca-ba77-1869882fb361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-394d5406-4df4-40ca-ba77-1869882fb361 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:42.610454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:42.611863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:42.613433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:42.613433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:42.613433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:42.613433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:42.613433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:42.613433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:42.613433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:42.613433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:42.613433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:42.613433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:42.613433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:42.613433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:42.622765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 171/331] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:42.632565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322203f-ae14-4d52-b502-613a0f115000 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:42.785715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322203f-ae14-4d52-b502-613a0f115000 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:42.820414 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:42.831936 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a09a5-5fd3-46af-a670-ab92f300a3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:42.832587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a09a5-5fd3-46af-a670-ab92f300a3af None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:42.832867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a09a5-5fd3-46af-a670-ab92f300a3af None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:42.833137 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a09a5-5fd3-46af-a670-ab92f300a3af None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:42.834406 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a09a5-5fd3-46af-a670-ab92f300a3af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:42.834907 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a09a5-5fd3-46af-a670-ab92f300a3af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:42.836698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a09a5-5fd3-46af-a670-ab92f300a3af None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:42.853111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d5406-4df4-40ca-ba77-1869882fb361 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:42.854191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 161/332] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:43.032968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d5406-4df4-40ca-ba77-1869882fb361 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:43.078681 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ecfd2-087e-4e25-9b2c-343caab05670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:43.079723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ecfd2-087e-4e25-9b2c-343caab05670 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:43.080228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ecfd2-087e-4e25-9b2c-343caab05670 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:43.080702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ecfd2-087e-4e25-9b2c-343caab05670 None admin] PATH_INFO: `/v3/users/2f3571b9bab643c497ecad196e4aaa9b` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:43.082218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ecfd2-087e-4e25-9b2c-343caab05670 None admin] RBAC: Authorizing `identity:get_user(user_id=2f3571b9bab643c497ecad196e4aaa9b)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:43.084441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ecfd2-087e-4e25-9b2c-343caab05670 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:43.086727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 172/333] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:42 2022] GET /identity/v3/users/2f3571b9bab643c497ecad196e4aaa9b => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:43.093057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a09a5-5fd3-46af-a670-ab92f300a3af None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:43.242000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a09a5-5fd3-46af-a670-ab92f300a3af None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:43.283572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7e88d-8d19-4aa5-9af0-3a06f5607473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:43.284197 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7e88d-8d19-4aa5-9af0-3a06f5607473 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:43.284479 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7e88d-8d19-4aa5-9af0-3a06f5607473 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:43.284755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7e88d-8d19-4aa5-9af0-3a06f5607473 None admin] PATH_INFO: `/v3/system/users/2f3571b9bab643c497ecad196e4aaa9b/roles/347f011f3e624778b2823ef73698f6ad` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:43.288918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7e88d-8d19-4aa5-9af0-3a06f5607473 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2f3571b9bab643c497ecad196e4aaa9b, role_id=347f011f3e624778b2823ef73698f6ad)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:43.290504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7e88d-8d19-4aa5-9af0-3a06f5607473 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:43.306543 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 162/334] 10.222.0.20 () {58 vars in 1334 bytes} [Sun Aug 7 00:49:43 2022] PUT /identity/v3/system/users/2f3571b9bab643c497ecad196e4aaa9b/roles/347f011f3e624778b2823ef73698f6ad => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:49:44.442827 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab9c4f-b14e-45a2-9563-134b26f6acf3 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:44.444141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab9c4f-b14e-45a2-9563-134b26f6acf3 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:44.444630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab9c4f-b14e-45a2-9563-134b26f6acf3 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:44.446628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 173/335] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:44.454591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f75e46-f302-4ebf-8b7d-32c4410b4ae3 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:44.455533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f75e46-f302-4ebf-8b7d-32c4410b4ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:44.456046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f75e46-f302-4ebf-8b7d-32c4410b4ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:44.481594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-69f75e46-f302-4ebf-8b7d-32c4410b4ae3 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:44.483188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-69f75e46-f302-4ebf-8b7d-32c4410b4ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:44.549912 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:44.571506 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191299d-05ce-4758-bfaa-ab2a58f7045b None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:44.572166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191299d-05ce-4758-bfaa-ab2a58f7045b None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:44.572685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191299d-05ce-4758-bfaa-ab2a58f7045b None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:44.581634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 174/336] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:44 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:44.582204 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 163/337] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:44.605979 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27eed1-cee1-429e-8e1a-eb9942eac299 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:44.606473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27eed1-cee1-429e-8e1a-eb9942eac299 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:44.606961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27eed1-cee1-429e-8e1a-eb9942eac299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:44.653349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f75e46-f302-4ebf-8b7d-32c4410b4ae3 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:44.656704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3a27eed1-cee1-429e-8e1a-eb9942eac299 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:44.658818 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3a27eed1-cee1-429e-8e1a-eb9942eac299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:44.731184 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:44.850456 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f75e46-f302-4ebf-8b7d-32c4410b4ae3 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:44.906683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 175/338] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:44.915222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902370f-ff80-40f8-8ab0-781009a63b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:44.915963 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902370f-ff80-40f8-8ab0-781009a63b5f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:44.916250 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902370f-ff80-40f8-8ab0-781009a63b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:44.916526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902370f-ff80-40f8-8ab0-781009a63b5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:44.937068 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902370f-ff80-40f8-8ab0-781009a63b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e902370f-ff80-40f8-8ab0-781009a63b5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:44.942267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:44.943854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:44.944905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:44.944905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:44.944905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:44.944905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:44.944905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:44.944905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:44.944905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:44.944905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:44.944905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:44.944905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:44.944905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:44.944905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:44.947610 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 164/339] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:44.954150 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27eed1-cee1-429e-8e1a-eb9942eac299 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:44.998349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902370f-ff80-40f8-8ab0-781009a63b5f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:45.089794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:45.204839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902370f-ff80-40f8-8ab0-781009a63b5f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:45.216802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27eed1-cee1-429e-8e1a-eb9942eac299 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:45.287485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd936f84-2066-46a7-b35e-b6ad9dac8955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:45.293079 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd936f84-2066-46a7-b35e-b6ad9dac8955 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:45.293863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd936f84-2066-46a7-b35e-b6ad9dac8955 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:45.294413 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd936f84-2066-46a7-b35e-b6ad9dac8955 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:45.309310 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92901089-9216-494e-8549-9007f5504509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:45.309966 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92901089-9216-494e-8549-9007f5504509 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:45.310251 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92901089-9216-494e-8549-9007f5504509 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:45.310528 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92901089-9216-494e-8549-9007f5504509 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:45.311245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92901089-9216-494e-8549-9007f5504509 None admin] RBAC: Adding query filter params (name=member) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:45.311551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92901089-9216-494e-8549-9007f5504509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:45.313335 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92901089-9216-494e-8549-9007f5504509 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:45.315836 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd936f84-2066-46a7-b35e-b6ad9dac8955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-cd936f84-2066-46a7-b35e-b6ad9dac8955 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:45.322447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:45.323425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:45.324279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:45.324279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:45.324279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:45.324279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:45.324279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:45.324279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:45.324279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:45.324279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:45.324279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:45.324279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:45.324279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:45.324279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:45.327788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 165/340] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:49:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:45.337554 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd936f84-2066-46a7-b35e-b6ad9dac8955 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:45.339527 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 176/341] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:45.346908 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92901089-9216-494e-8549-9007f5504509 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:45.397109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:45.587396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd936f84-2066-46a7-b35e-b6ad9dac8955 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:45.592424 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:45.628752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92901089-9216-494e-8549-9007f5504509 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:45.701323 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1b9f3-3c47-4d9d-b5e2-4446481f24fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:45.701949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1b9f3-3c47-4d9d-b5e2-4446481f24fa None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:45.702395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1b9f3-3c47-4d9d-b5e2-4446481f24fa None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:45.702811 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1b9f3-3c47-4d9d-b5e2-4446481f24fa None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:45.703645 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1b9f3-3c47-4d9d-b5e2-4446481f24fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:45.704152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1b9f3-3c47-4d9d-b5e2-4446481f24fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:45.705713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1b9f3-3c47-4d9d-b5e2-4446481f24fa None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:45.740642 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 166/342] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:49:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:45.745010 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6ab14-e98c-4e76-9f38-b1cf9fbaa5ee None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:45.746406 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6ab14-e98c-4e76-9f38-b1cf9fbaa5ee None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:45.746904 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6ab14-e98c-4e76-9f38-b1cf9fbaa5ee None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:45.749533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 167/343] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:45.750924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6ab14-e98c-4e76-9f38-b1cf9fbaa5ee None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:45.758536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d6f04-b746-4210-9c2b-894a964524dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:45.759655 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d6f04-b746-4210-9c2b-894a964524dd None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:45.760179 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d6f04-b746-4210-9c2b-894a964524dd None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:45.760662 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d6f04-b746-4210-9c2b-894a964524dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:45.974987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d6f04-b746-4210-9c2b-894a964524dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:45.977766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d6f04-b746-4210-9c2b-894a964524dd None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:46.029680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:46.031211 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6ab14-e98c-4e76-9f38-b1cf9fbaa5ee None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:46.104327 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fdb9b-a6ad-4d7f-b047-0f0f2cffac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:46.104952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fdb9b-a6ad-4d7f-b047-0f0f2cffac3f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:46.105231 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fdb9b-a6ad-4d7f-b047-0f0f2cffac3f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:46.105509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fdb9b-a6ad-4d7f-b047-0f0f2cffac3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:46.179771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 177/344] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 834 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:46.181423 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4dbd0-2cc0-4bb7-bc98-34ecd8773a40 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:46.181732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4dbd0-2cc0-4bb7-bc98-34ecd8773a40 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:46.182093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4dbd0-2cc0-4bb7-bc98-34ecd8773a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:46.183780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:46.209701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-acd4dbd0-2cc0-4bb7-bc98-34ecd8773a40 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:46.211247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-acd4dbd0-2cc0-4bb7-bc98-34ecd8773a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:46.279690 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fdb9b-a6ad-4d7f-b047-0f0f2cffac3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:46.282612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fdb9b-a6ad-4d7f-b047-0f0f2cffac3f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:46.358120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 178/345] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:46.367938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540658-af06-47bc-878e-ce0071afabf6 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:46.367938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540658-af06-47bc-878e-ce0071afabf6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:46.367938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00540658-af06-47bc-878e-ce0071afabf6 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:46.367938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 179/346] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:46.367938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540658-af06-47bc-878e-ce0071afabf6 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:46.471352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:46.551135 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 168/347] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 801 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:46.559938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1072bed-7ccc-4a0b-8094-56d348354343 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:46.559938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1072bed-7ccc-4a0b-8094-56d348354343 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:46.559938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1072bed-7ccc-4a0b-8094-56d348354343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:46.594782 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c1072bed-7ccc-4a0b-8094-56d348354343 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:46.596899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c1072bed-7ccc-4a0b-8094-56d348354343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:46.597118 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00540658-af06-47bc-878e-ce0071afabf6 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:46.667287 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630d9b2-24bb-40ec-a9d2-0f0cfbee0cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:46.668470 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630d9b2-24bb-40ec-a9d2-0f0cfbee0cea None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:46.668792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630d9b2-24bb-40ec-a9d2-0f0cfbee0cea None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:46.670400 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630d9b2-24bb-40ec-a9d2-0f0cfbee0cea None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:46.671935 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630d9b2-24bb-40ec-a9d2-0f0cfbee0cea None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:46.674473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630d9b2-24bb-40ec-a9d2-0f0cfbee0cea None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:46.677853 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 180/348] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:46 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:46.680639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630d9b2-24bb-40ec-a9d2-0f0cfbee0cea None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:46.716463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:46.730625 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 169/349] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:46.732000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1072bed-7ccc-4a0b-8094-56d348354343 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:46.913942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1072bed-7ccc-4a0b-8094-56d348354343 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:46.936578 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630d9b2-24bb-40ec-a9d2-0f0cfbee0cea None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:46.973542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:46.980441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8711d0-00bd-448c-8011-d629eeb04f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:46.981220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8711d0-00bd-448c-8011-d629eeb04f5e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:46.981571 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8711d0-00bd-448c-8011-d629eeb04f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:46.981946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8711d0-00bd-448c-8011-d629eeb04f5e None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:46.983276 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8711d0-00bd-448c-8011-d629eeb04f5e None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:46.984857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8711d0-00bd-448c-8011-d629eeb04f5e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:46.986988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 170/350] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:46 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:46.987921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8711d0-00bd-448c-8011-d629eeb04f5e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:47.014208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb42bad-8d99-432f-842c-130362ae2179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:47.016431 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb42bad-8d99-432f-842c-130362ae2179 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:47.017473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb42bad-8d99-432f-842c-130362ae2179 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:47.018132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb42bad-8d99-432f-842c-130362ae2179 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:47.036133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb42bad-8d99-432f-842c-130362ae2179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-9fb42bad-8d99-432f-842c-130362ae2179 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:47.046096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:47.047842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:47.049826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:47.049826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:47.049826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:47.049826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:47.049826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:47.049826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:47.049826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:47.049826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:47.049826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:47.049826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:47.049826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:47.049826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:47.049826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 181/351] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:49:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:47.052009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb42bad-8d99-432f-842c-130362ae2179 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:47.098994 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:47.182729 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8711d0-00bd-448c-8011-d629eeb04f5e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:47.232203 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb42bad-8d99-432f-842c-130362ae2179 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:47.243172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faced4c-af35-494c-8a53-1994916c40a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:47.244361 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faced4c-af35-494c-8a53-1994916c40a0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:47.244979 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faced4c-af35-494c-8a53-1994916c40a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:47.245439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faced4c-af35-494c-8a53-1994916c40a0 None admin] PATH_INFO: `/v3/groups/4769d31969304e22ad273f7b647004ae` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:47.256717 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faced4c-af35-494c-8a53-1994916c40a0 None admin] RBAC: Authorizing `identity:get_group(group_id=4769d31969304e22ad273f7b647004ae)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:47.258468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faced4c-af35-494c-8a53-1994916c40a0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:47.261569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 171/352] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Aug 7 00:49:46 2022] GET /identity/v3/groups/4769d31969304e22ad273f7b647004ae => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:47.263698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c9728-dcbe-4bad-8583-9f7149447ada None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:47.264176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c9728-dcbe-4bad-8583-9f7149447ada None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:47.264643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c9728-dcbe-4bad-8583-9f7149447ada None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:47.267024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 172/353] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:47.268459 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c9728-dcbe-4bad-8583-9f7149447ada None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:47.286034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9527-2229-4cd9-ad9c-0d34ae8d53aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:47.287259 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9527-2229-4cd9-ad9c-0d34ae8d53aa None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:47.287534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9527-2229-4cd9-ad9c-0d34ae8d53aa None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:47.287802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9527-2229-4cd9-ad9c-0d34ae8d53aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:47.300900 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f9527-2229-4cd9-ad9c-0d34ae8d53aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-805f9527-2229-4cd9-ad9c-0d34ae8d53aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:47.305842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:47.307785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:47.309509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:47.309509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:47.309509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:47.309509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:47.309509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:47.309509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:47.309509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:47.309509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:47.309509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:47.309509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:47.309509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:47.309509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:47.309509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 182/354] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:47.309509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9527-2229-4cd9-ad9c-0d34ae8d53aa None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:47.370055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:47.483722 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c9728-dcbe-4bad-8583-9f7149447ada None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:47.487527 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9527-2229-4cd9-ad9c-0d34ae8d53aa None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:47.533163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:47.546338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d802c-673e-4422-8d4e-a497d4069a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:47.546679 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d802c-673e-4422-8d4e-a497d4069a6b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:47.546901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d802c-673e-4422-8d4e-a497d4069a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:47.547165 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d802c-673e-4422-8d4e-a497d4069a6b None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:47.547841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d802c-673e-4422-8d4e-a497d4069a6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:47.548163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d802c-673e-4422-8d4e-a497d4069a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:47.549549 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d802c-673e-4422-8d4e-a497d4069a6b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:47.558663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f9918-353f-4bcd-bde5-c53b4740f1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:47.559768 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f9918-353f-4bcd-bde5-c53b4740f1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:47.560329 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 183/355] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:49:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:47.560666 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f9918-353f-4bcd-bde5-c53b4740f1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:47.561169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f9918-353f-4bcd-bde5-c53b4740f1e9 None admin] PATH_INFO: `/v3/groups/4769d31969304e22ad273f7b647004ae` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:47.561792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fc13b-bdbb-4abd-b53d-80e9222d9c23 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:47.562168 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fc13b-bdbb-4abd-b53d-80e9222d9c23 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:47.562418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fc13b-bdbb-4abd-b53d-80e9222d9c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:47.563298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f9918-353f-4bcd-bde5-c53b4740f1e9 None admin] RBAC: Authorizing `identity:get_group(group_id=4769d31969304e22ad273f7b647004ae)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:47.566263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f9918-353f-4bcd-bde5-c53b4740f1e9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:47.570881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 173/356] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Aug 7 00:49:47 2022] GET /identity/v3/groups/4769d31969304e22ad273f7b647004ae => generated 226 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:47.578147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f9918-353f-4bcd-bde5-c53b4740f1e9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:47.586496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-6c9fc13b-bdbb-4abd-b53d-80e9222d9c23 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:47.588091 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-6c9fc13b-bdbb-4abd-b53d-80e9222d9c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:47.703695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 184/357] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:47.705568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fc13b-bdbb-4abd-b53d-80e9222d9c23 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:47.769192 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:47.770722 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f9918-353f-4bcd-bde5-c53b4740f1e9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:47.830816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a1b03-2eab-4bb5-92d2-c11b5a802411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:47.835937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a1b03-2eab-4bb5-92d2-c11b5a802411 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:47.835937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a1b03-2eab-4bb5-92d2-c11b5a802411 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:47.835937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a1b03-2eab-4bb5-92d2-c11b5a802411 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:47.835937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a1b03-2eab-4bb5-92d2-c11b5a802411 None admin] RBAC: Adding query filter params (group.id=4769d31969304e22ad273f7b647004ae, role.id=93e4ae64906f4b0ea861a4ac4571f1d7, scope.project.id=06d4e914e37a47ff940142feccfa5200) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:47.835937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a1b03-2eab-4bb5-92d2-c11b5a802411 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:47.837693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a1b03-2eab-4bb5-92d2-c11b5a802411 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:47.847380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 174/358] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Aug 7 00:49:47 2022] GET /identity/v3/role_assignments?group.id=4769d31969304e22ad273f7b647004ae&scope.project.id=06d4e914e37a47ff940142feccfa5200&role.id=93e4ae64906f4b0ea861a4ac4571f1d7 => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:47.848291 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a1b03-2eab-4bb5-92d2-c11b5a802411 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:47.900137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fc13b-bdbb-4abd-b53d-80e9222d9c23 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:47.956718 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5d807-59eb-427c-923a-b6e93d9f0980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:47.957362 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5d807-59eb-427c-923a-b6e93d9f0980 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:47.957639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5d807-59eb-427c-923a-b6e93d9f0980 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:47.957902 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5d807-59eb-427c-923a-b6e93d9f0980 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:47.959168 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5d807-59eb-427c-923a-b6e93d9f0980 None admin] RBAC: Adding query filter params (name=member) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:47.959474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5d807-59eb-427c-923a-b6e93d9f0980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:47.961109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5d807-59eb-427c-923a-b6e93d9f0980 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:47.975695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 185/359] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:47.976516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5d807-59eb-427c-923a-b6e93d9f0980 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:47.998684 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:48.071702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a1b03-2eab-4bb5-92d2-c11b5a802411 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:48.149829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7d997-b436-4f0e-9051-87ab50b8e1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:48.150319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7d997-b436-4f0e-9051-87ab50b8e1eb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:48.150624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7d997-b436-4f0e-9051-87ab50b8e1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:48.151097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7d997-b436-4f0e-9051-87ab50b8e1eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:48.168771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:48.180811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5d807-59eb-427c-923a-b6e93d9f0980 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:48.251776 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1dc4f-2973-4125-9ddf-cb00a7c307eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:48.252745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1dc4f-2973-4125-9ddf-cb00a7c307eb None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:48.253103 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1dc4f-2973-4125-9ddf-cb00a7c307eb None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:48.253499 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1dc4f-2973-4125-9ddf-cb00a7c307eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:48.254395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1dc4f-2973-4125-9ddf-cb00a7c307eb None admin] RBAC: Adding query filter params (group.id=4769d31969304e22ad273f7b647004ae, role.id=b94b02b271d44f1195f1093a6202a947, scope.project.id=06d4e914e37a47ff940142feccfa5200) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:48.254851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1dc4f-2973-4125-9ddf-cb00a7c307eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:48.257196 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1dc4f-2973-4125-9ddf-cb00a7c307eb None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:48.273397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 186/360] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Aug 7 00:49:47 2022] GET /identity/v3/role_assignments?group.id=4769d31969304e22ad273f7b647004ae&scope.project.id=06d4e914e37a47ff940142feccfa5200&role.id=b94b02b271d44f1195f1093a6202a947 => generated 260 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:48.273397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f2208-e484-4cf3-8d2b-21ed5e071f47 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:48.273397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f2208-e484-4cf3-8d2b-21ed5e071f47 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:48.273397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f2208-e484-4cf3-8d2b-21ed5e071f47 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:48.279138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 187/361] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:48.280916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f2208-e484-4cf3-8d2b-21ed5e071f47 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:48.327260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7d997-b436-4f0e-9051-87ab50b8e1eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:48.329654 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7d997-b436-4f0e-9051-87ab50b8e1eb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:48.456066 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:48.540298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f2208-e484-4cf3-8d2b-21ed5e071f47 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:48.558000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 175/362] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:48.559937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7d997-b436-4f0e-9051-87ab50b8e1eb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:48.616090 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7563e-c9ca-4a67-b12a-e9c617362678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:48.617371 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7563e-c9ca-4a67-b12a-e9c617362678 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:48.617869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7563e-c9ca-4a67-b12a-e9c617362678 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:48.618635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7563e-c9ca-4a67-b12a-e9c617362678 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:48.641719 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7563e-c9ca-4a67-b12a-e9c617362678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-34d7563e-c9ca-4a67-b12a-e9c617362678 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:48.652880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:48.653854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:48.654661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:48.654661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:48.654661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:48.654661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:48.654661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:48.654661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:48.654661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:48.654661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:48.654661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:48.654661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:48.654661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:48.654661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:48.655799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 188/363] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:49:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:48.666164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525d9d6-c066-45a6-8a67-c4ce65b5aebe None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:48.666684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525d9d6-c066-45a6-8a67-c4ce65b5aebe None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:48.667160 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525d9d6-c066-45a6-8a67-c4ce65b5aebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:48.695279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7d997-b436-4f0e-9051-87ab50b8e1eb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:48.705812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-7525d9d6-c066-45a6-8a67-c4ce65b5aebe None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:48.707721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7525d9d6-c066-45a6-8a67-c4ce65b5aebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:48.733875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:48.747408 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcc32a-ec75-4a1b-a3f9-ea87f0ce4924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:48.749006 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc32a-ec75-4a1b-a3f9-ea87f0ce4924 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:48.749431 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc32a-ec75-4a1b-a3f9-ea87f0ce4924 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:48.749846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcc32a-ec75-4a1b-a3f9-ea87f0ce4924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:48.793293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:48.860844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcc32a-ec75-4a1b-a3f9-ea87f0ce4924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:48.861490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 189/364] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:48.862660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525d9d6-c066-45a6-8a67-c4ce65b5aebe None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:48.863363 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcc32a-ec75-4a1b-a3f9-ea87f0ce4924 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:49.029363 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 176/365] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:49.030739 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcc32a-ec75-4a1b-a3f9-ea87f0ce4924 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:49.041470 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525d9d6-c066-45a6-8a67-c4ce65b5aebe None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:49.085504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72ec69-9dd2-4a5f-a9fc-407be7ddff3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:49.086554 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72ec69-9dd2-4a5f-a9fc-407be7ddff3a None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:49.087031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72ec69-9dd2-4a5f-a9fc-407be7ddff3a None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:49.087498 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72ec69-9dd2-4a5f-a9fc-407be7ddff3a None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:49.088967 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72ec69-9dd2-4a5f-a9fc-407be7ddff3a None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:49.090673 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72ec69-9dd2-4a5f-a9fc-407be7ddff3a None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:49.093445 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 190/366] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:48 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:49.095258 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72ec69-9dd2-4a5f-a9fc-407be7ddff3a None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:49.118824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:49.121065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:49.190902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcc32a-ec75-4a1b-a3f9-ea87f0ce4924 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:49.238087 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0930680-539d-4758-9af8-b8d8bb441f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:49.238722 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0930680-539d-4758-9af8-b8d8bb441f67 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:49.239007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0930680-539d-4758-9af8-b8d8bb441f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:49.239651 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0930680-539d-4758-9af8-b8d8bb441f67 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:49.241631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0930680-539d-4758-9af8-b8d8bb441f67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:49.241941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0930680-539d-4758-9af8-b8d8bb441f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:49.243355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0930680-539d-4758-9af8-b8d8bb441f67 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:49.255204 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 177/367] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:49.257457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0930680-539d-4758-9af8-b8d8bb441f67 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:49.279324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72ec69-9dd2-4a5f-a9fc-407be7ddff3a None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:49.325245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7aac78-ea42-4f15-8442-d5f02e5b697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:49.326253 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aac78-ea42-4f15-8442-d5f02e5b697c None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:49.326757 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aac78-ea42-4f15-8442-d5f02e5b697c None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:49.327248 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aac78-ea42-4f15-8442-d5f02e5b697c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:49.351478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7aac78-ea42-4f15-8442-d5f02e5b697c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-4d7aac78-ea42-4f15-8442-d5f02e5b697c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:49.362159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:49.363135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:49.363978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:49.363978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:49.363978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:49.363978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:49.363978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:49.363978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:49.363978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:49.363978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:49.363978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:49.363978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:49.363978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:49:49.363978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:49.366667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 191/368] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:49.366991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7aac78-ea42-4f15-8442-d5f02e5b697c None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:49.428552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0930680-539d-4758-9af8-b8d8bb441f67 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:49.468504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:49.490813 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28104f-75e5-4b58-aed0-90f28819d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:49.492885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28104f-75e5-4b58-aed0-90f28819d0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:49.493449 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28104f-75e5-4b58-aed0-90f28819d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:49.494211 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28104f-75e5-4b58-aed0-90f28819d0e7 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:49.495981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28104f-75e5-4b58-aed0-90f28819d0e7 None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:49.498122 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28104f-75e5-4b58-aed0-90f28819d0e7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:49.501552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 178/369] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:49 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:49.503043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28104f-75e5-4b58-aed0-90f28819d0e7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:49.531896 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:49.569799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7aac78-ea42-4f15-8442-d5f02e5b697c None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:49.613028 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20297a-a85a-4ca8-8ba2-c8a9810c107c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:49.614098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20297a-a85a-4ca8-8ba2-c8a9810c107c None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:49.615187 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20297a-a85a-4ca8-8ba2-c8a9810c107c None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:49.616488 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20297a-a85a-4ca8-8ba2-c8a9810c107c None admin] PATH_INFO: `/v3/groups/4769d31969304e22ad273f7b647004ae` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:49.618177 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20297a-a85a-4ca8-8ba2-c8a9810c107c None admin] RBAC: Authorizing `identity:get_group(group_id=4769d31969304e22ad273f7b647004ae)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:49.620047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20297a-a85a-4ca8-8ba2-c8a9810c107c None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:49.622082 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 192/370] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Aug 7 00:49:49 2022] GET /identity/v3/groups/4769d31969304e22ad273f7b647004ae => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:49.623171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20297a-a85a-4ca8-8ba2-c8a9810c107c None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:49.740596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28104f-75e5-4b58-aed0-90f28819d0e7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:49.766508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20297a-a85a-4ca8-8ba2-c8a9810c107c None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:49.806341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057f7d3-bc4c-4664-b340-2e5e42f161ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:49.807324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057f7d3-bc4c-4664-b340-2e5e42f161ee None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:49.807874 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057f7d3-bc4c-4664-b340-2e5e42f161ee None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:49.808313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057f7d3-bc4c-4664-b340-2e5e42f161ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:49.813624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cc338-7e27-4b86-b23b-11a3ab37438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:49.815307 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cc338-7e27-4b86-b23b-11a3ab37438c None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:49.816154 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cc338-7e27-4b86-b23b-11a3ab37438c None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:49.816972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cc338-7e27-4b86-b23b-11a3ab37438c None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:49.819116 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cc338-7e27-4b86-b23b-11a3ab37438c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:49.820160 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cc338-7e27-4b86-b23b-11a3ab37438c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:49.823245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cc338-7e27-4b86-b23b-11a3ab37438c None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:49.838651 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 193/371] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:49.839836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cc338-7e27-4b86-b23b-11a3ab37438c None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:49.843954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:49.927091 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:49.955338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057f7d3-bc4c-4664-b340-2e5e42f161ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:49.958806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057f7d3-bc4c-4664-b340-2e5e42f161ee None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:49.971952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cc338-7e27-4b86-b23b-11a3ab37438c None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:50.013727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc506e-02cc-4720-84e3-3455b65354cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:50.014846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc506e-02cc-4720-84e3-3455b65354cc None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:50.015355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc506e-02cc-4720-84e3-3455b65354cc None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:50.015824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc506e-02cc-4720-84e3-3455b65354cc None admin] PATH_INFO: `/v3/groups/4769d31969304e22ad273f7b647004ae` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:50.017327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc506e-02cc-4720-84e3-3455b65354cc None admin] RBAC: Authorizing `identity:get_group(group_id=4769d31969304e22ad273f7b647004ae)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:50.019012 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc506e-02cc-4720-84e3-3455b65354cc None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:50.026537 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 194/372] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Aug 7 00:49:49 2022] GET /identity/v3/groups/4769d31969304e22ad273f7b647004ae => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:50.028331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc506e-02cc-4720-84e3-3455b65354cc None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:50.110031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:50.145343 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 179/373] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:50.147343 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057f7d3-bc4c-4664-b340-2e5e42f161ee None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:50.162574 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc506e-02cc-4720-84e3-3455b65354cc None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:50.204069 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541c1d4-518d-4adb-b225-045a154af030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:50.205043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541c1d4-518d-4adb-b225-045a154af030 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:50.205570 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541c1d4-518d-4adb-b225-045a154af030 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:50.206038 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541c1d4-518d-4adb-b225-045a154af030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:50.206978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541c1d4-518d-4adb-b225-045a154af030 None admin] RBAC: Adding query filter params (group.id=4769d31969304e22ad273f7b647004ae, role.id=b94b02b271d44f1195f1093a6202a947, scope.project.id=59fff2f6945340d0895b4123f3f1cc4a) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:50.207534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541c1d4-518d-4adb-b225-045a154af030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:50.210473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1541c1d4-518d-4adb-b225-045a154af030 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:50.216983 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 195/374] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Aug 7 00:49:50 2022] GET /identity/v3/role_assignments?group.id=4769d31969304e22ad273f7b647004ae&scope.project.id=59fff2f6945340d0895b4123f3f1cc4a&role.id=b94b02b271d44f1195f1093a6202a947 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:50.218074 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541c1d4-518d-4adb-b225-045a154af030 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:50.344230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541c1d4-518d-4adb-b225-045a154af030 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:50.386148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e9782-06fa-4b27-a535-3f5204bb47c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:50.387026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:50.388575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e9782-06fa-4b27-a535-3f5204bb47c8 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:50.389096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e9782-06fa-4b27-a535-3f5204bb47c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:50.389634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e9782-06fa-4b27-a535-3f5204bb47c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:50.390717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e9782-06fa-4b27-a535-3f5204bb47c8 None admin] RBAC: Adding query filter params (group.id=4769d31969304e22ad273f7b647004ae, role.id=93e4ae64906f4b0ea861a4ac4571f1d7, scope.project.id=59fff2f6945340d0895b4123f3f1cc4a) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:50.391229 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e9782-06fa-4b27-a535-3f5204bb47c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:50.393367 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e9782-06fa-4b27-a535-3f5204bb47c8 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:50.398206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:50.402765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 196/375] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Aug 7 00:49:50 2022] GET /identity/v3/role_assignments?group.id=4769d31969304e22ad273f7b647004ae&scope.project.id=59fff2f6945340d0895b4123f3f1cc4a&role.id=93e4ae64906f4b0ea861a4ac4571f1d7 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:50.408836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e9782-06fa-4b27-a535-3f5204bb47c8 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:50.427387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057f7d3-bc4c-4664-b340-2e5e42f161ee None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:50.555195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b3ae9-0eac-4185-be88-c4271d022081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:50.556491 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b3ae9-0eac-4185-be88-c4271d022081 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:50.556655 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b3ae9-0eac-4185-be88-c4271d022081 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:50.557048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b3ae9-0eac-4185-be88-c4271d022081 None admin] PATH_INFO: `/v3/users/2f3571b9bab643c497ecad196e4aaa9b` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:50.559009 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b3ae9-0eac-4185-be88-c4271d022081 None admin] RBAC: Authorizing `identity:get_user(user_id=2f3571b9bab643c497ecad196e4aaa9b)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:50.568048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b3ae9-0eac-4185-be88-c4271d022081 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:50.568048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 180/376] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:49:50 2022] GET /identity/v3/users/2f3571b9bab643c497ecad196e4aaa9b => generated 293 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:50.580580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b3ae9-0eac-4185-be88-c4271d022081 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:50.698061 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e9782-06fa-4b27-a535-3f5204bb47c8 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:50.784998 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9807e-7aef-4fb0-9670-b7708c93af01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:50.785760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9807e-7aef-4fb0-9670-b7708c93af01 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:50.785976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9807e-7aef-4fb0-9670-b7708c93af01 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:50.786292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9807e-7aef-4fb0-9670-b7708c93af01 None admin] PATH_INFO: `/v3/projects/348c3b03b0964532b13e1c51a4b097f3` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:50.789663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a9807e-7aef-4fb0-9670-b7708c93af01 None admin] RBAC: Authorizing `identity:get_project(project_id=348c3b03b0964532b13e1c51a4b097f3)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:50.791702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a9807e-7aef-4fb0-9670-b7708c93af01 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:50.794553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 197/377] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:50 2022] GET /identity/v3/projects/348c3b03b0964532b13e1c51a4b097f3 => generated 344 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:50.800570 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9807e-7aef-4fb0-9670-b7708c93af01 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:50.845096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b3ae9-0eac-4185-be88-c4271d022081 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:50.944708 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64038947-af72-41c3-8d96-51c46c53aa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:50.945351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64038947-af72-41c3-8d96-51c46c53aa9e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:50.945636 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64038947-af72-41c3-8d96-51c46c53aa9e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:50.946026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64038947-af72-41c3-8d96-51c46c53aa9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:50.946787 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64038947-af72-41c3-8d96-51c46c53aa9e None admin] RBAC: Adding query filter params (role.id=347f011f3e624778b2823ef73698f6ad, user.id=2f3571b9bab643c497ecad196e4aaa9b, scope.system=all) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:50.947098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64038947-af72-41c3-8d96-51c46c53aa9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:50.948648 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64038947-af72-41c3-8d96-51c46c53aa9e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:50.961961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:50.982369 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 181/378] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Aug 7 00:49:50 2022] GET /identity/v3/role_assignments?user.id=2f3571b9bab643c497ecad196e4aaa9b&scope.system=all&role.id=347f011f3e624778b2823ef73698f6ad => generated 510 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:51.030408 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60a332-8da1-4308-8f72-fef8f9f8211a None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:51.031158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60a332-8da1-4308-8f72-fef8f9f8211a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:51.031767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60a332-8da1-4308-8f72-fef8f9f8211a None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:51.034879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 182/379] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:51.041209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351509fd-d275-4a19-947d-4fdb25250340 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:51.042008 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351509fd-d275-4a19-947d-4fdb25250340 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:51.042689 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351509fd-d275-4a19-947d-4fdb25250340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:51.053460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9807e-7aef-4fb0-9670-b7708c93af01 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:51.096521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-351509fd-d275-4a19-947d-4fdb25250340 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:51.098519 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-351509fd-d275-4a19-947d-4fdb25250340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:51.123980 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac288af4-8470-4781-aef6-1d1b5bf99414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:51.125668 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac288af4-8470-4781-aef6-1d1b5bf99414 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:51.126370 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac288af4-8470-4781-aef6-1d1b5bf99414 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:51.127220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac288af4-8470-4781-aef6-1d1b5bf99414 None admin] PATH_INFO: `/v3/groups/a49c8ae4d7af4e0fa1e535cdbee3c602` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:51.129066 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:51.145937 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac288af4-8470-4781-aef6-1d1b5bf99414 None admin] RBAC: Authorizing `identity:get_group(group_id=a49c8ae4d7af4e0fa1e535cdbee3c602)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:51.150366 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac288af4-8470-4781-aef6-1d1b5bf99414 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:51.155030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 198/380] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Aug 7 00:49:50 2022] GET /identity/v3/groups/a49c8ae4d7af4e0fa1e535cdbee3c602 => generated 229 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:51.161138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32664b2-3083-4be3-b4ec-fa21e42a4e7a None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:51.162503 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32664b2-3083-4be3-b4ec-fa21e42a4e7a None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:51.163512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32664b2-3083-4be3-b4ec-fa21e42a4e7a None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:51.167829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 199/381] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:51.178542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be6bac-5aee-43f0-a1a3-83a464e2abbf None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:51.180042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be6bac-5aee-43f0-a1a3-83a464e2abbf None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:51.180777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be6bac-5aee-43f0-a1a3-83a464e2abbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:51.219037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-54be6bac-5aee-43f0-a1a3-83a464e2abbf None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:51.221895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-54be6bac-5aee-43f0-a1a3-83a464e2abbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:51.267681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 183/382] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:51.269405 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351509fd-d275-4a19-947d-4fdb25250340 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:51.378415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 200/383] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:49:51.384709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be6bac-5aee-43f0-a1a3-83a464e2abbf None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:51.473243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351509fd-d275-4a19-947d-4fdb25250340 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:51.524019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f0a84-c047-424b-87d0-38667015496e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:51.524657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f0a84-c047-424b-87d0-38667015496e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:51.524934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f0a84-c047-424b-87d0-38667015496e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:51.525210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f0a84-c047-424b-87d0-38667015496e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:51.525951 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f0a84-c047-424b-87d0-38667015496e None admin] RBAC: Adding query filter params (group.id=a49c8ae4d7af4e0fa1e535cdbee3c602, role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=348c3b03b0964532b13e1c51a4b097f3) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:51.526252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f0a84-c047-424b-87d0-38667015496e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:51.527726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f0a84-c047-424b-87d0-38667015496e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:51.535708 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 184/384] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Aug 7 00:49:51 2022] GET /identity/v3/role_assignments?group.id=a49c8ae4d7af4e0fa1e535cdbee3c602&scope.project.id=348c3b03b0964532b13e1c51a4b097f3&role.id=638e1fc82db44124ae615c46408110a7 => generated 260 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:51.536605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f0a84-c047-424b-87d0-38667015496e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:51.545302 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:51.554880 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:51.648883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be6bac-5aee-43f0-a1a3-83a464e2abbf None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:51.702463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f0a84-c047-424b-87d0-38667015496e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:51.748777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bd24e-3883-4c9f-9440-477dac505206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:51.749460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bd24e-3883-4c9f-9440-477dac505206 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:51.749736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bd24e-3883-4c9f-9440-477dac505206 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:51.750006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bd24e-3883-4c9f-9440-477dac505206 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:51.773194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bd24e-3883-4c9f-9440-477dac505206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:51.776961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0624f39-15cc-4237-a806-0cf0facb52ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-ec3bd24e-3883-4c9f-9440-477dac505206 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:51.778391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:51.779922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:51.781391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:51.781391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:51.781391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:51.781391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:51.781391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:51.781391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:51.781391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:51.781391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:51.781391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:51.781391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:51.781391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:51.781391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:51.781391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 201/385] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:49:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:51.783524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0624f39-15cc-4237-a806-0cf0facb52ac None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:51.784541 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0624f39-15cc-4237-a806-0cf0facb52ac None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:51.785274 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0624f39-15cc-4237-a806-0cf0facb52ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:51.785771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bd24e-3883-4c9f-9440-477dac505206 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:51.819389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0624f39-15cc-4237-a806-0cf0facb52ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-d0624f39-15cc-4237-a806-0cf0facb52ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:51.824932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:51.826786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:51.828366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:51.828366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:51.828366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:51.828366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:51.828366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:51.828366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:51.828366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:51.828366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:51.828366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:51.828366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:51.828366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:51.828366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:51.828366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 185/386] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:51.843327 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0624f39-15cc-4237-a806-0cf0facb52ac None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:52.063376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:52.099843 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bd24e-3883-4c9f-9440-477dac505206 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:52.136447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0624f39-15cc-4237-a806-0cf0facb52ac None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:52.142966 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:52.173793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51192e-73b9-497b-8cef-a2e86d44c0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:52.175322 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51192e-73b9-497b-8cef-a2e86d44c0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:52.178685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51192e-73b9-497b-8cef-a2e86d44c0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:52.179535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51192e-73b9-497b-8cef-a2e86d44c0d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:52.183031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51192e-73b9-497b-8cef-a2e86d44c0d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:52.187224 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51192e-73b9-497b-8cef-a2e86d44c0d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:52.190283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51192e-73b9-497b-8cef-a2e86d44c0d0 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:52.213033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 202/387] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:49:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:52.224168 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51192e-73b9-497b-8cef-a2e86d44c0d0 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:52.238657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43913e5-916b-41d2-a8d5-132d8c8d81d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:52.240445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43913e5-916b-41d2-a8d5-132d8c8d81d5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:52.241248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43913e5-916b-41d2-a8d5-132d8c8d81d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:52.245713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43913e5-916b-41d2-a8d5-132d8c8d81d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:52.247816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43913e5-916b-41d2-a8d5-132d8c8d81d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:52.250477 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43913e5-916b-41d2-a8d5-132d8c8d81d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:52.254164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43913e5-916b-41d2-a8d5-132d8c8d81d5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:52.289937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 186/388] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:52.317483 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43913e5-916b-41d2-a8d5-132d8c8d81d5 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:52.543564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51192e-73b9-497b-8cef-a2e86d44c0d0 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:52.621027 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43913e5-916b-41d2-a8d5-132d8c8d81d5 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:52.658362 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd52c0d-eaca-428c-b608-1cc6538a5368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:52.659036 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd52c0d-eaca-428c-b608-1cc6538a5368 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:52.659318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd52c0d-eaca-428c-b608-1cc6538a5368 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:52.659597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd52c0d-eaca-428c-b608-1cc6538a5368 None admin] PATH_INFO: `/v3/groups/4769d31969304e22ad273f7b647004ae` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:52.664819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd52c0d-eaca-428c-b608-1cc6538a5368 None admin] RBAC: Authorizing `identity:get_group(group_id=4769d31969304e22ad273f7b647004ae)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:52.666368 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd52c0d-eaca-428c-b608-1cc6538a5368 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:52.668550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 203/389] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Aug 7 00:49:52 2022] GET /identity/v3/groups/4769d31969304e22ad273f7b647004ae => generated 226 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:52.674372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd52c0d-eaca-428c-b608-1cc6538a5368 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:52.675862 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:52.689059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f2da7-68dd-4048-a3a9-d8efbc67fcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:52.690117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f2da7-68dd-4048-a3a9-d8efbc67fcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:52.690603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f2da7-68dd-4048-a3a9-d8efbc67fcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:52.691085 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f2da7-68dd-4048-a3a9-d8efbc67fcb4 None admin] PATH_INFO: `/v3/groups/4769d31969304e22ad273f7b647004ae` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:52.693738 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f2da7-68dd-4048-a3a9-d8efbc67fcb4 None admin] RBAC: Authorizing `identity:get_group(group_id=4769d31969304e22ad273f7b647004ae)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:52.701189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f2da7-68dd-4048-a3a9-d8efbc67fcb4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:52.705692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 187/390] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Aug 7 00:49:52 2022] GET /identity/v3/groups/4769d31969304e22ad273f7b647004ae => generated 226 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:52.712852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f2da7-68dd-4048-a3a9-d8efbc67fcb4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:52.860299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:52.938531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f2da7-68dd-4048-a3a9-d8efbc67fcb4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:53.010307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23c1cd-e70b-433c-b15b-9b992557abfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:53.012537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c1cd-e70b-433c-b15b-9b992557abfc None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:53.013087 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c1cd-e70b-433c-b15b-9b992557abfc None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:53.013613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23c1cd-e70b-433c-b15b-9b992557abfc None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:53.017986 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23c1cd-e70b-433c-b15b-9b992557abfc None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:53.021618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23c1cd-e70b-433c-b15b-9b992557abfc None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:53.026493 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 188/391] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:52 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:53.027243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd52c0d-eaca-428c-b608-1cc6538a5368 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:53.037550 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23c1cd-e70b-433c-b15b-9b992557abfc None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:53.080760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21a812-3b39-4413-b63a-10437edb0b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:53.081424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21a812-3b39-4413-b63a-10437edb0b28 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:53.081706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21a812-3b39-4413-b63a-10437edb0b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:53.081979 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21a812-3b39-4413-b63a-10437edb0b28 None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:53.084585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21a812-3b39-4413-b63a-10437edb0b28 None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:53.085526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21a812-3b39-4413-b63a-10437edb0b28 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:53.088582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 204/392] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:52 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:53.093501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21a812-3b39-4413-b63a-10437edb0b28 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:53.186194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:53.226562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21a812-3b39-4413-b63a-10437edb0b28 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:53.249116 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:53.277603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861c20d-948e-4f51-a8b4-df1ea7047fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:53.278282 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861c20d-948e-4f51-a8b4-df1ea7047fb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:53.278566 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861c20d-948e-4f51-a8b4-df1ea7047fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:53.278833 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861c20d-948e-4f51-a8b4-df1ea7047fb0 None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200/groups/4769d31969304e22ad273f7b647004ae/roles/b94b02b271d44f1195f1093a6202a947` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:53.283487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861c20d-948e-4f51-a8b4-df1ea7047fb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=06d4e914e37a47ff940142feccfa5200, group_id=4769d31969304e22ad273f7b647004ae, role_id=b94b02b271d44f1195f1093a6202a947)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:53.285024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861c20d-948e-4f51-a8b4-df1ea7047fb0 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:53.295561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23c1cd-e70b-433c-b15b-9b992557abfc None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:53.315082 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 205/393] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Aug 7 00:49:53 2022] PUT /identity/v3/projects/06d4e914e37a47ff940142feccfa5200/groups/4769d31969304e22ad273f7b647004ae/roles/b94b02b271d44f1195f1093a6202a947 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:49:53.366541 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17aae23-5066-4a06-9d5c-8b09b0bbf4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:53.368369 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aae23-5066-4a06-9d5c-8b09b0bbf4fa None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:53.369154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aae23-5066-4a06-9d5c-8b09b0bbf4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:53.369909 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aae23-5066-4a06-9d5c-8b09b0bbf4fa None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200/groups/4769d31969304e22ad273f7b647004ae/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:53.373890 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17aae23-5066-4a06-9d5c-8b09b0bbf4fa None admin] RBAC: Authorizing `identity:create_grant(project_id=06d4e914e37a47ff940142feccfa5200, group_id=4769d31969304e22ad273f7b647004ae, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:53.377588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17aae23-5066-4a06-9d5c-8b09b0bbf4fa None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:53.402563 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 189/394] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Aug 7 00:49:53 2022] PUT /identity/v3/projects/06d4e914e37a47ff940142feccfa5200/groups/4769d31969304e22ad273f7b647004ae/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:49:53.410681 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d3d86-5502-4892-89b3-637e1c759ebf None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:53.412435 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d3d86-5502-4892-89b3-637e1c759ebf None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:53.413511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d3d86-5502-4892-89b3-637e1c759ebf None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:53.416984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 206/395] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:49:53.426556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37a604-f989-43ca-822b-5fdba724a34f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:53.428531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37a604-f989-43ca-822b-5fdba724a34f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:53.429644 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37a604-f989-43ca-822b-5fdba724a34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:53.465211 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-bb37a604-f989-43ca-822b-5fdba724a34f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:53.467837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bb37a604-f989-43ca-822b-5fdba724a34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:53.584679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 190/396] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:53.631199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d3d86-5502-4892-89b3-637e1c759ebf None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:53.845491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d3d86-5502-4892-89b3-637e1c759ebf None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:53.920708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d304d-a505-400e-b7c7-2ffd0390c74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:53.921755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d304d-a505-400e-b7c7-2ffd0390c74e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:53.922266 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d304d-a505-400e-b7c7-2ffd0390c74e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:53.922760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d304d-a505-400e-b7c7-2ffd0390c74e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:53.941990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d304d-a505-400e-b7c7-2ffd0390c74e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-632d304d-a505-400e-b7c7-2ffd0390c74e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:53.952552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:53.953611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:53.954422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:53.954422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:53.954422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:53.954422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:53.954422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:53.954422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:53.954422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:53.954422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:53.954422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:53.954422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:53.954422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:53.954422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:53.955048 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 207/397] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:53.965065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37a604-f989-43ca-822b-5fdba724a34f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:54.021906 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cfa91-61c4-40da-b7dd-3b1cc7b38ca4 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:54.021906 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cfa91-61c4-40da-b7dd-3b1cc7b38ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:54.022901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cfa91-61c4-40da-b7dd-3b1cc7b38ca4 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:54.025547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 208/398] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:54.032318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaae585-59b1-405e-ab1d-bfce97c83af6 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:54.032765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaae585-59b1-405e-ab1d-bfce97c83af6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:54.033376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaae585-59b1-405e-ab1d-bfce97c83af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:54.066124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-efaae585-59b1-405e-ab1d-bfce97c83af6 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:54.068385 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-efaae585-59b1-405e-ab1d-bfce97c83af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:54.075046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:54.143332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37a604-f989-43ca-822b-5fdba724a34f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:54.168690 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:54.180727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af940bf-b6ab-4270-b871-3b1a2e0bc400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:54.181351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af940bf-b6ab-4270-b871-3b1a2e0bc400 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:54.181629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af940bf-b6ab-4270-b871-3b1a2e0bc400 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:54.181904 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af940bf-b6ab-4270-b871-3b1a2e0bc400 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:54.182575 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af940bf-b6ab-4270-b871-3b1a2e0bc400 None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:54.182874 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af940bf-b6ab-4270-b871-3b1a2e0bc400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:54.184291 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af940bf-b6ab-4270-b871-3b1a2e0bc400 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:54.202519 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 191/399] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:54.216041 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af940bf-b6ab-4270-b871-3b1a2e0bc400 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:54.258761 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 209/400] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:54.304856 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaae585-59b1-405e-ab1d-bfce97c83af6 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:54.397305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af940bf-b6ab-4270-b871-3b1a2e0bc400 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:54.416803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:54.434747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac0f10-372c-4e8c-a134-83cf9b847ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:54.435393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac0f10-372c-4e8c-a134-83cf9b847ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:54.435669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac0f10-372c-4e8c-a134-83cf9b847ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:54.435999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac0f10-372c-4e8c-a134-83cf9b847ec2 None admin] PATH_INFO: `/v3/groups/4769d31969304e22ad273f7b647004ae` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:54.437296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac0f10-372c-4e8c-a134-83cf9b847ec2 None admin] RBAC: Authorizing `identity:get_group(group_id=4769d31969304e22ad273f7b647004ae)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:54.438743 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac0f10-372c-4e8c-a134-83cf9b847ec2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:54.444023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 192/401] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Aug 7 00:49:54 2022] GET /identity/v3/groups/4769d31969304e22ad273f7b647004ae => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:54.444023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e17b2d-34ba-4132-b175-666735049c25 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:54.444023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e17b2d-34ba-4132-b175-666735049c25 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:54.444023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e17b2d-34ba-4132-b175-666735049c25 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:54.445483 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 193/402] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:54.450603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6665a66-5d69-4521-a16e-40a5e0c1bf33 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:54.451322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6665a66-5d69-4521-a16e-40a5e0c1bf33 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:54.451812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6665a66-5d69-4521-a16e-40a5e0c1bf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:54.471483 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f6665a66-5d69-4521-a16e-40a5e0c1bf33 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:54.473056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f6665a66-5d69-4521-a16e-40a5e0c1bf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:54.495500 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaae585-59b1-405e-ab1d-bfce97c83af6 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:54.535672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cacf1-9c42-4ae8-b690-5f3251d7fe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:54.537212 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cacf1-9c42-4ae8-b690-5f3251d7fe2f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:54.537326 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cacf1-9c42-4ae8-b690-5f3251d7fe2f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:54.537611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cacf1-9c42-4ae8-b690-5f3251d7fe2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:54.548749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 194/403] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:54.550068 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6665a66-5d69-4521-a16e-40a5e0c1bf33 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:54.551453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cacf1-9c42-4ae8-b690-5f3251d7fe2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-217cacf1-9c42-4ae8-b690-5f3251d7fe2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:54.558887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:54.559839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:54.565593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:54.565593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:54.565593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:54.565593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:54.565593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:54.565593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:54.565593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:54.565593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:54.565593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:54.565593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:54.565593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:54.565593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:54.565593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 210/404] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:49:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:49:54.568466 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cacf1-9c42-4ae8-b690-5f3251d7fe2f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:54.611828 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:54.680691 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6665a66-5d69-4521-a16e-40a5e0c1bf33 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:54.691889 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cacf1-9c42-4ae8-b690-5f3251d7fe2f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:54.706184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:54.727930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd4702-dd47-4141-9b51-f2900ad3c7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:54.728910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd4702-dd47-4141-9b51-f2900ad3c7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:54.728910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd4702-dd47-4141-9b51-f2900ad3c7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:54.729178 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd4702-dd47-4141-9b51-f2900ad3c7c9 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:54.730295 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd4702-dd47-4141-9b51-f2900ad3c7c9 None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:54.731760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd4702-dd47-4141-9b51-f2900ad3c7c9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:54.733811 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 195/405] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:54 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:54.734874 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd4702-dd47-4141-9b51-f2900ad3c7c9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:54.746489 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf876b-14a6-4587-bd86-147ac93c9679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:54.747526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf876b-14a6-4587-bd86-147ac93c9679 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:54.748305 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf876b-14a6-4587-bd86-147ac93c9679 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:54.748584 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf876b-14a6-4587-bd86-147ac93c9679 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:54.749292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf876b-14a6-4587-bd86-147ac93c9679 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:54.749597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf876b-14a6-4587-bd86-147ac93c9679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:54.751018 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf876b-14a6-4587-bd86-147ac93c9679 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:54.765325 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 211/406] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:49:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:54.765325 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf876b-14a6-4587-bd86-147ac93c9679 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:54.887449 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd4702-dd47-4141-9b51-f2900ad3c7c9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:54.903468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:54.923038 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf876b-14a6-4587-bd86-147ac93c9679 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:54.938300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545780b-9c40-46f1-a80b-62cb1f459491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:54.939415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545780b-9c40-46f1-a80b-62cb1f459491 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:54.939861 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545780b-9c40-46f1-a80b-62cb1f459491 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:54.940625 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545780b-9c40-46f1-a80b-62cb1f459491 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:54.965525 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545780b-9c40-46f1-a80b-62cb1f459491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:54.966262 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23230a0-d9df-456f-8d23-b8929b964be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:54.966934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23230a0-d9df-456f-8d23-b8929b964be5 None admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:54.967212 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23230a0-d9df-456f-8d23-b8929b964be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:54.967483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23230a0-d9df-456f-8d23-b8929b964be5 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a/groups/4769d31969304e22ad273f7b647004ae/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:54.969545 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23230a0-d9df-456f-8d23-b8929b964be5 None admin] RBAC: Authorizing `identity:create_grant(project_id=59fff2f6945340d0895b4123f3f1cc4a, group_id=4769d31969304e22ad273f7b647004ae, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:54.971078 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23230a0-d9df-456f-8d23-b8929b964be5 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e545780b-9c40-46f1-a80b-62cb1f459491 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:54.978693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:54.980604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:54.982532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:54.982532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:54.982532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:54.982532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:54.982532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:54.982532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:54.982532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:54.982532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:54.982532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:54.982532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:54.982532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:54.982532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:54.992542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 196/407] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:49:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:54.992542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545780b-9c40-46f1-a80b-62cb1f459491 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:55.012769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 212/408] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Aug 7 00:49:54 2022] PUT /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a/groups/4769d31969304e22ad273f7b647004ae/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:49:55.014919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23230a0-d9df-456f-8d23-b8929b964be5 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:55.048915 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:55.115927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545780b-9c40-46f1-a80b-62cb1f459491 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:55.201901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346c0b4-ff8c-4ae6-9e29-594b3fe604e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:55.202715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346c0b4-ff8c-4ae6-9e29-594b3fe604e5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:55.203572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346c0b4-ff8c-4ae6-9e29-594b3fe604e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:55.203572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346c0b4-ff8c-4ae6-9e29-594b3fe604e5 None admin] PATH_INFO: `/v3/groups/4769d31969304e22ad273f7b647004ae` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:55.204899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346c0b4-ff8c-4ae6-9e29-594b3fe604e5 None admin] RBAC: Authorizing `identity:get_group(group_id=4769d31969304e22ad273f7b647004ae)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:55.206409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346c0b4-ff8c-4ae6-9e29-594b3fe604e5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:55.208366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 197/409] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Aug 7 00:49:54 2022] GET /identity/v3/groups/4769d31969304e22ad273f7b647004ae => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:55.217214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346c0b4-ff8c-4ae6-9e29-594b3fe604e5 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:55.290897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23230a0-d9df-456f-8d23-b8929b964be5 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:55.353202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346c0b4-ff8c-4ae6-9e29-594b3fe604e5 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:55.369857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:55.378535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435c595-fe33-4a55-9755-dd2e2125fbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:55.379596 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435c595-fe33-4a55-9755-dd2e2125fbde None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:55.380211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435c595-fe33-4a55-9755-dd2e2125fbde None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:55.380698 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435c595-fe33-4a55-9755-dd2e2125fbde None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:55.382152 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435c595-fe33-4a55-9755-dd2e2125fbde None admin] RBAC: Adding query filter params (name=admin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:55.382830 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435c595-fe33-4a55-9755-dd2e2125fbde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:55.385748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435c595-fe33-4a55-9755-dd2e2125fbde None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:55.393906 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc3528-bb35-4da9-853a-906f30b07afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:55.394558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc3528-bb35-4da9-853a-906f30b07afb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:55.394835 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc3528-bb35-4da9-853a-906f30b07afb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:55.395108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc3528-bb35-4da9-853a-906f30b07afb None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:55.398448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc3528-bb35-4da9-853a-906f30b07afb None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:55.400603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc3528-bb35-4da9-853a-906f30b07afb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:55.401874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 213/410] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:55.403143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 198/411] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:55 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:55.418966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc3528-bb35-4da9-853a-906f30b07afb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:55.419388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435c595-fe33-4a55-9755-dd2e2125fbde None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:55.453312 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:55.544633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc3528-bb35-4da9-853a-906f30b07afb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:55.586980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c2ee9-205e-4c58-821b-e430d76cbd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:55.587635 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c2ee9-205e-4c58-821b-e430d76cbd15 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:55.587938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c2ee9-205e-4c58-821b-e430d76cbd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:55.588211 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c2ee9-205e-4c58-821b-e430d76cbd15 None admin] PATH_INFO: `/v3/groups/a49c8ae4d7af4e0fa1e535cdbee3c602` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:55.589578 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c2ee9-205e-4c58-821b-e430d76cbd15 None admin] RBAC: Authorizing `identity:get_group(group_id=a49c8ae4d7af4e0fa1e535cdbee3c602)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:55.591178 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c2ee9-205e-4c58-821b-e430d76cbd15 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:55.593368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 199/412] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Aug 7 00:49:55 2022] GET /identity/v3/groups/a49c8ae4d7af4e0fa1e535cdbee3c602 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:55.606611 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c2ee9-205e-4c58-821b-e430d76cbd15 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:55.749532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435c595-fe33-4a55-9755-dd2e2125fbde None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:55.756739 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:55.818481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c2ee9-205e-4c58-821b-e430d76cbd15 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:55.834350 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8390f-2f65-45a2-be0e-ef7199493387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:55.835498 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8390f-2f65-45a2-be0e-ef7199493387 None admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:55.836033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8390f-2f65-45a2-be0e-ef7199493387 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:55.836534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8390f-2f65-45a2-be0e-ef7199493387 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a/groups/4769d31969304e22ad273f7b647004ae/roles/b94b02b271d44f1195f1093a6202a947` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:55.840825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8390f-2f65-45a2-be0e-ef7199493387 None admin] RBAC: Authorizing `identity:create_grant(project_id=59fff2f6945340d0895b4123f3f1cc4a, group_id=4769d31969304e22ad273f7b647004ae, role_id=b94b02b271d44f1195f1093a6202a947)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:55.842484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8390f-2f65-45a2-be0e-ef7199493387 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:55.855930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bee208-fbb6-4e7d-b7e3-f81e6b9ad42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:55.856682 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bee208-fbb6-4e7d-b7e3-f81e6b9ad42b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:55.857045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bee208-fbb6-4e7d-b7e3-f81e6b9ad42b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:55.857321 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bee208-fbb6-4e7d-b7e3-f81e6b9ad42b None admin] PATH_INFO: `/v3/projects/348c3b03b0964532b13e1c51a4b097f3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:55.858706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bee208-fbb6-4e7d-b7e3-f81e6b9ad42b None admin] RBAC: Authorizing `identity:get_project(project_id=348c3b03b0964532b13e1c51a4b097f3)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:55.860452 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bee208-fbb6-4e7d-b7e3-f81e6b9ad42b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:55.862620 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 200/413] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:55 2022] GET /identity/v3/projects/348c3b03b0964532b13e1c51a4b097f3 => generated 344 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:55.863934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2afb2a-88fb-409b-81d3-5123b36554a7 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:55.864345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2afb2a-88fb-409b-81d3-5123b36554a7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:55.864687 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2afb2a-88fb-409b-81d3-5123b36554a7 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:55.866466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 201/414] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:55.871744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892687f-329c-4d82-8618-f62a8c541a41 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:55.872347 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892687f-329c-4d82-8618-f62a8c541a41 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:55.872824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892687f-329c-4d82-8618-f62a8c541a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:55.873438 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 214/415] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Aug 7 00:49:55 2022] PUT /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a/groups/4769d31969304e22ad273f7b647004ae/roles/b94b02b271d44f1195f1093a6202a947 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:49:55.880548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8390f-2f65-45a2-be0e-ef7199493387 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:55.898214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-8892687f-329c-4d82-8618-f62a8c541a41 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:55.899828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8892687f-329c-4d82-8618-f62a8c541a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:55.994875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 202/416] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:49:56.001451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:56.033898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892687f-329c-4d82-8618-f62a8c541a41 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:56.037637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8390f-2f65-45a2-be0e-ef7199493387 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:56.081741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ed85f-d350-4ccb-aba1-e845cdf787a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:56.082466 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ed85f-d350-4ccb-aba1-e845cdf787a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:56.083399 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ed85f-d350-4ccb-aba1-e845cdf787a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:56.083685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ed85f-d350-4ccb-aba1-e845cdf787a2 None admin] PATH_INFO: `/v3/projects/348c3b03b0964532b13e1c51a4b097f3/groups/a49c8ae4d7af4e0fa1e535cdbee3c602/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:56.089666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ed85f-d350-4ccb-aba1-e845cdf787a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=348c3b03b0964532b13e1c51a4b097f3, group_id=a49c8ae4d7af4e0fa1e535cdbee3c602, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:56.091573 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ed85f-d350-4ccb-aba1-e845cdf787a2 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:56.110281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 215/417] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Aug 7 00:49:55 2022] PUT /identity/v3/projects/348c3b03b0964532b13e1c51a4b097f3/groups/a49c8ae4d7af4e0fa1e535cdbee3c602/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:49:56.149246 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:56.223736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892687f-329c-4d82-8618-f62a8c541a41 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:56.268919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db1912-a3ba-42bd-8e71-df65d2e1d8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:56.269557 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db1912-a3ba-42bd-8e71-df65d2e1d8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:56.269841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db1912-a3ba-42bd-8e71-df65d2e1d8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:56.270116 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db1912-a3ba-42bd-8e71-df65d2e1d8f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:56.283419 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db1912-a3ba-42bd-8e71-df65d2e1d8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-54db1912-a3ba-42bd-8e71-df65d2e1d8f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:56.288781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:56.289741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:56.290559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:56.290559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:56.290559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:56.290559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:56.290559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:56.290559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:56.290559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:56.290559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:56.290559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:56.290559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:56.290559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:56.290559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:56.290559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 203/418] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:56.297896 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ed85f-d350-4ccb-aba1-e845cdf787a2 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:56.453614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ed85f-d350-4ccb-aba1-e845cdf787a2 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:56.501028 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6cd48-488e-4cf6-9055-aae710a5edaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:56.502038 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6cd48-488e-4cf6-9055-aae710a5edaf None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:56.502522 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6cd48-488e-4cf6-9055-aae710a5edaf None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:56.502992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6cd48-488e-4cf6-9055-aae710a5edaf None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:56.503924 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6cd48-488e-4cf6-9055-aae710a5edaf None admin] RBAC: Adding query filter params (name=member) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:56.504435 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6cd48-488e-4cf6-9055-aae710a5edaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:56.506843 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6cd48-488e-4cf6-9055-aae710a5edaf None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:56.511932 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:56.521979 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 216/419] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:56.527974 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db1912-a3ba-42bd-8e71-df65d2e1d8f2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:56.675892 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db1912-a3ba-42bd-8e71-df65d2e1d8f2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:56.685775 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:56.730136 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d265e3-c536-4fc2-859b-3221410e12b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:56.730815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d265e3-c536-4fc2-859b-3221410e12b0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:56.731100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d265e3-c536-4fc2-859b-3221410e12b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:56.731373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d265e3-c536-4fc2-859b-3221410e12b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:56.805565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daac67f-5841-453c-90a8-713a0802785f None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:56.806177 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daac67f-5841-453c-90a8-713a0802785f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:56.806649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daac67f-5841-453c-90a8-713a0802785f None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:56.808592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 217/420] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:56.817103 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29061ad-4383-4e9a-92e8-2d1fa4e03138 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:56.817572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29061ad-4383-4e9a-92e8-2d1fa4e03138 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:56.818065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29061ad-4383-4e9a-92e8-2d1fa4e03138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:56.830907 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d265e3-c536-4fc2-859b-3221410e12b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:56.834039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d265e3-c536-4fc2-859b-3221410e12b0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:56.856836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e29061ad-4383-4e9a-92e8-2d1fa4e03138 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:56.858099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e29061ad-4383-4e9a-92e8-2d1fa4e03138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:56.977031 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 204/421] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:56.984524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d265e3-c536-4fc2-859b-3221410e12b0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:56.993145 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:57.010691 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 218/422] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:57.088073 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29061ad-4383-4e9a-92e8-2d1fa4e03138 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:57.133446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d265e3-c536-4fc2-859b-3221410e12b0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:57.191467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d65b9-2dee-4b96-9883-6babf3d62491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:57.192688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d65b9-2dee-4b96-9883-6babf3d62491 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:57.193176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d65b9-2dee-4b96-9883-6babf3d62491 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:57.193658 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d65b9-2dee-4b96-9883-6babf3d62491 None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:57.199622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d65b9-2dee-4b96-9883-6babf3d62491 None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:57.205902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d65b9-2dee-4b96-9883-6babf3d62491 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:57.211150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 205/423] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:56 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:57.231007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d65b9-2dee-4b96-9883-6babf3d62491 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:57.397488 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29061ad-4383-4e9a-92e8-2d1fa4e03138 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:57.436317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:57.445668 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:57.456272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ad425-bd85-475b-ad24-80f02eff4e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:57.456943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ad425-bd85-475b-ad24-80f02eff4e2b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:57.457223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ad425-bd85-475b-ad24-80f02eff4e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:57.457488 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ad425-bd85-475b-ad24-80f02eff4e2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:57.481218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ad425-bd85-475b-ad24-80f02eff4e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-eb0ad425-bd85-475b-ad24-80f02eff4e2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:57.495717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:57.497568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:57.500916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:57.500916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:57.500916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:57.500916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:57.500916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:57.500916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:57.500916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:57.500916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:57.500916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:57.500916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:57.500916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:57.500916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:57.503342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d65b9-2dee-4b96-9883-6babf3d62491 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:57.503581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 219/424] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:49:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:49:57.514934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ad425-bd85-475b-ad24-80f02eff4e2b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:57.566838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c85539-ea92-4f31-b4cf-531aa74f9d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:57.569335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c85539-ea92-4f31-b4cf-531aa74f9d9a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:57.569829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c85539-ea92-4f31-b4cf-531aa74f9d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:57.570304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c85539-ea92-4f31-b4cf-531aa74f9d9a None admin] PATH_INFO: `/v3/groups/4769d31969304e22ad273f7b647004ae` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:57.574113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c85539-ea92-4f31-b4cf-531aa74f9d9a None admin] RBAC: Authorizing `identity:get_group(group_id=4769d31969304e22ad273f7b647004ae)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:57.576910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c85539-ea92-4f31-b4cf-531aa74f9d9a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:57.580218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 206/425] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Aug 7 00:49:57 2022] GET /identity/v3/groups/4769d31969304e22ad273f7b647004ae => generated 226 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:57.594627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c85539-ea92-4f31-b4cf-531aa74f9d9a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:57.794917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ad425-bd85-475b-ad24-80f02eff4e2b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:57.837271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915098c-e43a-42ee-846a-14893968447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:57.838268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915098c-e43a-42ee-846a-14893968447a None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:57.838790 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915098c-e43a-42ee-846a-14893968447a None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:57.839277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915098c-e43a-42ee-846a-14893968447a None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:57.840196 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915098c-e43a-42ee-846a-14893968447a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:57.840702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915098c-e43a-42ee-846a-14893968447a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:57.842336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915098c-e43a-42ee-846a-14893968447a None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:57.853759 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 220/426] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:49:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:57.859678 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915098c-e43a-42ee-846a-14893968447a None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:57.865206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c85539-ea92-4f31-b4cf-531aa74f9d9a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:57.910326 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff72028-94b3-427e-afce-908bab8a4a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:57.910860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff72028-94b3-427e-afce-908bab8a4a88 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:57.911147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff72028-94b3-427e-afce-908bab8a4a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:57.911400 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff72028-94b3-427e-afce-908bab8a4a88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:57.912185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff72028-94b3-427e-afce-908bab8a4a88 None admin] RBAC: Adding query filter params (group.id=4769d31969304e22ad273f7b647004ae, role.id=93e4ae64906f4b0ea861a4ac4571f1d7, scope.project.id=06d4e914e37a47ff940142feccfa5200) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:57.912588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff72028-94b3-427e-afce-908bab8a4a88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:57.913938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff72028-94b3-427e-afce-908bab8a4a88 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:57.934559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 207/427] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Aug 7 00:49:57 2022] GET /identity/v3/role_assignments?group.id=4769d31969304e22ad273f7b647004ae&scope.project.id=06d4e914e37a47ff940142feccfa5200&role.id=93e4ae64906f4b0ea861a4ac4571f1d7 => generated 611 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:49:57.975945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:58.040492 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915098c-e43a-42ee-846a-14893968447a None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:58.084036 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8c42f-a9c5-4a50-bbfe-84a35760bfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:58.085111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8c42f-a9c5-4a50-bbfe-84a35760bfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:58.085616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8c42f-a9c5-4a50-bbfe-84a35760bfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:58.086090 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8c42f-a9c5-4a50-bbfe-84a35760bfa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:58.184222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8c42f-a9c5-4a50-bbfe-84a35760bfa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:58.186109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8c42f-a9c5-4a50-bbfe-84a35760bfa6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:58.251956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:58.345290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 221/428] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:58.351529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff72028-94b3-427e-afce-908bab8a4a88 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:58.364518 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:58.409104 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9768fb-4c8e-47ca-9af2-9f0eba7ef829 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:58.409421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9768fb-4c8e-47ca-9af2-9f0eba7ef829 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:58.409856 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9768fb-4c8e-47ca-9af2-9f0eba7ef829 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:58.411880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 222/429] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:49:58.419711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100dd35-c0c0-4134-8188-54e10c1b26f5 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:58.420244 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100dd35-c0c0-4134-8188-54e10c1b26f5 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:58.420732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100dd35-c0c0-4134-8188-54e10c1b26f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:58.456970 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-f100dd35-c0c0-4134-8188-54e10c1b26f5 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:58.459506 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f100dd35-c0c0-4134-8188-54e10c1b26f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:58.493815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff72028-94b3-427e-afce-908bab8a4a88 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:58.539009 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08510049-2e31-4a0a-bbda-f42d7d308cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:58.539659 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08510049-2e31-4a0a-bbda-f42d7d308cbb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:58.539999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08510049-2e31-4a0a-bbda-f42d7d308cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:58.540284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08510049-2e31-4a0a-bbda-f42d7d308cbb None admin] PATH_INFO: `/v3/projects/06d4e914e37a47ff940142feccfa5200` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:58.541491 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08510049-2e31-4a0a-bbda-f42d7d308cbb None admin] RBAC: Authorizing `identity:get_project(project_id=06d4e914e37a47ff940142feccfa5200)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:58.542943 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08510049-2e31-4a0a-bbda-f42d7d308cbb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:58.544986 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 208/430] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:58 2022] GET /identity/v3/projects/06d4e914e37a47ff940142feccfa5200 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:58.550835 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08510049-2e31-4a0a-bbda-f42d7d308cbb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:58.592397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 223/431] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:49:58.623971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100dd35-c0c0-4134-8188-54e10c1b26f5 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:58.699970 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:58.732160 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08510049-2e31-4a0a-bbda-f42d7d308cbb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:58.791438 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:58.815089 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b29f1-03d1-4f6c-b6ef-07841680ba5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:58.815967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b29f1-03d1-4f6c-b6ef-07841680ba5f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:58.816125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b29f1-03d1-4f6c-b6ef-07841680ba5f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:58.816374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b29f1-03d1-4f6c-b6ef-07841680ba5f None admin] PATH_INFO: `/v3/groups/4769d31969304e22ad273f7b647004ae` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:58.818521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b29f1-03d1-4f6c-b6ef-07841680ba5f None admin] RBAC: Authorizing `identity:get_group(group_id=4769d31969304e22ad273f7b647004ae)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:58.820277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b29f1-03d1-4f6c-b6ef-07841680ba5f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:58.822157 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 209/432] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Aug 7 00:49:58 2022] GET /identity/v3/groups/4769d31969304e22ad273f7b647004ae => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:58.823123 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e22d0c-6864-4b76-aafb-ad27491cf0de None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:58.823405 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e22d0c-6864-4b76-aafb-ad27491cf0de None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:58.823685 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e22d0c-6864-4b76-aafb-ad27491cf0de None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:58.828665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 210/433] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:58.831205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb3104-5b2d-4a0a-808f-e87f593b4c17 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:58.831496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb3104-5b2d-4a0a-808f-e87f593b4c17 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:58.834301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb3104-5b2d-4a0a-808f-e87f593b4c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:58.848196 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100dd35-c0c0-4134-8188-54e10c1b26f5 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:58.856331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-caeb3104-5b2d-4a0a-808f-e87f593b4c17 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:58.857931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-caeb3104-5b2d-4a0a-808f-e87f593b4c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:58.909700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959b525-0c35-4908-a232-5b8206097d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:58.910273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959b525-0c35-4908-a232-5b8206097d3e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:58.910552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959b525-0c35-4908-a232-5b8206097d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:58.912103 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959b525-0c35-4908-a232-5b8206097d3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:58.932604 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959b525-0c35-4908-a232-5b8206097d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-d959b525-0c35-4908-a232-5b8206097d3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:58.937511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:58.940660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:58.946126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:58.946126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:58.946126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:58.946126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:58.946126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:58.946126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:58.946126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:58.946126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:58.946126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:58.946126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:58.946126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:49:58.946126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:49:58.946126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 224/434] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:49:58.946126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959b525-0c35-4908-a232-5b8206097d3e None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:58.976596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 211/435] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:58.978126 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1ecd6-c128-4fc8-868a-249a64b2d6f6 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:58.978616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1ecd6-c128-4fc8-868a-249a64b2d6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:58.978884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1ecd6-c128-4fc8-868a-249a64b2d6f6 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:58.980427 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 212/436] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:49:58.980905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1ecd6-c128-4fc8-868a-249a64b2d6f6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:59.079182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:59.085369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959b525-0c35-4908-a232-5b8206097d3e None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:59.113161 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1ecd6-c128-4fc8-868a-249a64b2d6f6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:59.123577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c9b97-ba8c-46d3-bf17-7dea514d3855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:59.124232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9b97-ba8c-46d3-bf17-7dea514d3855 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:59.124512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9b97-ba8c-46d3-bf17-7dea514d3855 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:59.124783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9b97-ba8c-46d3-bf17-7dea514d3855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:59.125525 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c9b97-ba8c-46d3-bf17-7dea514d3855 None admin] RBAC: Adding query filter params (group.id=4769d31969304e22ad273f7b647004ae, role.id=b94b02b271d44f1195f1093a6202a947, scope.project.id=06d4e914e37a47ff940142feccfa5200) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:59.126086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c9b97-ba8c-46d3-bf17-7dea514d3855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:59.127295 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c9b97-ba8c-46d3-bf17-7dea514d3855 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:59.136458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 225/437] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Aug 7 00:49:58 2022] GET /identity/v3/role_assignments?group.id=4769d31969304e22ad273f7b647004ae&scope.project.id=06d4e914e37a47ff940142feccfa5200&role.id=b94b02b271d44f1195f1093a6202a947 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:59.139077 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b582b4-12e6-44d5-9586-71a199dab5a3 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:59.139361 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b582b4-12e6-44d5-9586-71a199dab5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:59.139639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b582b4-12e6-44d5-9586-71a199dab5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:59.146777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:59.160234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed177d-1881-4bb1-a4d4-aca70c830dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:59.160980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed177d-1881-4bb1-a4d4-aca70c830dea None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:59.161282 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed177d-1881-4bb1-a4d4-aca70c830dea None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:59.161534 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed177d-1881-4bb1-a4d4-aca70c830dea None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:59.162230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed177d-1881-4bb1-a4d4-aca70c830dea None admin] RBAC: Adding query filter params (name=member) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:59.162530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed177d-1881-4bb1-a4d4-aca70c830dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:59.163997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed177d-1881-4bb1-a4d4-aca70c830dea None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:59.167750 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-25b582b4-12e6-44d5-9586-71a199dab5a3 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:49:59.169523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-25b582b4-12e6-44d5-9586-71a199dab5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:49:59.175140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 213/438] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:49:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:59.181396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed177d-1881-4bb1-a4d4-aca70c830dea None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:59.299602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 226/439] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:49:59.301629 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b582b4-12e6-44d5-9586-71a199dab5a3 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:59.324530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed177d-1881-4bb1-a4d4-aca70c830dea None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:59.371119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7148e-3d37-4c55-b725-8561db5260e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:59.372417 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7148e-3d37-4c55-b725-8561db5260e1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:59.372701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7148e-3d37-4c55-b725-8561db5260e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:59.372968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7148e-3d37-4c55-b725-8561db5260e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:59.376193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:59.389569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7148e-3d37-4c55-b725-8561db5260e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-8ef7148e-3d37-4c55-b725-8561db5260e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:59.394371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:59.395345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:59.396532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:59.396532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:59.396532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:59.396532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:59.396532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:59.396532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:59.396532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:59.396532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:59.396532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:59.396532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:59.396532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:49:59.396532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:59.396532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 214/440] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:49:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:59.397745 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7148e-3d37-4c55-b725-8561db5260e1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:59.458242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b582b4-12e6-44d5-9586-71a199dab5a3 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:59.507715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:59.516622 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96538d-9363-4895-86dd-a8ef199a65ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:59.517927 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96538d-9363-4895-86dd-a8ef199a65ff None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:59.518392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96538d-9363-4895-86dd-a8ef199a65ff None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:59.518688 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96538d-9363-4895-86dd-a8ef199a65ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:59.559297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7148e-3d37-4c55-b725-8561db5260e1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:59.608803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93063a7e-b962-44a0-b91b-ee722d3b45be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:59.609462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93063a7e-b962-44a0-b91b-ee722d3b45be None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:59.609740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93063a7e-b962-44a0-b91b-ee722d3b45be None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:59.610010 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93063a7e-b962-44a0-b91b-ee722d3b45be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:59.624153 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93063a7e-b962-44a0-b91b-ee722d3b45be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-93063a7e-b962-44a0-b91b-ee722d3b45be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:49:59.629656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:49:59.631265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:49:59.632125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:49:59.632125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:49:59.632125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:49:59.632125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:49:59.632125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:49:59.632125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:49:59.632125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:49:59.632125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:49:59.632125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:49:59.632125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:49:59.632125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:49:59.632125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:49:59.632125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 215/441] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:49:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:49:59.632125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93063a7e-b962-44a0-b91b-ee722d3b45be None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:59.632862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96538d-9363-4895-86dd-a8ef199a65ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:59.634580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96538d-9363-4895-86dd-a8ef199a65ff None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:59.705742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:59.757509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93063a7e-b962-44a0-b91b-ee722d3b45be None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:59.803794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 227/442] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:49:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:49:59.804827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e97ef-a211-478a-9475-dad44a22fbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:49:59.805012 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96538d-9363-4895-86dd-a8ef199a65ff None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:59.805720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e97ef-a211-478a-9475-dad44a22fbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:49:59.806170 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e97ef-a211-478a-9475-dad44a22fbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:49:59.806635 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e97ef-a211-478a-9475-dad44a22fbc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:49:59.807805 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e97ef-a211-478a-9475-dad44a22fbc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:49:59.808311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e97ef-a211-478a-9475-dad44a22fbc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:49:59.810281 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e97ef-a211-478a-9475-dad44a22fbc3 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:49:59.821739 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 216/443] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:49:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:49:59.822747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e97ef-a211-478a-9475-dad44a22fbc3 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:49:59.853257 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:49:59.965491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96538d-9363-4895-86dd-a8ef199a65ff None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:59.965742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e97ef-a211-478a-9475-dad44a22fbc3 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:49:59.985201 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:00.007768 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d10e4-7807-4f6b-9ba3-a0d983245cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:00.008362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d10e4-7807-4f6b-9ba3-a0d983245cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:00.008640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d10e4-7807-4f6b-9ba3-a0d983245cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:00.008909 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d10e4-7807-4f6b-9ba3-a0d983245cb4 None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:00.010073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d10e4-7807-4f6b-9ba3-a0d983245cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:00.011557 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d10e4-7807-4f6b-9ba3-a0d983245cb4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:00.013289 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 217/444] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:49:59 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:00.014081 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d10e4-7807-4f6b-9ba3-a0d983245cb4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:00.017999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bc7a0-d2f9-4260-8927-eee1c4ce02d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:00.018985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bc7a0-d2f9-4260-8927-eee1c4ce02d9 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:00.019457 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bc7a0-d2f9-4260-8927-eee1c4ce02d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:00.019919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bc7a0-d2f9-4260-8927-eee1c4ce02d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:00.021693 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896bc7a0-d2f9-4260-8927-eee1c4ce02d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:00.022116 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896bc7a0-d2f9-4260-8927-eee1c4ce02d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:00.024854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896bc7a0-d2f9-4260-8927-eee1c4ce02d9 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:00.035553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 228/445] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:49:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:00.036578 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bc7a0-d2f9-4260-8927-eee1c4ce02d9 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:00.135813 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d10e4-7807-4f6b-9ba3-a0d983245cb4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:00.178720 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:00.179572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247c791-d3e9-4d94-adc1-c9939bc1db52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:00.180609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247c791-d3e9-4d94-adc1-c9939bc1db52 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:00.180609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247c791-d3e9-4d94-adc1-c9939bc1db52 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:00.181185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247c791-d3e9-4d94-adc1-c9939bc1db52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:00.191174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bc7a0-d2f9-4260-8927-eee1c4ce02d9 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:00.239155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d0e23-1157-40d5-b89d-be4bc279c45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:00.239773 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d0e23-1157-40d5-b89d-be4bc279c45d None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:00.240034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d0e23-1157-40d5-b89d-be4bc279c45d None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:00.240306 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d0e23-1157-40d5-b89d-be4bc279c45d None admin] PATH_INFO: `/v3/groups/4769d31969304e22ad273f7b647004ae` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:00.241526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d0e23-1157-40d5-b89d-be4bc279c45d None admin] RBAC: Authorizing `identity:get_group(group_id=4769d31969304e22ad273f7b647004ae)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:00.242999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d0e23-1157-40d5-b89d-be4bc279c45d None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:00.243742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:00.244972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 229/446] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Aug 7 00:50:00 2022] GET /identity/v3/groups/4769d31969304e22ad273f7b647004ae => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:00.245458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d0e23-1157-40d5-b89d-be4bc279c45d None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:00.268311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247c791-d3e9-4d94-adc1-c9939bc1db52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:00.271207 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247c791-d3e9-4d94-adc1-c9939bc1db52 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:00.375923 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d0e23-1157-40d5-b89d-be4bc279c45d None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:00.411154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 218/447] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:50:00.412727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247c791-d3e9-4d94-adc1-c9939bc1db52 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:00.429684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2f81f-0047-44cc-a66e-f63885cbff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:00.430523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2f81f-0047-44cc-a66e-f63885cbff73 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:00.430938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2f81f-0047-44cc-a66e-f63885cbff73 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:00.431376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2f81f-0047-44cc-a66e-f63885cbff73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:00.467777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:00.518730 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2f81f-0047-44cc-a66e-f63885cbff73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:00.520483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2f81f-0047-44cc-a66e-f63885cbff73 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:00.539270 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:00.566140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247c791-d3e9-4d94-adc1-c9939bc1db52 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:00.606161 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9e769-6cec-4659-8ab2-c233ad1480b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:00.606776 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9e769-6cec-4659-8ab2-c233ad1480b7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:00.607052 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9e769-6cec-4659-8ab2-c233ad1480b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:00.607320 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9e769-6cec-4659-8ab2-c233ad1480b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:00.608082 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9e769-6cec-4659-8ab2-c233ad1480b7 None admin] RBAC: Adding query filter params (group.id=4769d31969304e22ad273f7b647004ae, role.id=93e4ae64906f4b0ea861a4ac4571f1d7, scope.project.id=59fff2f6945340d0895b4123f3f1cc4a) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:00.608386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9e769-6cec-4659-8ab2-c233ad1480b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:00.609839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9e769-6cec-4659-8ab2-c233ad1480b7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:00.617316 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 219/448] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Aug 7 00:50:00 2022] GET /identity/v3/role_assignments?group.id=4769d31969304e22ad273f7b647004ae&scope.project.id=59fff2f6945340d0895b4123f3f1cc4a&role.id=93e4ae64906f4b0ea861a4ac4571f1d7 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:00.618208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9e769-6cec-4659-8ab2-c233ad1480b7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:00.712261 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 230/449] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:50:00.720985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2f81f-0047-44cc-a66e-f63885cbff73 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:00.772914 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9e769-6cec-4659-8ab2-c233ad1480b7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:00.809047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:00.836381 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03eee8-e988-46e7-b494-beac4b91b3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:00.837496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03eee8-e988-46e7-b494-beac4b91b3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:00.838032 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03eee8-e988-46e7-b494-beac4b91b3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:00.839114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03eee8-e988-46e7-b494-beac4b91b3a3 None admin] PATH_INFO: `/v3/projects/348c3b03b0964532b13e1c51a4b097f3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:00.840142 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03eee8-e988-46e7-b494-beac4b91b3a3 None admin] RBAC: Authorizing `identity:get_project(project_id=348c3b03b0964532b13e1c51a4b097f3)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:00.842250 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03eee8-e988-46e7-b494-beac4b91b3a3 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:00.845055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 220/450] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:50:00 2022] GET /identity/v3/projects/348c3b03b0964532b13e1c51a4b097f3 => generated 344 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:00.852657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03eee8-e988-46e7-b494-beac4b91b3a3 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:00.882852 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2f81f-0047-44cc-a66e-f63885cbff73 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:00.884412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:00.948356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f92ae-9566-4fac-b533-af07bb5b6d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:00.949563 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f92ae-9566-4fac-b533-af07bb5b6d8f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:00.950188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f92ae-9566-4fac-b533-af07bb5b6d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:00.950636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f92ae-9566-4fac-b533-af07bb5b6d8f None admin] PATH_INFO: `/v3/projects/59fff2f6945340d0895b4123f3f1cc4a` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:00.952488 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f92ae-9566-4fac-b533-af07bb5b6d8f None admin] RBAC: Authorizing `identity:get_project(project_id=59fff2f6945340d0895b4123f3f1cc4a)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:00.954951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f92ae-9566-4fac-b533-af07bb5b6d8f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:00.957952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 231/451] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:50:00 2022] GET /identity/v3/projects/59fff2f6945340d0895b4123f3f1cc4a => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:00.966604 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f92ae-9566-4fac-b533-af07bb5b6d8f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:01.031169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03eee8-e988-46e7-b494-beac4b91b3a3 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:01.093266 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992951-e515-4dd2-879b-d0172032acfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:01.093806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992951-e515-4dd2-879b-d0172032acfd None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:01.094060 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992951-e515-4dd2-879b-d0172032acfd None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:01.094355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992951-e515-4dd2-879b-d0172032acfd None admin] PATH_INFO: `/v3/groups/a49c8ae4d7af4e0fa1e535cdbee3c602` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:01.096025 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7992951-e515-4dd2-879b-d0172032acfd None admin] RBAC: Authorizing `identity:get_group(group_id=a49c8ae4d7af4e0fa1e535cdbee3c602)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:01.097947 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7992951-e515-4dd2-879b-d0172032acfd None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:01.100512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 221/452] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Aug 7 00:50:00 2022] GET /identity/v3/groups/a49c8ae4d7af4e0fa1e535cdbee3c602 => generated 229 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:01.106727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992951-e515-4dd2-879b-d0172032acfd None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:01.148367 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f92ae-9566-4fac-b533-af07bb5b6d8f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:01.188951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:01.199516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c757021-6aca-47e9-8c28-036fcc2dae28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:01.200590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c757021-6aca-47e9-8c28-036fcc2dae28 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:01.201068 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c757021-6aca-47e9-8c28-036fcc2dae28 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:01.201528 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c757021-6aca-47e9-8c28-036fcc2dae28 None admin] PATH_INFO: `/v3/groups/4769d31969304e22ad273f7b647004ae` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:01.203422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c757021-6aca-47e9-8c28-036fcc2dae28 None admin] RBAC: Authorizing `identity:get_group(group_id=4769d31969304e22ad273f7b647004ae)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:01.206023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c757021-6aca-47e9-8c28-036fcc2dae28 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:01.214352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 232/453] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Aug 7 00:50:00 2022] GET /identity/v3/groups/4769d31969304e22ad273f7b647004ae => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:01.214570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:01.216101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c757021-6aca-47e9-8c28-036fcc2dae28 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:01.228052 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992951-e515-4dd2-879b-d0172032acfd None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:01.262527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3121b-cf02-4230-a0aa-6d56c709ac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:01.263134 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3121b-cf02-4230-a0aa-6d56c709ac4e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:01.263411 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3121b-cf02-4230-a0aa-6d56c709ac4e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:01.263680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3121b-cf02-4230-a0aa-6d56c709ac4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:01.264439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3121b-cf02-4230-a0aa-6d56c709ac4e None admin] RBAC: Adding query filter params (group.id=a49c8ae4d7af4e0fa1e535cdbee3c602, role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=348c3b03b0964532b13e1c51a4b097f3) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:01.264745 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3121b-cf02-4230-a0aa-6d56c709ac4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:01.266186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3121b-cf02-4230-a0aa-6d56c709ac4e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:01.272929 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 222/454] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Aug 7 00:50:01 2022] GET /identity/v3/role_assignments?group.id=a49c8ae4d7af4e0fa1e535cdbee3c602&scope.project.id=348c3b03b0964532b13e1c51a4b097f3&role.id=638e1fc82db44124ae615c46408110a7 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:01.393295 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c757021-6aca-47e9-8c28-036fcc2dae28 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:01.439754 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f72355-ed45-414a-9258-73cc08773f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:01.440902 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f72355-ed45-414a-9258-73cc08773f4d None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:01.441405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f72355-ed45-414a-9258-73cc08773f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:01.442485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f72355-ed45-414a-9258-73cc08773f4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:01.444178 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f72355-ed45-414a-9258-73cc08773f4d None admin] RBAC: Adding query filter params (group.id=4769d31969304e22ad273f7b647004ae, role.id=b94b02b271d44f1195f1093a6202a947, scope.project.id=59fff2f6945340d0895b4123f3f1cc4a) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:01.444750 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f72355-ed45-414a-9258-73cc08773f4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:01.447564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f72355-ed45-414a-9258-73cc08773f4d None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:01.460459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 233/455] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Aug 7 00:50:01 2022] GET /identity/v3/role_assignments?group.id=4769d31969304e22ad273f7b647004ae&scope.project.id=59fff2f6945340d0895b4123f3f1cc4a&role.id=b94b02b271d44f1195f1093a6202a947 => generated 611 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:04.299919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00510d-0389-4963-8114-9db7285da8c5 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:04.300560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00510d-0389-4963-8114-9db7285da8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:04.300560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00510d-0389-4963-8114-9db7285da8c5 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:04.302352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 223/456] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:04.308089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ee2aa-9c98-455b-bd28-5aff1b81a159 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:04.308629 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ee2aa-9c98-455b-bd28-5aff1b81a159 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:04.308629 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ee2aa-9c98-455b-bd28-5aff1b81a159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:04.334980 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-4d5ee2aa-9c98-455b-bd28-5aff1b81a159 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:04.336256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4d5ee2aa-9c98-455b-bd28-5aff1b81a159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:04.432029 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:04.448992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 234/457] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:04.499630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00510d-0389-4963-8114-9db7285da8c5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:04.556151 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbbfe6-9840-4f8f-9f50-ecf103f7587f None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:04.556336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbbfe6-9840-4f8f-9f50-ecf103f7587f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:04.556616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbbfe6-9840-4f8f-9f50-ecf103f7587f None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:04.557992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 235/458] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:04.566133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a684a-ea92-4ef4-857e-599577896cdb None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:04.566451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a684a-ea92-4ef4-857e-599577896cdb None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:04.566678 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a684a-ea92-4ef4-857e-599577896cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:04.598713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-0d9a684a-ea92-4ef4-857e-599577896cdb None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:04.599968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-0d9a684a-ea92-4ef4-857e-599577896cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:04.634618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00510d-0389-4963-8114-9db7285da8c5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:04.673703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7abeca-a5fd-410c-be72-7281a76be18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:04.674360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7abeca-a5fd-410c-be72-7281a76be18f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:04.674644 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7abeca-a5fd-410c-be72-7281a76be18f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:04.675014 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7abeca-a5fd-410c-be72-7281a76be18f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:04.687425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7abeca-a5fd-410c-be72-7281a76be18f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:04.690850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7abeca-a5fd-410c-be72-7281a76be18f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:04.700298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-ac7abeca-a5fd-410c-be72-7281a76be18f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:04.708864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:04.709905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:04.711253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:04.711253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:04.711253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:04.711253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 224/459] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:04.716395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7abeca-a5fd-410c-be72-7281a76be18f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:04.748775 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 236/460] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:04.750651 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8a9f6-ef73-43e4-912f-bebe135573a4 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:04.751157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8a9f6-ef73-43e4-912f-bebe135573a4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:04.751720 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8a9f6-ef73-43e4-912f-bebe135573a4 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:04.758379 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 237/461] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:04.760533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d11c2-adbb-4376-8273-0b8558be3e2e None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:04.761037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d11c2-adbb-4376-8273-0b8558be3e2e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:04.761528 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d11c2-adbb-4376-8273-0b8558be3e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:04.783055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-534d11c2-adbb-4376-8273-0b8558be3e2e None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:04.785010 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-534d11c2-adbb-4376-8273-0b8558be3e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:04.844307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7abeca-a5fd-410c-be72-7281a76be18f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:04.891927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c4372-90a5-4e5a-ab22-dfa1dabc7e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:04.891927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c4372-90a5-4e5a-ab22-dfa1dabc7e15 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:04.891927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c4372-90a5-4e5a-ab22-dfa1dabc7e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:04.891927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c4372-90a5-4e5a-ab22-dfa1dabc7e15 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:04.892338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c4372-90a5-4e5a-ab22-dfa1dabc7e15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:04.892338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c4372-90a5-4e5a-ab22-dfa1dabc7e15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:04.892338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c4372-90a5-4e5a-ab22-dfa1dabc7e15 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:04.892897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 238/462] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:50:04.894068 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d11c2-adbb-4376-8273-0b8558be3e2e None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:04.917314 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 225/463] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:04.922955 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c4372-90a5-4e5a-ab22-dfa1dabc7e15 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:04.975949 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:05.030749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:05.047738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d11c2-adbb-4376-8273-0b8558be3e2e None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:05.095888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c4372-90a5-4e5a-ab22-dfa1dabc7e15 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:05.096597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42b0bc-1287-4d51-b4be-a09cef943090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:05.097319 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42b0bc-1287-4d51-b4be-a09cef943090 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:05.097654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42b0bc-1287-4d51-b4be-a09cef943090 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:05.098528 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42b0bc-1287-4d51-b4be-a09cef943090 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:05.118174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42b0bc-1287-4d51-b4be-a09cef943090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:05.120098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42b0bc-1287-4d51-b4be-a09cef943090 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-dd42b0bc-1287-4d51-b4be-a09cef943090 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:05.142576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:05.143548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:05.145474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:05.145474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:05.145474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:05.145474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 239/464] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:05.145474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42b0bc-1287-4d51-b4be-a09cef943090 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:05.146556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa3418-c1e5-4d4d-b2a9-fd1b4fd09c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:05.147723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa3418-c1e5-4d4d-b2a9-fd1b4fd09c56 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:05.148263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa3418-c1e5-4d4d-b2a9-fd1b4fd09c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:05.148790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa3418-c1e5-4d4d-b2a9-fd1b4fd09c56 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:05.149681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa3418-c1e5-4d4d-b2a9-fd1b4fd09c56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:05.151498 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa3418-c1e5-4d4d-b2a9-fd1b4fd09c56 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:05.180810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 226/465] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:50:04 2022] POST /identity/v3/users => generated 248 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:50:05.182131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa3418-c1e5-4d4d-b2a9-fd1b4fd09c56 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:05.296062 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42b0bc-1287-4d51-b4be-a09cef943090 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:05.299868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:05.344887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13519e-7c81-4111-8fa0-6f2ef1a3f1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:05.346461 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13519e-7c81-4111-8fa0-6f2ef1a3f1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:05.346942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13519e-7c81-4111-8fa0-6f2ef1a3f1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:05.347424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13519e-7c81-4111-8fa0-6f2ef1a3f1a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:05.361907 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13519e-7c81-4111-8fa0-6f2ef1a3f1a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:05.364648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13519e-7c81-4111-8fa0-6f2ef1a3f1a7 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-ad13519e-7c81-4111-8fa0-6f2ef1a3f1a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:05.384630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:05.385624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:05.386457 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:05.386457 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:05.386457 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:05.388397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 240/466] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:05.405216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13519e-7c81-4111-8fa0-6f2ef1a3f1a7 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:05.459685 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa3418-c1e5-4d4d-b2a9-fd1b4fd09c56 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:05.503775 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:05.532439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f9ac4-fa94-4045-a30b-d7657bcd3162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:05.533502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f9ac4-fa94-4045-a30b-d7657bcd3162 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:05.533997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f9ac4-fa94-4045-a30b-d7657bcd3162 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:05.534575 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f9ac4-fa94-4045-a30b-d7657bcd3162 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:05.536447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f9ac4-fa94-4045-a30b-d7657bcd3162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:05.537004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f9ac4-fa94-4045-a30b-d7657bcd3162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:05.539894 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f9ac4-fa94-4045-a30b-d7657bcd3162 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:05.542057 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13519e-7c81-4111-8fa0-6f2ef1a3f1a7 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:05.561513 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 227/467] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:05.571035 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f9ac4-fa94-4045-a30b-d7657bcd3162 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:05.587183 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081686f9-5f32-4636-8a50-8ee6e466c227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:05.587839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081686f9-5f32-4636-8a50-8ee6e466c227 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:05.588182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081686f9-5f32-4636-8a50-8ee6e466c227 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:05.588896 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081686f9-5f32-4636-8a50-8ee6e466c227 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:05.589565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081686f9-5f32-4636-8a50-8ee6e466c227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:05.589869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081686f9-5f32-4636-8a50-8ee6e466c227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:05.591624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081686f9-5f32-4636-8a50-8ee6e466c227 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:05.607538 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 241/468] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:05.608918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c918a7-d2ed-4fcf-b3ee-ec6102d5b9d3 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:05.609199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c918a7-d2ed-4fcf-b3ee-ec6102d5b9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:05.609457 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c918a7-d2ed-4fcf-b3ee-ec6102d5b9d3 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:05.610918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 242/469] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:05.616183 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c918a7-d2ed-4fcf-b3ee-ec6102d5b9d3 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:05.648425 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:05.754873 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c918a7-d2ed-4fcf-b3ee-ec6102d5b9d3 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:05.785512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f9ac4-fa94-4045-a30b-d7657bcd3162 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:05.803630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c25be4-00c0-4985-a134-00bfaeb0de96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:05.805001 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c25be4-00c0-4985-a134-00bfaeb0de96 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:05.805589 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c25be4-00c0-4985-a134-00bfaeb0de96 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:05.806011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c25be4-00c0-4985-a134-00bfaeb0de96 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:05.807254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c25be4-00c0-4985-a134-00bfaeb0de96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:05.809375 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c25be4-00c0-4985-a134-00bfaeb0de96 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:05.834915 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9bb1a-70ab-4bd7-ae13-d74afcde1549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:05.835878 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9bb1a-70ab-4bd7-ae13-d74afcde1549 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:05.836410 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9bb1a-70ab-4bd7-ae13-d74afcde1549 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:05.836833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9bb1a-70ab-4bd7-ae13-d74afcde1549 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:05.837764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9bb1a-70ab-4bd7-ae13-d74afcde1549 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:05.839441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9bb1a-70ab-4bd7-ae13-d74afcde1549 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:05.848005 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 243/470] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:50:05 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:50:05.848005 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29da6b-a7a7-46ed-8189-7ea06d70ef4e None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:05.848005 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29da6b-a7a7-46ed-8189-7ea06d70ef4e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:05.848005 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29da6b-a7a7-46ed-8189-7ea06d70ef4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:05.866028 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-2c29da6b-a7a7-46ed-8189-7ea06d70ef4e None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:05.867392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2c29da6b-a7a7-46ed-8189-7ea06d70ef4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:05.891702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 228/471] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:50:05 2022] POST /identity/v3/users => generated 246 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:50:05.959062 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 244/472] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:06.000351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9bb1a-70ab-4bd7-ae13-d74afcde1549 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:06.053329 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:06.166727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9bb1a-70ab-4bd7-ae13-d74afcde1549 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:06.222190 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8663d-0cf1-44ec-9b15-7878ccd5bc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:06.223847 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8663d-0cf1-44ec-9b15-7878ccd5bc73 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:06.224190 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8663d-0cf1-44ec-9b15-7878ccd5bc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:06.224467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8663d-0cf1-44ec-9b15-7878ccd5bc73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:06.241076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8663d-0cf1-44ec-9b15-7878ccd5bc73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:06.242586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8663d-0cf1-44ec-9b15-7878ccd5bc73 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-5ae8663d-0cf1-44ec-9b15-7878ccd5bc73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:06.266315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:06.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:06.269781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:06.269781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:06.269781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:06.280061 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 229/473] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:06.282020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29da6b-a7a7-46ed-8189-7ea06d70ef4e None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:06.284598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:06.436989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29da6b-a7a7-46ed-8189-7ea06d70ef4e None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:06.545299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc30767-3e86-4487-897a-0762fcb39a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:06.546364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc30767-3e86-4487-897a-0762fcb39a32 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:06.546852 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc30767-3e86-4487-897a-0762fcb39a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:06.547326 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc30767-3e86-4487-897a-0762fcb39a32 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:06.548620 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc30767-3e86-4487-897a-0762fcb39a32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:06.549251 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc30767-3e86-4487-897a-0762fcb39a32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:06.552185 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc30767-3e86-4487-897a-0762fcb39a32 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:06.577998 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 245/474] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:06.588003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8663d-0cf1-44ec-9b15-7878ccd5bc73 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:06.599483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66fb6f-558b-4793-91cb-3d7f0512554e None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:06.600038 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66fb6f-558b-4793-91cb-3d7f0512554e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:06.600545 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66fb6f-558b-4793-91cb-3d7f0512554e None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:06.603579 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 246/475] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:50:06.609706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091af0a-dacd-4ac4-b00f-393234635b58 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:06.610143 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091af0a-dacd-4ac4-b00f-393234635b58 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:06.610580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091af0a-dacd-4ac4-b00f-393234635b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:06.663245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3091af0a-dacd-4ac4-b00f-393234635b58 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:06.665342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3091af0a-dacd-4ac4-b00f-393234635b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:06.856410 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:06.873137 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:06.882770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 247/476] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:50:06.910172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8663d-0cf1-44ec-9b15-7878ccd5bc73 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:06.923084 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091af0a-dacd-4ac4-b00f-393234635b58 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:06.989908 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f385390-77a3-4629-8cf6-063317f2da32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:06.991462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f385390-77a3-4629-8cf6-063317f2da32 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:06.992171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f385390-77a3-4629-8cf6-063317f2da32 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:06.992794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f385390-77a3-4629-8cf6-063317f2da32 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:06.994050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f385390-77a3-4629-8cf6-063317f2da32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:06.996935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f385390-77a3-4629-8cf6-063317f2da32 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:07.048601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 230/477] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:50:06 2022] POST /identity/v3/users => generated 249 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:50:07.157133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091af0a-dacd-4ac4-b00f-393234635b58 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:07.230892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88549f26-f0a9-4bbd-9e46-b1597c24f256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:07.232306 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88549f26-f0a9-4bbd-9e46-b1597c24f256 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:07.233066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88549f26-f0a9-4bbd-9e46-b1597c24f256 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:07.233777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88549f26-f0a9-4bbd-9e46-b1597c24f256 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:07.235235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88549f26-f0a9-4bbd-9e46-b1597c24f256 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:07.238083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88549f26-f0a9-4bbd-9e46-b1597c24f256 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:07.252849 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.sql.core [None req-88549f26-f0a9-4bbd-9e46-b1597c24f256 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 00:50:07.252849 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 00:50:07.252849 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [parameters: {'id': '5143e74b869d493891b478a2274e987e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 00:50:07.252849 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80516) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 00:50:07.285124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-88549f26-f0a9-4bbd-9e46-b1597c24f256 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 00:50:07.285124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:07.285124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:50:07.285124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:50:07.285124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:50:07.285124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:50:07.285124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:50:07.285124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:50:07.285124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:50:07.285124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:50:07.285124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:50:07.285124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:50:07.285124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:50:07.285124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application result.read() Aug 07 00:50:07.285124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return ref.to_dict() Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:50:07.287696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application yield resource Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise self.value Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application session.commit() Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 00:50:07.289956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self.session.flush() Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application compat.raise_( Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 00:50:07.292020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:50:07.294176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application result.read() Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:50:07.296064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [parameters: {'id': '5143e74b869d493891b478a2274e987e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:07.300916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 00:50:07.303835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:07.309801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 248/478] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Aug 7 00:50:06 2022] POST /identity/v3/roles => generated 144 bytes in 378 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:07.309983 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f385390-77a3-4629-8cf6-063317f2da32 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:07.525716 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f385390-77a3-4629-8cf6-063317f2da32 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:07.599497 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2a991-6d2d-4cbf-9e9a-77d1ee226554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:07.600650 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2a991-6d2d-4cbf-9e9a-77d1ee226554 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:07.601139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2a991-6d2d-4cbf-9e9a-77d1ee226554 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:07.601602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2a991-6d2d-4cbf-9e9a-77d1ee226554 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:07.627179 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2a991-6d2d-4cbf-9e9a-77d1ee226554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:07.637443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-a0c2a991-6d2d-4cbf-9e9a-77d1ee226554 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:07.643937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:07.644921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:07.645993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:07.645993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:07.645993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:07.645993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:07.645993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:07.645993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:07.645993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:07.645993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:07.645993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:07.645993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:07.645993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:50:07.645993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:07.651590 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 231/479] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:50:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:07.653707 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88549f26-f0a9-4bbd-9e46-b1597c24f256 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:07.772519 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:07.857775 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88549f26-f0a9-4bbd-9e46-b1597c24f256 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:07.922588 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63092ea7-ce7f-4bba-ba03-644860e3859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:07.923613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63092ea7-ce7f-4bba-ba03-644860e3859f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:07.924144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63092ea7-ce7f-4bba-ba03-644860e3859f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:07.924621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63092ea7-ce7f-4bba-ba03-644860e3859f None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:07.925890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63092ea7-ce7f-4bba-ba03-644860e3859f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:07.926419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63092ea7-ce7f-4bba-ba03-644860e3859f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:07.928851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63092ea7-ce7f-4bba-ba03-644860e3859f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:07.946262 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 249/480] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:08.259520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662e03a-e3cd-40c2-b20d-baa867f3d76b None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:08.260249 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662e03a-e3cd-40c2-b20d-baa867f3d76b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:08.260759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662e03a-e3cd-40c2-b20d-baa867f3d76b None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:08.262643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 232/481] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:08.281635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069c6f-9fb8-473b-8b15-195e8bef361c None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:08.282250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069c6f-9fb8-473b-8b15-195e8bef361c None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:08.282737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069c6f-9fb8-473b-8b15-195e8bef361c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:08.304830 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-96069c6f-9fb8-473b-8b15-195e8bef361c None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:08.306369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-96069c6f-9fb8-473b-8b15-195e8bef361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:08.404275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 250/482] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:08.448995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662e03a-e3cd-40c2-b20d-baa867f3d76b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:08.596767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662e03a-e3cd-40c2-b20d-baa867f3d76b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:08.656875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f6226-94be-4181-b668-513a0bc60aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:08.657548 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f6226-94be-4181-b668-513a0bc60aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:08.657831 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f6226-94be-4181-b668-513a0bc60aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:08.658113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f6226-94be-4181-b668-513a0bc60aa2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:08.679516 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f6226-94be-4181-b668-513a0bc60aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-5c4f6226-94be-4181-b668-513a0bc60aa2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:08.684486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:08.685488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:08.686303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:08.686303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:08.686303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:08.686303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:08.686303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:08.686303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:08.686303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:08.686303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:08.686303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:08.686303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:08.686303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:08.686303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:08.686303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 233/483] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:08.695934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96069c6f-9fb8-473b-8b15-195e8bef361c None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:08.823578 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:08.942616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96069c6f-9fb8-473b-8b15-195e8bef361c None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:09.015040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc0c88-3faa-4e90-b9de-838ac55cceca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:09.016137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc0c88-3faa-4e90-b9de-838ac55cceca None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:09.016642 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc0c88-3faa-4e90-b9de-838ac55cceca None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:09.017466 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc0c88-3faa-4e90-b9de-838ac55cceca None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:09.018939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc0c88-3faa-4e90-b9de-838ac55cceca None admin] RBAC: Adding query filter params (name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:09.020014 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc0c88-3faa-4e90-b9de-838ac55cceca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:09.022451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc0c88-3faa-4e90-b9de-838ac55cceca None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:09.034473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b46c1-081e-493e-a605-e9565c9618b2 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:09.038106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b46c1-081e-493e-a605-e9565c9618b2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:09.038957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b46c1-081e-493e-a605-e9565c9618b2 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:09.045769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 251/484] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:09.046476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 234/485] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:09.053718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b46c1-081e-493e-a605-e9565c9618b2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:09.056433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47a4e1-fabd-49f6-bb11-27a31366063f None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:09.057258 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47a4e1-fabd-49f6-bb11-27a31366063f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:09.058049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47a4e1-fabd-49f6-bb11-27a31366063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:09.114477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-ff47a4e1-fabd-49f6-bb11-27a31366063f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:09.117141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ff47a4e1-fabd-49f6-bb11-27a31366063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:09.184144 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:09.242634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 252/486] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:09.278834 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b46c1-081e-493e-a605-e9565c9618b2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:09.297128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47a4e1-fabd-49f6-bb11-27a31366063f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:09.351494 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7fd5c-110e-4a39-8f53-2366c4e387cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:09.353076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7fd5c-110e-4a39-8f53-2366c4e387cb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:09.353627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7fd5c-110e-4a39-8f53-2366c4e387cb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:09.354117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7fd5c-110e-4a39-8f53-2366c4e387cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:09.399887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:09.400305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7fd5c-110e-4a39-8f53-2366c4e387cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:09.401813 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7fd5c-110e-4a39-8f53-2366c4e387cb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-10f7fd5c-110e-4a39-8f53-2366c4e387cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:09.431621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:09.432646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:09.433503 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:09.433503 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:09.433503 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:09.444187 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 235/487] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:09.445761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df7095-f340-4f77-ac5a-6c8382a59fa0 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:09.446053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df7095-f340-4f77-ac5a-6c8382a59fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:09.446327 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df7095-f340-4f77-ac5a-6c8382a59fa0 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:09.448865 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 236/488] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:09.449662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df7095-f340-4f77-ac5a-6c8382a59fa0 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:09.536090 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47a4e1-fabd-49f6-bb11-27a31366063f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:09.621909 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ebdd8-6b81-464f-987d-a9949f0c19e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:09.624205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ebdd8-6b81-464f-987d-a9949f0c19e5 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:09.624980 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ebdd8-6b81-464f-987d-a9949f0c19e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:09.626324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ebdd8-6b81-464f-987d-a9949f0c19e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:09.664645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ebdd8-6b81-464f-987d-a9949f0c19e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:09.673511 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df7095-f340-4f77-ac5a-6c8382a59fa0 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-ed7ebdd8-6b81-464f-987d-a9949f0c19e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:09.677225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:09.678901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:09.680459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:09.680459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:09.680459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:09.680459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:09.680459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:09.680459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:09.680459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:09.680459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:09.680459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:09.680459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:09.680459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:09.680459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:09.685874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 253/489] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:09.703177 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ac796-2144-4779-81b2-5d2b68683756 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:09.704793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ac796-2144-4779-81b2-5d2b68683756 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:09.705473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ac796-2144-4779-81b2-5d2b68683756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:09.706480 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:09.747523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3f5ac796-2144-4779-81b2-5d2b68683756 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:09.749956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3f5ac796-2144-4779-81b2-5d2b68683756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:09.752895 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1ce45-0508-461a-bdd6-88bf440026ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:09.754185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1ce45-0508-461a-bdd6-88bf440026ec None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:09.754726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1ce45-0508-461a-bdd6-88bf440026ec None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:09.755345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1ce45-0508-461a-bdd6-88bf440026ec None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:09.757633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1ce45-0508-461a-bdd6-88bf440026ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:09.757633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1ce45-0508-461a-bdd6-88bf440026ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:09.760224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1ce45-0508-461a-bdd6-88bf440026ec None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:09.794219 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 237/490] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:09.794219 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1ce45-0508-461a-bdd6-88bf440026ec None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:09.917968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 254/491] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:09.920670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ac796-2144-4779-81b2-5d2b68683756 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:09.991621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1ce45-0508-461a-bdd6-88bf440026ec None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:09.997888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:10.061903 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292cce5-b6b5-4d3f-9f45-da603113dbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:10.063166 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292cce5-b6b5-4d3f-9f45-da603113dbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:10.063744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292cce5-b6b5-4d3f-9f45-da603113dbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:10.064399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292cce5-b6b5-4d3f-9f45-da603113dbc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:10.065696 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292cce5-b6b5-4d3f-9f45-da603113dbc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:10.066997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292cce5-b6b5-4d3f-9f45-da603113dbc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:10.069964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292cce5-b6b5-4d3f-9f45-da603113dbc1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:10.087578 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 238/492] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:10.089427 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292cce5-b6b5-4d3f-9f45-da603113dbc1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:10.158621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ac796-2144-4779-81b2-5d2b68683756 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:10.180386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:10.227383 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15027acc-2835-44c3-958c-be84f6f8d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:10.228751 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15027acc-2835-44c3-958c-be84f6f8d193 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:10.229390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15027acc-2835-44c3-958c-be84f6f8d193 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:10.230013 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15027acc-2835-44c3-958c-be84f6f8d193 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:10.246857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15027acc-2835-44c3-958c-be84f6f8d193 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:10.249871 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15027acc-2835-44c3-958c-be84f6f8d193 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-15027acc-2835-44c3-958c-be84f6f8d193 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:10.277176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:10.279243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:10.281548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:10.281548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:10.281548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:10.281548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:10.281548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:10.281548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:10.281548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:10.281548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:10.281548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:50:10.281548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:10.283948 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 255/493] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:50:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:10.286527 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15027acc-2835-44c3-958c-be84f6f8d193 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:10.336152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292cce5-b6b5-4d3f-9f45-da603113dbc1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:10.407249 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6defa41-1a1e-4912-bf24-73f654fe448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:10.408768 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6defa41-1a1e-4912-bf24-73f654fe448a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:10.409545 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6defa41-1a1e-4912-bf24-73f654fe448a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:10.410868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6defa41-1a1e-4912-bf24-73f654fe448a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:10.431462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6defa41-1a1e-4912-bf24-73f654fe448a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c6defa41-1a1e-4912-bf24-73f654fe448a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:10.444463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:10.446255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:10.447785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:10.447785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:10.447785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:10.447785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:10.447785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:10.447785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:10.447785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:10.447785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:10.447785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:10.447785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:10.447785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:10.447785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:10.447785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 239/494] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:10.449157 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6defa41-1a1e-4912-bf24-73f654fe448a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:10.461006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:10.473662 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15027acc-2835-44c3-958c-be84f6f8d193 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:10.524880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fefde7-e630-40f9-a825-82b28360df88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:10.525978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fefde7-e630-40f9-a825-82b28360df88 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:10.526475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fefde7-e630-40f9-a825-82b28360df88 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:10.526967 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fefde7-e630-40f9-a825-82b28360df88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:10.548764 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fefde7-e630-40f9-a825-82b28360df88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:10.552198 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fefde7-e630-40f9-a825-82b28360df88 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-31fefde7-e630-40f9-a825-82b28360df88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:10.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:10.580508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:10.581493 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:10.581493 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:10.581493 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:10.581821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 256/495] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:10.584656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e1748-8760-44b8-8a9f-074f37f91ba5 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:10.585148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e1748-8760-44b8-8a9f-074f37f91ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:10.585615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e1748-8760-44b8-8a9f-074f37f91ba5 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:10.588274 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 257/496] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:10.589592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e1748-8760-44b8-8a9f-074f37f91ba5 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:10.596932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:10.604857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6defa41-1a1e-4912-bf24-73f654fe448a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:10.656634 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05464e9-2911-463c-aa42-ff671ceafd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:10.657363 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05464e9-2911-463c-aa42-ff671ceafd84 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:10.657686 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05464e9-2911-463c-aa42-ff671ceafd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:10.658024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05464e9-2911-463c-aa42-ff671ceafd84 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:10.658845 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05464e9-2911-463c-aa42-ff671ceafd84 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:10.659214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05464e9-2911-463c-aa42-ff671ceafd84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:10.661344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05464e9-2911-463c-aa42-ff671ceafd84 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:10.703023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 240/497] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Aug 7 00:50:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:10.704157 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05464e9-2911-463c-aa42-ff671ceafd84 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:10.781830 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e1748-8760-44b8-8a9f-074f37f91ba5 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:10.835777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c247ff0-41d4-41d9-9d00-4a47a9aa18c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:10.836424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c247ff0-41d4-41d9-9d00-4a47a9aa18c7 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:10.836704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c247ff0-41d4-41d9-9d00-4a47a9aa18c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:10.836981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c247ff0-41d4-41d9-9d00-4a47a9aa18c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:10.837660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c247ff0-41d4-41d9-9d00-4a47a9aa18c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:10.837964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c247ff0-41d4-41d9-9d00-4a47a9aa18c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:10.839521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c247ff0-41d4-41d9-9d00-4a47a9aa18c7 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:10.848283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 258/498] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:10.850128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baec8cd-95fb-424a-b3a2-436030673db2 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:10.850128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baec8cd-95fb-424a-b3a2-436030673db2 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:10.850428 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baec8cd-95fb-424a-b3a2-436030673db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:10.860354 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:10.865064 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05464e9-2911-463c-aa42-ff671ceafd84 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:10.880931 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-8baec8cd-95fb-424a-b3a2-436030673db2 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:10.882946 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8baec8cd-95fb-424a-b3a2-436030673db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:10.906932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6fc0f-1cd0-4ba5-994c-c3e2a7e07d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:10.907557 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6fc0f-1cd0-4ba5-994c-c3e2a7e07d71 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:10.907844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6fc0f-1cd0-4ba5-994c-c3e2a7e07d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:10.908162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6fc0f-1cd0-4ba5-994c-c3e2a7e07d71 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:10.908817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6fc0f-1cd0-4ba5-994c-c3e2a7e07d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:10.909122 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6fc0f-1cd0-4ba5-994c-c3e2a7e07d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:10.910939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6fc0f-1cd0-4ba5-994c-c3e2a7e07d71 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:10.923061 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 241/499] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:10.923967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6fc0f-1cd0-4ba5-994c-c3e2a7e07d71 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:10.940578 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:10.977548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 259/500] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:10.978850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca6759-6599-4ecf-b01b-e97a1a2f8c71 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:10.979247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca6759-6599-4ecf-b01b-e97a1a2f8c71 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:10.980023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca6759-6599-4ecf-b01b-e97a1a2f8c71 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:10.980976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 260/501] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:10.981505 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca6759-6599-4ecf-b01b-e97a1a2f8c71 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:11.063890 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6fc0f-1cd0-4ba5-994c-c3e2a7e07d71 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:11.102271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796ebfe-30f0-4774-ad35-0716ff26d02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:11.102751 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796ebfe-30f0-4774-ad35-0716ff26d02f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:11.103032 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796ebfe-30f0-4774-ad35-0716ff26d02f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:11.103302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796ebfe-30f0-4774-ad35-0716ff26d02f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:11.110765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca6759-6599-4ecf-b01b-e97a1a2f8c71 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:11.148298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a49cc-f593-4129-aec1-b17c142116cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:11.148942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a49cc-f593-4129-aec1-b17c142116cb None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:11.149227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a49cc-f593-4129-aec1-b17c142116cb None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:11.149493 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a49cc-f593-4129-aec1-b17c142116cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:11.151637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:11.162262 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a49cc-f593-4129-aec1-b17c142116cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:11.164365 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a49cc-f593-4129-aec1-b17c142116cb None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-982a49cc-f593-4129-aec1-b17c142116cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:11.180721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:11.182080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:11.183591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:11.183591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:11.183591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:11.183591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 261/502] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:11.183591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a49cc-f593-4129-aec1-b17c142116cb None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:11.190387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796ebfe-30f0-4774-ad35-0716ff26d02f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:11.192056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796ebfe-30f0-4774-ad35-0716ff26d02f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:11.209556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:11.322799 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 242/503] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:50:11.324153 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163d1c7-7c79-401b-ae74-b3f47463b1f7 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:11.324444 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163d1c7-7c79-401b-ae74-b3f47463b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:11.324722 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163d1c7-7c79-401b-ae74-b3f47463b1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:11.336920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a49cc-f593-4129-aec1-b17c142116cb None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:11.344323 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0163d1c7-7c79-401b-ae74-b3f47463b1f7 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:11.345556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0163d1c7-7c79-401b-ae74-b3f47463b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:11.375726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe62e0c-eea0-4537-af85-cdaa2184812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:11.376310 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe62e0c-eea0-4537-af85-cdaa2184812f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:11.376593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe62e0c-eea0-4537-af85-cdaa2184812f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:11.376860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe62e0c-eea0-4537-af85-cdaa2184812f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:11.385705 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe62e0c-eea0-4537-af85-cdaa2184812f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:11.387320 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe62e0c-eea0-4537-af85-cdaa2184812f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-7fe62e0c-eea0-4537-af85-cdaa2184812f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:11.399575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:11.400623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:11.406200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:11.406200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:11.406200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:11.406200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:11.406200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:11.406200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:11.406200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:11.406200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:11.406200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:50:11.406200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:11.406200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 262/504] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:50:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:11.406200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe62e0c-eea0-4537-af85-cdaa2184812f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:11.449193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 243/505] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:11.449193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163d1c7-7c79-401b-ae74-b3f47463b1f7 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:11.462637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:11.513934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:11.534792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe62e0c-eea0-4537-af85-cdaa2184812f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:11.571117 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798621e-db07-4c5a-b563-8a329405e01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:11.571770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798621e-db07-4c5a-b563-8a329405e01b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:11.572097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798621e-db07-4c5a-b563-8a329405e01b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:11.572369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798621e-db07-4c5a-b563-8a329405e01b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:11.584560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798621e-db07-4c5a-b563-8a329405e01b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:11.584812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163d1c7-7c79-401b-ae74-b3f47463b1f7 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-7798621e-db07-4c5a-b563-8a329405e01b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:11.589745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:11.591080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:11.592648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:11.592648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:11.592648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:11.592648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:11.592648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:11.592648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:11.592648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:11.592648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:11.592648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:11.592648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:11.592648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:11.592648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:11.592648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 263/506] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:11.592648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798621e-db07-4c5a-b563-8a329405e01b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:11.626322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cb328-9108-4d99-b5e0-32ff3729a874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:11.626829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cb328-9108-4d99-b5e0-32ff3729a874 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:11.627244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cb328-9108-4d99-b5e0-32ff3729a874 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:11.627429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cb328-9108-4d99-b5e0-32ff3729a874 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:11.628048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cb328-9108-4d99-b5e0-32ff3729a874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:11.628348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cb328-9108-4d99-b5e0-32ff3729a874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:11.630366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cb328-9108-4d99-b5e0-32ff3729a874 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:11.642427 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 244/507] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:11.643284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cb328-9108-4d99-b5e0-32ff3729a874 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:11.720304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798621e-db07-4c5a-b563-8a329405e01b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:11.728622 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:11.757606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cb328-9108-4d99-b5e0-32ff3729a874 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:11.759370 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:11.764101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c9ac1-cea0-431d-b1c7-346d10061d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:11.764737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c9ac1-cea0-431d-b1c7-346d10061d93 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:11.765020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c9ac1-cea0-431d-b1c7-346d10061d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:11.765286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c9ac1-cea0-431d-b1c7-346d10061d93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:11.777372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c9ac1-cea0-431d-b1c7-346d10061d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:11.778891 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c9ac1-cea0-431d-b1c7-346d10061d93 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-de2c9ac1-cea0-431d-b1c7-346d10061d93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:11.794977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:11.803553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:11.804496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:11.804496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:11.804496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:11.804496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 264/508] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:11.804496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c9ac1-cea0-431d-b1c7-346d10061d93 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:11.808536 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac51110-1b82-49b7-92c7-d67e1925231b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:11.809536 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac51110-1b82-49b7-92c7-d67e1925231b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:11.810025 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac51110-1b82-49b7-92c7-d67e1925231b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:11.810487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac51110-1b82-49b7-92c7-d67e1925231b None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:11.811895 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac51110-1b82-49b7-92c7-d67e1925231b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:11.812424 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac51110-1b82-49b7-92c7-d67e1925231b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:11.815243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac51110-1b82-49b7-92c7-d67e1925231b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:11.848889 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 245/509] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Aug 7 00:50:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:11.850311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac51110-1b82-49b7-92c7-d67e1925231b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:11.947655 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c9ac1-cea0-431d-b1c7-346d10061d93 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:11.981267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac51110-1b82-49b7-92c7-d67e1925231b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:11.994048 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500cda-d4ad-44ab-bc7b-0c6101d9a99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:11.994692 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500cda-d4ad-44ab-bc7b-0c6101d9a99e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:11.994968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500cda-d4ad-44ab-bc7b-0c6101d9a99e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:11.995235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500cda-d4ad-44ab-bc7b-0c6101d9a99e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:12.009130 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d500cda-d4ad-44ab-bc7b-0c6101d9a99e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:12.010784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d500cda-d4ad-44ab-bc7b-0c6101d9a99e None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:12.019259 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7d4b2-d9fa-43cf-8068-6a9e70169790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:12.020031 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7d4b2-d9fa-43cf-8068-6a9e70169790 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:12.020322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7d4b2-d9fa-43cf-8068-6a9e70169790 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:12.020857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7d4b2-d9fa-43cf-8068-6a9e70169790 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:12.021551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7d4b2-d9fa-43cf-8068-6a9e70169790 None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:12.021951 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7d4b2-d9fa-43cf-8068-6a9e70169790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:12.023334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7d4b2-d9fa-43cf-8068-6a9e70169790 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-4d500cda-d4ad-44ab-bc7b-0c6101d9a99e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:12.030608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:12.031560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:12.033822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:12.033822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:12.033822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:12.033822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 265/510] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:12.033822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500cda-d4ad-44ab-bc7b-0c6101d9a99e None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:12.036291 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 246/511] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:12.037483 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7d4b2-d9fa-43cf-8068-6a9e70169790 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:12.053507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:12.067389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:12.159383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7d4b2-d9fa-43cf-8068-6a9e70169790 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:12.164359 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500cda-d4ad-44ab-bc7b-0c6101d9a99e None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:12.204513 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465785d6-0fc8-4a5d-88ce-38259e3bf129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:12.205033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465785d6-0fc8-4a5d-88ce-38259e3bf129 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:12.205316 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465785d6-0fc8-4a5d-88ce-38259e3bf129 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:12.205585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465785d6-0fc8-4a5d-88ce-38259e3bf129 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:12.206261 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465785d6-0fc8-4a5d-88ce-38259e3bf129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:12.206568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465785d6-0fc8-4a5d-88ce-38259e3bf129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:12.208117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465785d6-0fc8-4a5d-88ce-38259e3bf129 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:12.212537 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b807f0-9899-4181-afa6-cc4976d1de56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:12.213177 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b807f0-9899-4181-afa6-cc4976d1de56 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:12.213453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b807f0-9899-4181-afa6-cc4976d1de56 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:12.213723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b807f0-9899-4181-afa6-cc4976d1de56 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:12.221663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 247/512] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:12.223146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465785d6-0fc8-4a5d-88ce-38259e3bf129 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:12.227959 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b807f0-9899-4181-afa6-cc4976d1de56 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:12.230093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b807f0-9899-4181-afa6-cc4976d1de56 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-17b807f0-9899-4181-afa6-cc4976d1de56 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:12.251666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:12.253580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:12.255954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:12.255954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:12.255954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:12.255954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:12.255954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:12.255954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:12.255954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:12.255954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:12.255954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:50:12.255954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:12.255954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 266/513] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Aug 7 00:50:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:12.257338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b807f0-9899-4181-afa6-cc4976d1de56 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:12.341818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:12.344547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:12.363879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465785d6-0fc8-4a5d-88ce-38259e3bf129 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:12.383944 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b807f0-9899-4181-afa6-cc4976d1de56 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:12.406416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ed58-776f-45bf-b877-3af1547f2989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:12.407053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ed58-776f-45bf-b877-3af1547f2989 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:12.407310 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ed58-776f-45bf-b877-3af1547f2989 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:12.407581 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ed58-776f-45bf-b877-3af1547f2989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:12.421850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae6403-072f-4a88-a871-90f30490ba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:12.422489 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae6403-072f-4a88-a871-90f30490ba8e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:12.422759 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae6403-072f-4a88-a871-90f30490ba8e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:12.423032 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae6403-072f-4a88-a871-90f30490ba8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:12.435198 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae6403-072f-4a88-a871-90f30490ba8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:12.436712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae6403-072f-4a88-a871-90f30490ba8e None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-8eae6403-072f-4a88-a871-90f30490ba8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:12.451632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:12.453592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:12.454663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:12.454663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:12.454663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:12.454663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 267/514] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:12.454663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae6403-072f-4a88-a871-90f30490ba8e None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:12.489838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320ed58-776f-45bf-b877-3af1547f2989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:12.491301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320ed58-776f-45bf-b877-3af1547f2989 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:12.574406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae6403-072f-4a88-a871-90f30490ba8e None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:12.580447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:12.600898 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:12.602980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 248/515] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:50:12.604179 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ed58-776f-45bf-b877-3af1547f2989 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:12.618724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8c655-7c70-4eb3-ba9f-a68fc8dff3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:12.619333 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8c655-7c70-4eb3-ba9f-a68fc8dff3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:12.619608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8c655-7c70-4eb3-ba9f-a68fc8dff3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:12.619880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8c655-7c70-4eb3-ba9f-a68fc8dff3f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:12.620577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8c655-7c70-4eb3-ba9f-a68fc8dff3f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:12.620875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8c655-7c70-4eb3-ba9f-a68fc8dff3f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:12.622283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8c655-7c70-4eb3-ba9f-a68fc8dff3f1 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:12.635266 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 268/516] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:12.636138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8c655-7c70-4eb3-ba9f-a68fc8dff3f1 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:12.722310 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ed58-776f-45bf-b877-3af1547f2989 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:12.748686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8c655-7c70-4eb3-ba9f-a68fc8dff3f1 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:12.758042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d23c1d-4e9e-4f55-9818-3f9b894391b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:12.758844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d23c1d-4e9e-4f55-9818-3f9b894391b5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:12.758996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d23c1d-4e9e-4f55-9818-3f9b894391b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:12.759184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d23c1d-4e9e-4f55-9818-3f9b894391b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:12.765837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d23c1d-4e9e-4f55-9818-3f9b894391b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:12.767282 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d23c1d-4e9e-4f55-9818-3f9b894391b5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:12.780044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-d2d23c1d-4e9e-4f55-9818-3f9b894391b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:12.780044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:12.780044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:12.780044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:12.780044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:12.780044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:12.780044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:12.780044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:12.780044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:12.780044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:12.780044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:12.780044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:12.780044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:12.780044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:12.780044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:12.780958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:12.781824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:12.781824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:12.781824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:12.781824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:12.781824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:12.781824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:12.781824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:12.781824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:12.781824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 249/517] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:12.782788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d23c1d-4e9e-4f55-9818-3f9b894391b5 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:12.794209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b4a87-cc85-4976-8527-102c667846dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:12.794806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b4a87-cc85-4976-8527-102c667846dd None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:12.795084 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b4a87-cc85-4976-8527-102c667846dd None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:12.795662 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b4a87-cc85-4976-8527-102c667846dd None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:12.796143 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b4a87-cc85-4976-8527-102c667846dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:12.796442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b4a87-cc85-4976-8527-102c667846dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:12.797893 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b4a87-cc85-4976-8527-102c667846dd None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:12.830068 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:12.835455 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 269/518] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Aug 7 00:50:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:12.836550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b4a87-cc85-4976-8527-102c667846dd None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:12.880326 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:12.899139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d23c1d-4e9e-4f55-9818-3f9b894391b5 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:12.934688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ae744-fd22-4271-9225-608b3f45694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:12.935305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ae744-fd22-4271-9225-608b3f45694a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:12.935585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ae744-fd22-4271-9225-608b3f45694a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:12.935855 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ae744-fd22-4271-9225-608b3f45694a None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:12.936542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ae744-fd22-4271-9225-608b3f45694a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:12.936848 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ae744-fd22-4271-9225-608b3f45694a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:12.938234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ae744-fd22-4271-9225-608b3f45694a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:12.947966 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b4a87-cc85-4976-8527-102c667846dd None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:12.951206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 250/519] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:12.952080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ae744-fd22-4271-9225-608b3f45694a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:12.989371 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe289872-ad4b-490b-bde4-d21834987928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:12.989919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe289872-ad4b-490b-bde4-d21834987928 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:12.990185 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe289872-ad4b-490b-bde4-d21834987928 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:12.990452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe289872-ad4b-490b-bde4-d21834987928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:13.001105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe289872-ad4b-490b-bde4-d21834987928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:13.002603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe289872-ad4b-490b-bde4-d21834987928 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-fe289872-ad4b-490b-bde4-d21834987928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:13.018156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:13.021008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:13.022093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:13.022093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:13.022093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:13.022093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 270/520] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:13.022093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe289872-ad4b-490b-bde4-d21834987928 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:13.066732 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ae744-fd22-4271-9225-608b3f45694a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:13.068907 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:13.104798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d386bf7-4484-420d-8ce3-9cf9f628dc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:13.105690 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d386bf7-4484-420d-8ce3-9cf9f628dc46 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:13.106033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d386bf7-4484-420d-8ce3-9cf9f628dc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:13.106378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d386bf7-4484-420d-8ce3-9cf9f628dc46 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:13.107078 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d386bf7-4484-420d-8ce3-9cf9f628dc46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:13.109148 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d386bf7-4484-420d-8ce3-9cf9f628dc46 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:13.124820 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:13.133384 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 251/521] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:50:12 2022] POST /identity/v3/users => generated 247 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:50:13.134210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d386bf7-4484-420d-8ce3-9cf9f628dc46 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:13.137417 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe289872-ad4b-490b-bde4-d21834987928 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:13.189917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb6308-c158-4d15-9dfd-165a4fd19b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:13.190539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb6308-c158-4d15-9dfd-165a4fd19b6b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:13.190906 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb6308-c158-4d15-9dfd-165a4fd19b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:13.191718 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb6308-c158-4d15-9dfd-165a4fd19b6b None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:13.192594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb6308-c158-4d15-9dfd-165a4fd19b6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:13.192898 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb6308-c158-4d15-9dfd-165a4fd19b6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:13.194564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb6308-c158-4d15-9dfd-165a4fd19b6b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:13.224523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 271/522] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:13.224523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb6308-c158-4d15-9dfd-165a4fd19b6b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:13.290462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d386bf7-4484-420d-8ce3-9cf9f628dc46 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:13.342199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb6308-c158-4d15-9dfd-165a4fd19b6b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:13.356492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11794909-b9b3-4519-ae20-b443b6493da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:13.356893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11794909-b9b3-4519-ae20-b443b6493da3 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:13.357172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11794909-b9b3-4519-ae20-b443b6493da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:13.357445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11794909-b9b3-4519-ae20-b443b6493da3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:13.394269 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:13.399621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5b2fd-afa0-4419-aaa3-26e6b171a5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:13.400395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5b2fd-afa0-4419-aaa3-26e6b171a5c2 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:13.400745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5b2fd-afa0-4419-aaa3-26e6b171a5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:13.401105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5b2fd-afa0-4419-aaa3-26e6b171a5c2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:13.409482 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5b2fd-afa0-4419-aaa3-26e6b171a5c2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:13.411169 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5b2fd-afa0-4419-aaa3-26e6b171a5c2 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-21d5b2fd-afa0-4419-aaa3-26e6b171a5c2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:13.425066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:13.426796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:13.428256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:13.428256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:13.428256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:13.428256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:13.428256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:13.428256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:13.428256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:13.428256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:13.428256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:50:13.428256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:13.428818 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 272/523] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:13.433646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5b2fd-afa0-4419-aaa3-26e6b171a5c2 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:13.448588 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:13.451622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11794909-b9b3-4519-ae20-b443b6493da3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:13.453346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11794909-b9b3-4519-ae20-b443b6493da3 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:13.569524 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5b2fd-afa0-4419-aaa3-26e6b171a5c2 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:13.571935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 252/524] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:50:13.575231 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11794909-b9b3-4519-ae20-b443b6493da3 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:13.616394 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67904e17-5602-4e7f-b3a7-1357d9b805a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:13.617026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67904e17-5602-4e7f-b3a7-1357d9b805a6 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:13.617305 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67904e17-5602-4e7f-b3a7-1357d9b805a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:13.617579 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67904e17-5602-4e7f-b3a7-1357d9b805a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:13.618234 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67904e17-5602-4e7f-b3a7-1357d9b805a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:13.618534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67904e17-5602-4e7f-b3a7-1357d9b805a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:13.619924 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67904e17-5602-4e7f-b3a7-1357d9b805a6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:13.639887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 273/525] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:13.639887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67904e17-5602-4e7f-b3a7-1357d9b805a6 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:13.649659 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:13.698798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11794909-b9b3-4519-ae20-b443b6493da3 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:13.743893 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:13.747481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84042b23-f504-410f-8246-18ea5b8cdd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:13.748492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84042b23-f504-410f-8246-18ea5b8cdd61 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:13.748952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84042b23-f504-410f-8246-18ea5b8cdd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:13.749415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84042b23-f504-410f-8246-18ea5b8cdd61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:13.750719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84042b23-f504-410f-8246-18ea5b8cdd61 None admin] RBAC: Adding query filter params (role.id=05605552a8ef41ce895f7d776aefd260, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=345c25e7dd2341bcb4c53d0a5aa36b9d) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:13.751221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84042b23-f504-410f-8246-18ea5b8cdd61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:13.754464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84042b23-f504-410f-8246-18ea5b8cdd61 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:13.771951 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 253/526] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:13 2022] GET /identity/v3/role_assignments?user.id=345c25e7dd2341bcb4c53d0a5aa36b9d&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=05605552a8ef41ce895f7d776aefd260 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:13.771951 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84042b23-f504-410f-8246-18ea5b8cdd61 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:13.790318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67904e17-5602-4e7f-b3a7-1357d9b805a6 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:13.857401 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f647a-074a-4ba9-9215-a7b8cb2bcedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:13.859170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f647a-074a-4ba9-9215-a7b8cb2bcedb None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:13.860007 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f647a-074a-4ba9-9215-a7b8cb2bcedb None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:13.860492 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f647a-074a-4ba9-9215-a7b8cb2bcedb None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:13.862304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f647a-074a-4ba9-9215-a7b8cb2bcedb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:13.863521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f647a-074a-4ba9-9215-a7b8cb2bcedb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:13.866484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f647a-074a-4ba9-9215-a7b8cb2bcedb None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:13.898356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 274/527] 10.222.0.20 () {56 vars in 1139 bytes} [Sun Aug 7 00:50:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:13.900271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f647a-074a-4ba9-9215-a7b8cb2bcedb None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:13.944722 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84042b23-f504-410f-8246-18ea5b8cdd61 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:13.977630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:14.008258 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e21bc1-0281-4491-a940-0c2b12ad438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:14.008934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e21bc1-0281-4491-a940-0c2b12ad438c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:14.009243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e21bc1-0281-4491-a940-0c2b12ad438c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:14.009498 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e21bc1-0281-4491-a940-0c2b12ad438c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:14.031857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e21bc1-0281-4491-a940-0c2b12ad438c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:14.035561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e21bc1-0281-4491-a940-0c2b12ad438c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:14.052278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f647a-074a-4ba9-9215-a7b8cb2bcedb None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-49e21bc1-0281-4491-a940-0c2b12ad438c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:14.068570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:14.070330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:14.071961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:14.071961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:14.071961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:14.075974 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 254/528] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:14.076909 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e21bc1-0281-4491-a940-0c2b12ad438c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:14.105425 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:14.114668 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58789a-f04d-4c88-950f-122682d33159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:14.115230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58789a-f04d-4c88-950f-122682d33159 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:14.115513 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58789a-f04d-4c88-950f-122682d33159 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:14.115795 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58789a-f04d-4c88-950f-122682d33159 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:14.125610 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58789a-f04d-4c88-950f-122682d33159 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:14.127125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58789a-f04d-4c88-950f-122682d33159 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:14.146550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-cf58789a-f04d-4c88-950f-122682d33159 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:14.146550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:14.146550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:14.146550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:14.146550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:14.146550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:14.146550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:14.146550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:14.146550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:14.146550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:14.146550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:14.146550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:14.146550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:14.146550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:14.146550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:14.148111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:14.149634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:14.149634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:14.149634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:14.149634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:14.149634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:14.149634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:14.149634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:14.149634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:14.149634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 275/529] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:14.149634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58789a-f04d-4c88-950f-122682d33159 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:14.298171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e21bc1-0281-4491-a940-0c2b12ad438c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:14.303433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58789a-f04d-4c88-950f-122682d33159 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:14.339413 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941d829-4ef3-4c12-9048-d363dfa842d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:14.340115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941d829-4ef3-4c12-9048-d363dfa842d8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:14.340390 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941d829-4ef3-4c12-9048-d363dfa842d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:14.340709 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941d829-4ef3-4c12-9048-d363dfa842d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:14.343934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09598c-bbd5-417c-b7d4-35ebca892b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:14.344936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09598c-bbd5-417c-b7d4-35ebca892b12 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:14.345445 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09598c-bbd5-417c-b7d4-35ebca892b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:14.345918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09598c-bbd5-417c-b7d4-35ebca892b12 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:14.346777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09598c-bbd5-417c-b7d4-35ebca892b12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:14.347280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09598c-bbd5-417c-b7d4-35ebca892b12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:14.349939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09598c-bbd5-417c-b7d4-35ebca892b12 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:14.366222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 276/530] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:14.367397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09598c-bbd5-417c-b7d4-35ebca892b12 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:14.390571 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:14.419632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941d829-4ef3-4c12-9048-d363dfa842d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:14.421174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941d829-4ef3-4c12-9048-d363dfa842d8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:14.430318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:14.509648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09598c-bbd5-417c-b7d4-35ebca892b12 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:14.551715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 255/531] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:50:14.552917 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941d829-4ef3-4c12-9048-d363dfa842d8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:14.580747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb7d26-d77d-419b-89a1-d7d7d70a45f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:14.582408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb7d26-d77d-419b-89a1-d7d7d70a45f8 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:14.582684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb7d26-d77d-419b-89a1-d7d7d70a45f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:14.582959 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb7d26-d77d-419b-89a1-d7d7d70a45f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:14.583801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb7d26-d77d-419b-89a1-d7d7d70a45f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:14.584443 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb7d26-d77d-419b-89a1-d7d7d70a45f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:14.586792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb7d26-d77d-419b-89a1-d7d7d70a45f8 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:14.604180 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 277/532] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:14.605450 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb7d26-d77d-419b-89a1-d7d7d70a45f8 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:14.689323 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:14.736088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941d829-4ef3-4c12-9048-d363dfa842d8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:14.748896 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb7d26-d77d-419b-89a1-d7d7d70a45f8 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:14.784341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d768c49-c76a-4816-9308-d31ddc212960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:14.785558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d768c49-c76a-4816-9308-d31ddc212960 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:14.785846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d768c49-c76a-4816-9308-d31ddc212960 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:14.786124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d768c49-c76a-4816-9308-d31ddc212960 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:14.795262 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcacca-577d-4854-b891-393c18042a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:14.795496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d768c49-c76a-4816-9308-d31ddc212960 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:14.796638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcacca-577d-4854-b891-393c18042a35 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:14.796959 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d768c49-c76a-4816-9308-d31ddc212960 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:14.797550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcacca-577d-4854-b891-393c18042a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:14.797981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcacca-577d-4854-b891-393c18042a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:14.809766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcacca-577d-4854-b891-393c18042a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:14.811497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcacca-577d-4854-b891-393c18042a35 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:14.811812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-0d768c49-c76a-4816-9308-d31ddc212960 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:14.811812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:14.811812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:14.811812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:14.811812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:14.811812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:14.811812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:14.811812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:14.811812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:14.811812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:14.811812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:14.811812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:14.811812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:14.811812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:14.811812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:14.812868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:14.813920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:14.813920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:14.813920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:14.813920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:14.813920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:14.813920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:14.813920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:14.813920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:14.815495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 256/533] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:14.817051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d768c49-c76a-4816-9308-d31ddc212960 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:14.824393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-02fcacca-577d-4854-b891-393c18042a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:14.836664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:14.838275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:14.840214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:14.840214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:14.840214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:14.842319 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 278/534] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:14.843640 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcacca-577d-4854-b891-393c18042a35 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:14.946944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d768c49-c76a-4816-9308-d31ddc212960 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:14.992271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255b401-8246-4e5d-8446-57e4f00be8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:14.992986 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255b401-8246-4e5d-8446-57e4f00be8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:14.993337 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255b401-8246-4e5d-8446-57e4f00be8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:14.993703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255b401-8246-4e5d-8446-57e4f00be8e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:14.993818 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcacca-577d-4854-b891-393c18042a35 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:14.994545 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255b401-8246-4e5d-8446-57e4f00be8e8 None admin] RBAC: Adding query filter params (role.id=05605552a8ef41ce895f7d776aefd260, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=803d0ab121784d688b58374aaa6a8e7c) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:14.994916 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255b401-8246-4e5d-8446-57e4f00be8e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:14.997588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255b401-8246-4e5d-8446-57e4f00be8e8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:14.999718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:15.007391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 257/535] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:14 2022] GET /identity/v3/role_assignments?user.id=803d0ab121784d688b58374aaa6a8e7c&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=05605552a8ef41ce895f7d776aefd260 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:15.009133 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255b401-8246-4e5d-8446-57e4f00be8e8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:15.051524 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15af2bb-58a5-4929-9b0c-da461bfabc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:15.052639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15af2bb-58a5-4929-9b0c-da461bfabc71 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:15.053121 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15af2bb-58a5-4929-9b0c-da461bfabc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:15.053622 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15af2bb-58a5-4929-9b0c-da461bfabc71 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:15.054978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15af2bb-58a5-4929-9b0c-da461bfabc71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:15.055540 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15af2bb-58a5-4929-9b0c-da461bfabc71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:15.058199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15af2bb-58a5-4929-9b0c-da461bfabc71 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:15.083231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 279/536] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:15.093839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15af2bb-58a5-4929-9b0c-da461bfabc71 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:15.158678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255b401-8246-4e5d-8446-57e4f00be8e8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:15.164294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:15.223701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98253b77-b6da-4f85-82c9-6cc1acc72414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:15.224356 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98253b77-b6da-4f85-82c9-6cc1acc72414 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:15.224644 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98253b77-b6da-4f85-82c9-6cc1acc72414 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:15.224922 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98253b77-b6da-4f85-82c9-6cc1acc72414 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:15.225610 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98253b77-b6da-4f85-82c9-6cc1acc72414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:15.225917 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98253b77-b6da-4f85-82c9-6cc1acc72414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:15.227467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98253b77-b6da-4f85-82c9-6cc1acc72414 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:15.242977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 258/537] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:15.248236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98253b77-b6da-4f85-82c9-6cc1acc72414 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:15.335953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15af2bb-58a5-4929-9b0c-da461bfabc71 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:15.363506 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:15.384685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366d38e-069b-470d-809d-7f7fdc688837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:15.385307 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366d38e-069b-470d-809d-7f7fdc688837 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:15.385586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366d38e-069b-470d-809d-7f7fdc688837 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:15.385861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366d38e-069b-470d-809d-7f7fdc688837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:15.386612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366d38e-069b-470d-809d-7f7fdc688837 None admin] RBAC: Adding query filter params (role.id=05605552a8ef41ce895f7d776aefd260, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=20b8a995891f46f1ab1672836752cc4e) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:15.386919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366d38e-069b-470d-809d-7f7fdc688837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:15.388436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366d38e-069b-470d-809d-7f7fdc688837 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:15.407575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 280/538] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:15 2022] GET /identity/v3/role_assignments?user.id=20b8a995891f46f1ab1672836752cc4e&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=05605552a8ef41ce895f7d776aefd260 => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:15.438623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98253b77-b6da-4f85-82c9-6cc1acc72414 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:15.509002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867da88-077c-46cf-a500-1d88ff5061a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:15.509592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867da88-077c-46cf-a500-1d88ff5061a0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:15.509882 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867da88-077c-46cf-a500-1d88ff5061a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:15.510171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867da88-077c-46cf-a500-1d88ff5061a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:15.521804 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867da88-077c-46cf-a500-1d88ff5061a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:15.523414 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867da88-077c-46cf-a500-1d88ff5061a0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:15.542671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e867da88-077c-46cf-a500-1d88ff5061a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:15.542671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:15.542671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:15.542671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:15.542671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:15.542671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:15.542671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:15.542671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:15.542671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:15.542671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:15.542671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:15.542671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:15.542671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:15.542671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:15.542671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:15.544402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:15.546043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:15.546043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:15.546043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:15.546043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:15.546043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:15.546043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:15.546043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:15.546043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:15.546043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 259/539] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:15.551231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366d38e-069b-470d-809d-7f7fdc688837 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:15.700350 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:15.731807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366d38e-069b-470d-809d-7f7fdc688837 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:15.804633 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02615f82-bac0-4792-8faf-62628aa7d2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:15.805161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02615f82-bac0-4792-8faf-62628aa7d2bd None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:15.805434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02615f82-bac0-4792-8faf-62628aa7d2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:15.805707 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02615f82-bac0-4792-8faf-62628aa7d2bd None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:15.806518 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02615f82-bac0-4792-8faf-62628aa7d2bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:15.806832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02615f82-bac0-4792-8faf-62628aa7d2bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:15.808400 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02615f82-bac0-4792-8faf-62628aa7d2bd None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:15.819552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fef75-56d5-4d4d-8994-da9ca48e52f3 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:15.820315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fef75-56d5-4d4d-8994-da9ca48e52f3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:15.820315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fef75-56d5-4d4d-8994-da9ca48e52f3 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:15.825859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 281/540] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:15.826220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 260/541] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:15.832637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02615f82-bac0-4792-8faf-62628aa7d2bd None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:15.834054 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089926c-d39e-41f4-af08-0bb5bb3c5cae None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:15.834360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089926c-d39e-41f4-af08-0bb5bb3c5cae None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:15.834614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089926c-d39e-41f4-af08-0bb5bb3c5cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:15.879124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6089926c-d39e-41f4-af08-0bb5bb3c5cae None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:15.881820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6089926c-d39e-41f4-af08-0bb5bb3c5cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:16.032268 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 261/542] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:16.044857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02615f82-bac0-4792-8faf-62628aa7d2bd None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:16.073125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089926c-d39e-41f4-af08-0bb5bb3c5cae None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:16.109512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34506f-104c-46a6-ac2c-78ab714ddc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:16.110146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34506f-104c-46a6-ac2c-78ab714ddc14 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:16.110418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34506f-104c-46a6-ac2c-78ab714ddc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:16.110758 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34506f-104c-46a6-ac2c-78ab714ddc14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:16.111515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34506f-104c-46a6-ac2c-78ab714ddc14 None admin] RBAC: Adding query filter params (role.id=05605552a8ef41ce895f7d776aefd260, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=e393d9c50bbb4f69a48ae635d13b1197) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:16.111825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34506f-104c-46a6-ac2c-78ab714ddc14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:16.115607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34506f-104c-46a6-ac2c-78ab714ddc14 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:16.133041 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 282/543] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:15 2022] GET /identity/v3/role_assignments?user.id=e393d9c50bbb4f69a48ae635d13b1197&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=05605552a8ef41ce895f7d776aefd260 => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:16.149157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bc4f7-a989-4254-a712-1c1a3691965f None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:16.149579 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bc4f7-a989-4254-a712-1c1a3691965f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:16.149732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bc4f7-a989-4254-a712-1c1a3691965f None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:16.152455 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 283/544] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:50:16.157135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf1f9b-4f5a-4d28-ada4-0ead782f698d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:16.157517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf1f9b-4f5a-4d28-ada4-0ead782f698d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:16.157663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf1f9b-4f5a-4d28-ada4-0ead782f698d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:16.176556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:16.177951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3ebf1f9b-4f5a-4d28-ada4-0ead782f698d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:16.178789 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3ebf1f9b-4f5a-4d28-ada4-0ead782f698d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:16.184343 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:16.304023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089926c-d39e-41f4-af08-0bb5bb3c5cae None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:16.355065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 284/545] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:50:16.369180 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db6521-adc0-4d06-83c2-870311670405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:16.369831 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db6521-adc0-4d06-83c2-870311670405 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:16.370108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db6521-adc0-4d06-83c2-870311670405 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:16.370380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db6521-adc0-4d06-83c2-870311670405 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:16.382476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db6521-adc0-4d06-83c2-870311670405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-f5db6521-adc0-4d06-83c2-870311670405 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:16.388280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:16.389191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:16.389996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:16.389996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:16.389996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:16.389996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:16.389996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:16.389996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:16.389996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:16.389996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:16.389996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:16.389996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:16.389996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:16.389996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:16.389996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 262/546] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:16.397801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf1f9b-4f5a-4d28-ada4-0ead782f698d None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:16.410930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db6521-adc0-4d06-83c2-870311670405 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:16.624104 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf1f9b-4f5a-4d28-ada4-0ead782f698d None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:16.639032 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db6521-adc0-4d06-83c2-870311670405 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:16.656431 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:16.704389 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282e73a-af91-41ad-9d12-3441e99d097e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:16.705195 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282e73a-af91-41ad-9d12-3441e99d097e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:16.705481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282e73a-af91-41ad-9d12-3441e99d097e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:16.705756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282e73a-af91-41ad-9d12-3441e99d097e None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:16.706448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282e73a-af91-41ad-9d12-3441e99d097e None admin] RBAC: Adding query filter params (name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:16.706843 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282e73a-af91-41ad-9d12-3441e99d097e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:16.708278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282e73a-af91-41ad-9d12-3441e99d097e None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:16.715895 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4031b8-f7a7-400f-9926-3bf4e5f6a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:16.716591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4031b8-f7a7-400f-9926-3bf4e5f6a429 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:16.716873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4031b8-f7a7-400f-9926-3bf4e5f6a429 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:16.717147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4031b8-f7a7-400f-9926-3bf4e5f6a429 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:16.728103 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 285/547] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:16.733655 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282e73a-af91-41ad-9d12-3441e99d097e None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:16.734620 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4031b8-f7a7-400f-9926-3bf4e5f6a429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-4b4031b8-f7a7-400f-9926-3bf4e5f6a429 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:16.739678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:16.740630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:16.741591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:16.741591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:16.741591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:16.741591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:16.741591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:16.741591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:16.741591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:16.741591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:16.741591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:16.741591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:16.741591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:16.741591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:16.744988 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:16.745912 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 263/548] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:16.747992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4031b8-f7a7-400f-9926-3bf4e5f6a429 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:16.876609 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282e73a-af91-41ad-9d12-3441e99d097e None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:16.915326 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35701a-b1c0-410c-ab96-7f0674cd0d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:16.916152 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35701a-b1c0-410c-ab96-7f0674cd0d61 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:16.916695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35701a-b1c0-410c-ab96-7f0674cd0d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:16.916863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35701a-b1c0-410c-ab96-7f0674cd0d61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:16.929283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35701a-b1c0-410c-ab96-7f0674cd0d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:16.930919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35701a-b1c0-410c-ab96-7f0674cd0d61 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-cf35701a-b1c0-410c-ab96-7f0674cd0d61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:16.948533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:16.949736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:16.951110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:16.951110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:16.951110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:16.951110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 286/549] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:16.961174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35701a-b1c0-410c-ab96-7f0674cd0d61 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:17.001582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4031b8-f7a7-400f-9926-3bf4e5f6a429 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:17.078862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:17.081096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed23da-9aa6-42cd-b210-a6fbfc30fd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:17.082787 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed23da-9aa6-42cd-b210-a6fbfc30fd3b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:17.083394 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed23da-9aa6-42cd-b210-a6fbfc30fd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:17.083831 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed23da-9aa6-42cd-b210-a6fbfc30fd3b None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:17.085176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed23da-9aa6-42cd-b210-a6fbfc30fd3b None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:17.085584 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed23da-9aa6-42cd-b210-a6fbfc30fd3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:17.088184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed23da-9aa6-42cd-b210-a6fbfc30fd3b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:17.129295 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 264/550] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:17.135950 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed23da-9aa6-42cd-b210-a6fbfc30fd3b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:17.136247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35701a-b1c0-410c-ab96-7f0674cd0d61 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:17.177370 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c316f-a67a-4d05-91ab-59fc811b89d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:17.177989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c316f-a67a-4d05-91ab-59fc811b89d3 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:17.178269 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c316f-a67a-4d05-91ab-59fc811b89d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:17.178541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c316f-a67a-4d05-91ab-59fc811b89d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:17.187931 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c316f-a67a-4d05-91ab-59fc811b89d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:17.187931 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c316f-a67a-4d05-91ab-59fc811b89d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:17.187931 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c316f-a67a-4d05-91ab-59fc811b89d3 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:17.195374 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 287/551] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:17.213233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c316f-a67a-4d05-91ab-59fc811b89d3 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:17.260977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:17.414023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed23da-9aa6-42cd-b210-a6fbfc30fd3b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:17.453548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c316f-a67a-4d05-91ab-59fc811b89d3 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:17.491649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:17.498623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af531082-6904-4bb0-a388-f95ecebe94c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:17.499176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af531082-6904-4bb0-a388-f95ecebe94c0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:17.499456 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af531082-6904-4bb0-a388-f95ecebe94c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:17.502057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af531082-6904-4bb0-a388-f95ecebe94c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:17.527990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af531082-6904-4bb0-a388-f95ecebe94c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:17.529472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af531082-6904-4bb0-a388-f95ecebe94c0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:17.539642 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb033e-8ffb-4bd8-b0b5-ef15c8fd3e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:17.540515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb033e-8ffb-4bd8-b0b5-ef15c8fd3e5c None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:17.540658 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb033e-8ffb-4bd8-b0b5-ef15c8fd3e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:17.540898 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb033e-8ffb-4bd8-b0b5-ef15c8fd3e5c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:17.561246 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb033e-8ffb-4bd8-b0b5-ef15c8fd3e5c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:17.562737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb033e-8ffb-4bd8-b0b5-ef15c8fd3e5c None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-af531082-6904-4bb0-a388-f95ecebe94c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:17.564833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:17.565767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:17.567195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:17.567195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:17.567195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:17.572104 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 265/552] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:17.573662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af531082-6904-4bb0-a388-f95ecebe94c0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-c6eb033e-8ffb-4bd8-b0b5-ef15c8fd3e5c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:17.585723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:17.586712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:17.587727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:17.587727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:17.587727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:17.587727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:17.587727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:17.587727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:17.587727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:17.587727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:17.587727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:50:17.587727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:17.600737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 288/553] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:50:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:17.601707 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb033e-8ffb-4bd8-b0b5-ef15c8fd3e5c None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:17.779871 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:17.817604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af531082-6904-4bb0-a388-f95ecebe94c0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:17.850205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb033e-8ffb-4bd8-b0b5-ef15c8fd3e5c None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:17.958588 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db14c0a-7df6-4d87-a087-1fe5573783a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:17.960591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d1de4-f1e4-44d6-9f94-f2226d731904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:17.961474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14c0a-7df6-4d87-a087-1fe5573783a9 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:17.961834 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14c0a-7df6-4d87-a087-1fe5573783a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:17.962551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d1de4-f1e4-44d6-9f94-f2226d731904 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:17.962988 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14c0a-7df6-4d87-a087-1fe5573783a9 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:17.964181 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db14c0a-7df6-4d87-a087-1fe5573783a9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:17.964653 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d1de4-f1e4-44d6-9f94-f2226d731904 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:17.965021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d1de4-f1e4-44d6-9f94-f2226d731904 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:17.965807 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d1de4-f1e4-44d6-9f94-f2226d731904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:17.966206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db14c0a-7df6-4d87-a087-1fe5573783a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:17.967396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d1de4-f1e4-44d6-9f94-f2226d731904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:17.969321 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d1de4-f1e4-44d6-9f94-f2226d731904 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:17.970724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db14c0a-7df6-4d87-a087-1fe5573783a9 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:18.014355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 266/554] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:18.016181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459159f-e7b9-45e2-9bab-42e794e87950 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:18.016608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459159f-e7b9-45e2-9bab-42e794e87950 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:18.016952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459159f-e7b9-45e2-9bab-42e794e87950 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:18.026354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 267/555] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:18.027642 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459159f-e7b9-45e2-9bab-42e794e87950 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:18.030321 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 289/556] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Aug 7 00:50:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:18.036508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beccc4f-4602-4ec9-8720-3549d61f5512 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:18.036805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beccc4f-4602-4ec9-8720-3549d61f5512 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:18.037098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beccc4f-4602-4ec9-8720-3549d61f5512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:18.063446 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3beccc4f-4602-4ec9-8720-3549d61f5512 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:18.064741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3beccc4f-4602-4ec9-8720-3549d61f5512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:18.095043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:18.148890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 290/557] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:18.150249 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beccc4f-4602-4ec9-8720-3549d61f5512 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:18.186874 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459159f-e7b9-45e2-9bab-42e794e87950 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:18.243810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2942608-0db7-429f-b0d0-078bb10029a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:18.244606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2942608-0db7-429f-b0d0-078bb10029a5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:18.244941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2942608-0db7-429f-b0d0-078bb10029a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:18.245297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2942608-0db7-429f-b0d0-078bb10029a5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:18.254801 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2942608-0db7-429f-b0d0-078bb10029a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:18.256307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2942608-0db7-429f-b0d0-078bb10029a5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-d2942608-0db7-429f-b0d0-078bb10029a5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:18.271194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:18.273412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:18.275339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:18.275339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:18.275339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:18.275339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:18.275339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:18.275339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:18.275339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:18.275339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:18.275339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:50:18.275339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:18.275339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 268/558] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:50:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:18.275339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6794c-9a39-4d58-9b37-7e9f9a890448 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:18.275339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6794c-9a39-4d58-9b37-7e9f9a890448 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:18.282684 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6794c-9a39-4d58-9b37-7e9f9a890448 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:18.282684 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 269/559] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:18.282684 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6794c-9a39-4d58-9b37-7e9f9a890448 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:18.283565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:18.292783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beccc4f-4602-4ec9-8720-3549d61f5512 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:18.336688 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78320e-05f6-4fb5-822a-3156d11f7d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:18.337322 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78320e-05f6-4fb5-822a-3156d11f7d10 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:18.337599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78320e-05f6-4fb5-822a-3156d11f7d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:18.337923 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78320e-05f6-4fb5-822a-3156d11f7d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:18.387176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:18.456866 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78320e-05f6-4fb5-822a-3156d11f7d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:18.459264 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6794c-9a39-4d58-9b37-7e9f9a890448 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:18.460709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78320e-05f6-4fb5-822a-3156d11f7d10 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:18.518724 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffe3f8-60c5-4e1a-80c5-813f6fde2727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:18.520833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffe3f8-60c5-4e1a-80c5-813f6fde2727 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:18.521301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffe3f8-60c5-4e1a-80c5-813f6fde2727 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:18.521795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffe3f8-60c5-4e1a-80c5-813f6fde2727 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:18.541180 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffe3f8-60c5-4e1a-80c5-813f6fde2727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-32ffe3f8-60c5-4e1a-80c5-813f6fde2727 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:18.553949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:18.555995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:18.557601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:18.557601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:18.557601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:18.557601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:18.557601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:18.557601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:18.557601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:18.557601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:18.557601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:18.557601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:18.557601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:18.557601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:18.557601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 270/560] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:18.557601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13571a-e956-419b-89ba-d7f3ff36e79a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:18.559043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13571a-e956-419b-89ba-d7f3ff36e79a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:18.559043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13571a-e956-419b-89ba-d7f3ff36e79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:18.577080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4c13571a-e956-419b-89ba-d7f3ff36e79a None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:18.578301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4c13571a-e956-419b-89ba-d7f3ff36e79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:18.650904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 291/561] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:50:18.650904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78320e-05f6-4fb5-822a-3156d11f7d10 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:18.656028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:18.673313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 271/562] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:18.675368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13571a-e956-419b-89ba-d7f3ff36e79a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:18.756361 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:18.806390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78320e-05f6-4fb5-822a-3156d11f7d10 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:18.846291 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13571a-e956-419b-89ba-d7f3ff36e79a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:18.854179 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbf5de-2c16-44f7-9c4a-0dbbdb6936b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:18.855223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf5de-2c16-44f7-9c4a-0dbbdb6936b1 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:18.855714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf5de-2c16-44f7-9c4a-0dbbdb6936b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:18.856218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf5de-2c16-44f7-9c4a-0dbbdb6936b1 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:18.857627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbf5de-2c16-44f7-9c4a-0dbbdb6936b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:18.858035 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbf5de-2c16-44f7-9c4a-0dbbdb6936b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:18.860527 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbf5de-2c16-44f7-9c4a-0dbbdb6936b1 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:18.890665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af769f-c62d-4cf6-8f75-184f116206fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:18.891311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af769f-c62d-4cf6-8f75-184f116206fc None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:18.891579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af769f-c62d-4cf6-8f75-184f116206fc None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:18.891849 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af769f-c62d-4cf6-8f75-184f116206fc None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:18.897578 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 292/563] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Aug 7 00:50:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:18.897702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af769f-c62d-4cf6-8f75-184f116206fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:18.897702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af769f-c62d-4cf6-8f75-184f116206fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:18.897857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbf5de-2c16-44f7-9c4a-0dbbdb6936b1 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:18.897929 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af769f-c62d-4cf6-8f75-184f116206fc None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:18.906999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 272/564] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:18.908376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af769f-c62d-4cf6-8f75-184f116206fc None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:18.974875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:19.025240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbf5de-2c16-44f7-9c4a-0dbbdb6936b1 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:19.030345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af769f-c62d-4cf6-8f75-184f116206fc None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:19.047681 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:19.068944 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f55998-27bc-49b7-a142-fb1b406fab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:19.069839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f55998-27bc-49b7-a142-fb1b406fab72 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:19.070297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f55998-27bc-49b7-a142-fb1b406fab72 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:19.070750 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f55998-27bc-49b7-a142-fb1b406fab72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:19.078865 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10920f8d-ef33-4279-874b-a069cbf90a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:19.079867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10920f8d-ef33-4279-874b-a069cbf90a09 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:19.080349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10920f8d-ef33-4279-874b-a069cbf90a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:19.080803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10920f8d-ef33-4279-874b-a069cbf90a09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:19.088125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f55998-27bc-49b7-a142-fb1b406fab72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:19.090595 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f55998-27bc-49b7-a142-fb1b406fab72 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:19.098579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10920f8d-ef33-4279-874b-a069cbf90a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-10920f8d-ef33-4279-874b-a069cbf90a09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:19.107628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:19.108681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:19.109532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:19.109532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:19.109532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:19.109532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:19.109532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:19.109532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:19.109532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:19.109532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:19.109532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:19.109532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:19.109532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:19.109532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:19.110171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 273/565] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:19.111429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10920f8d-ef33-4279-874b-a069cbf90a09 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-89f55998-27bc-49b7-a142-fb1b406fab72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:19.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:19.122521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:19.124167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:19.124167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:19.124167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:19.124167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 293/566] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:19.124167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa54240-45ad-41f6-a2e1-435810c9480f None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:19.124167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa54240-45ad-41f6-a2e1-435810c9480f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:19.124167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa54240-45ad-41f6-a2e1-435810c9480f None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:19.124167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 294/567] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:19.124167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa54240-45ad-41f6-a2e1-435810c9480f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:19.240816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa54240-45ad-41f6-a2e1-435810c9480f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:19.271596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10920f8d-ef33-4279-874b-a069cbf90a09 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:19.278677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1c21b-6b1a-4465-af22-674462568bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:19.279320 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1c21b-6b1a-4465-af22-674462568bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:19.279604 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1c21b-6b1a-4465-af22-674462568bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:19.279880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1c21b-6b1a-4465-af22-674462568bb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:19.292594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1c21b-6b1a-4465-af22-674462568bb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:19.294259 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1c21b-6b1a-4465-af22-674462568bb4 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:19.294549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-aef1c21b-6b1a-4465-af22-674462568bb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:19.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:19.312708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:19.314426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:19.314426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:19.314426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:19.314426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 295/568] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:19.314426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1c21b-6b1a-4465-af22-674462568bb4 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:19.334891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a04a9a-94c0-4608-8c20-43961f2cb648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:19.335800 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a04a9a-94c0-4608-8c20-43961f2cb648 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:19.336283 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a04a9a-94c0-4608-8c20-43961f2cb648 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:19.336718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a04a9a-94c0-4608-8c20-43961f2cb648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:19.349426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:19.355954 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a04a9a-94c0-4608-8c20-43961f2cb648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:19.357473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a04a9a-94c0-4608-8c20-43961f2cb648 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-09a04a9a-94c0-4608-8c20-43961f2cb648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:19.373415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:19.375141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:19.376777 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:19.376777 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:19.376777 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:19.376777 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 274/569] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:19.376777 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a04a9a-94c0-4608-8c20-43961f2cb648 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:19.475603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1c21b-6b1a-4465-af22-674462568bb4 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:19.489276 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a04a9a-94c0-4608-8c20-43961f2cb648 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:19.519965 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61681fda-4abf-4346-b06c-8172c5686835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:19.520872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61681fda-4abf-4346-b06c-8172c5686835 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:19.521151 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61681fda-4abf-4346-b06c-8172c5686835 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:19.521421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61681fda-4abf-4346-b06c-8172c5686835 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:19.522113 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61681fda-4abf-4346-b06c-8172c5686835 None admin] RBAC: Adding query filter params (name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:19.522414 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61681fda-4abf-4346-b06c-8172c5686835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:19.523817 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61681fda-4abf-4346-b06c-8172c5686835 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:19.532722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 296/570] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:19.533812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016f802-8885-4b81-8578-c9eedf651128 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:19.534164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016f802-8885-4b81-8578-c9eedf651128 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:19.534477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016f802-8885-4b81-8578-c9eedf651128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:19.548750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0738fc-44f3-46a7-a40e-b5e0f3da527e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:19.549396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0738fc-44f3-46a7-a40e-b5e0f3da527e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:19.549674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0738fc-44f3-46a7-a40e-b5e0f3da527e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:19.549948 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0738fc-44f3-46a7-a40e-b5e0f3da527e None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:19.551268 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0738fc-44f3-46a7-a40e-b5e0f3da527e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:19.551583 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0738fc-44f3-46a7-a40e-b5e0f3da527e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:19.553073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0738fc-44f3-46a7-a40e-b5e0f3da527e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:19.555802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-1016f802-8885-4b81-8578-c9eedf651128 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:19.557113 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1016f802-8885-4b81-8578-c9eedf651128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:19.569220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 275/571] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:19.570195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0738fc-44f3-46a7-a40e-b5e0f3da527e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:19.608124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:19.661857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 297/572] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:19.662724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016f802-8885-4b81-8578-c9eedf651128 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:19.686445 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:19.712976 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0738fc-44f3-46a7-a40e-b5e0f3da527e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:19.755376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a0db4-b8fd-43f0-ac24-f806ff81da37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:19.756144 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a0db4-b8fd-43f0-ac24-f806ff81da37 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:19.756490 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a0db4-b8fd-43f0-ac24-f806ff81da37 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:19.756828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a0db4-b8fd-43f0-ac24-f806ff81da37 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:19.757571 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a0db4-b8fd-43f0-ac24-f806ff81da37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:19.758015 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a0db4-b8fd-43f0-ac24-f806ff81da37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:19.759772 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a0db4-b8fd-43f0-ac24-f806ff81da37 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:19.774555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 276/573] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:19.775445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a0db4-b8fd-43f0-ac24-f806ff81da37 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:19.790507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016f802-8885-4b81-8578-c9eedf651128 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:19.834707 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef559643-8ab6-4817-b115-a9e08666e40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:19.835335 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef559643-8ab6-4817-b115-a9e08666e40f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:19.835627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef559643-8ab6-4817-b115-a9e08666e40f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:19.835935 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef559643-8ab6-4817-b115-a9e08666e40f None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:19.836597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef559643-8ab6-4817-b115-a9e08666e40f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:19.836898 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef559643-8ab6-4817-b115-a9e08666e40f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:19.839193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef559643-8ab6-4817-b115-a9e08666e40f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:19.853478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 298/574] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:19.854352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef559643-8ab6-4817-b115-a9e08666e40f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:19.883467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:19.903269 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a0db4-b8fd-43f0-ac24-f806ff81da37 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:19.939809 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39ab5f-c558-4d2d-87b6-9fd8ece913fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:19.940474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39ab5f-c558-4d2d-87b6-9fd8ece913fc None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:19.941346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39ab5f-c558-4d2d-87b6-9fd8ece913fc None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:19.942154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39ab5f-c558-4d2d-87b6-9fd8ece913fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:19.950936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:19.954225 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39ab5f-c558-4d2d-87b6-9fd8ece913fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:19.955697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39ab5f-c558-4d2d-87b6-9fd8ece913fc None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-5f39ab5f-c558-4d2d-87b6-9fd8ece913fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:19.971303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:19.973324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:19.975465 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:19.975465 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:19.975465 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:19.975465 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 277/575] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:19.975465 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39ab5f-c558-4d2d-87b6-9fd8ece913fc None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:19.982658 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef559643-8ab6-4817-b115-a9e08666e40f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:20.022226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6d9d7-c69f-4eef-bb92-780bb0440d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:20.022864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6d9d7-c69f-4eef-bb92-780bb0440d9b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:20.023146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6d9d7-c69f-4eef-bb92-780bb0440d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:20.023419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6d9d7-c69f-4eef-bb92-780bb0440d9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:20.030402 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6d9d7-c69f-4eef-bb92-780bb0440d9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:20.031860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6d9d7-c69f-4eef-bb92-780bb0440d9b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:20.043608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-1de6d9d7-c69f-4eef-bb92-780bb0440d9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:20.043608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:20.043608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:20.043608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:20.043608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:20.043608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:20.043608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:20.043608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:20.043608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:20.043608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:20.043608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:20.043608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:20.043608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:20.043608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:20.043608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:20.045100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:20.046006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:20.046006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:20.046006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:20.046006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:20.046006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:20.046006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:20.046006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:20.046006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:20.046006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 299/576] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:20.050831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6d9d7-c69f-4eef-bb92-780bb0440d9b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:20.088278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39ab5f-c558-4d2d-87b6-9fd8ece913fc None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:20.125568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bb665-5e2a-4c6d-bdf1-3c24bf40c5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:20.126196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb665-5e2a-4c6d-bdf1-3c24bf40c5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:20.126473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb665-5e2a-4c6d-bdf1-3c24bf40c5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:20.126740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb665-5e2a-4c6d-bdf1-3c24bf40c5d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:20.135464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:20.141021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2bb665-5e2a-4c6d-bdf1-3c24bf40c5d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-2d2bb665-5e2a-4c6d-bdf1-3c24bf40c5d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:20.146505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:20.156209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:20.157742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:20.157742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:20.157742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:20.157742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:20.157742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:20.157742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:20.157742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:20.157742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:20.157742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:20.157742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:20.157742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:20.157742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:20.157742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 278/577] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:20.157742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bb665-5e2a-4c6d-bdf1-3c24bf40c5d9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:20.166030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6d9d7-c69f-4eef-bb92-780bb0440d9b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:20.210593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa11fe-736f-4d78-971a-144287f0b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:20.211231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa11fe-736f-4d78-971a-144287f0b075 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:20.211547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa11fe-736f-4d78-971a-144287f0b075 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:20.211781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa11fe-736f-4d78-971a-144287f0b075 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:20.215009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:20.221080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa11fe-736f-4d78-971a-144287f0b075 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:20.223073 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa11fe-736f-4d78-971a-144287f0b075 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-e0aa11fe-736f-4d78-971a-144287f0b075 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:20.234706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:20.236502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:20.239231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:20.239231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:20.239231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:20.239231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:20.239231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:20.239231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:20.239231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:20.239231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:20.239231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:50:20.239231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:20.239231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 300/578] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:50:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:20.239231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa11fe-736f-4d78-971a-144287f0b075 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:20.278775 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2bb665-5e2a-4c6d-bdf1-3c24bf40c5d9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:20.317292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575359fd-1b2b-4857-80e9-d2fc33a149ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:20.317923 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575359fd-1b2b-4857-80e9-d2fc33a149ad None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:20.318203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575359fd-1b2b-4857-80e9-d2fc33a149ad None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:20.318468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575359fd-1b2b-4857-80e9-d2fc33a149ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:20.325432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575359fd-1b2b-4857-80e9-d2fc33a149ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:20.326861 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575359fd-1b2b-4857-80e9-d2fc33a149ad None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:20.338509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-575359fd-1b2b-4857-80e9-d2fc33a149ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:20.338509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:20.338509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:20.338509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:20.338509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:20.338509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:20.338509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:20.338509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:20.338509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:20.338509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:20.338509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:20.338509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:20.338509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:20.338509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:20.338509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:20.340173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:20.341921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:20.341921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:20.341921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:20.341921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:20.341921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:20.341921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:20.341921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:20.341921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:20.341921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 279/579] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:20.341921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575359fd-1b2b-4857-80e9-d2fc33a149ad None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:20.360467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa11fe-736f-4d78-971a-144287f0b075 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:20.396925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282be76e-6cf4-4067-8105-d830022ce0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:20.397447 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282be76e-6cf4-4067-8105-d830022ce0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:20.397725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282be76e-6cf4-4067-8105-d830022ce0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:20.397992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282be76e-6cf4-4067-8105-d830022ce0c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:20.398638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282be76e-6cf4-4067-8105-d830022ce0c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:20.398934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282be76e-6cf4-4067-8105-d830022ce0c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:20.400351 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282be76e-6cf4-4067-8105-d830022ce0c7 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:20.412598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:20.413803 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 301/580] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:20.414611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282be76e-6cf4-4067-8105-d830022ce0c7 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:20.460770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575359fd-1b2b-4857-80e9-d2fc33a149ad None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:20.477949 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:20.499575 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec816a-c9dc-48ab-8b83-98bd2efc5fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:20.500238 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec816a-c9dc-48ab-8b83-98bd2efc5fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:20.500894 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec816a-c9dc-48ab-8b83-98bd2efc5fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:20.501177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec816a-c9dc-48ab-8b83-98bd2efc5fc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:20.501889 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec816a-c9dc-48ab-8b83-98bd2efc5fc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:20.502198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec816a-c9dc-48ab-8b83-98bd2efc5fc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:20.503840 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec816a-c9dc-48ab-8b83-98bd2efc5fc9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:20.523438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 280/581] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:20.524341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec816a-c9dc-48ab-8b83-98bd2efc5fc9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:20.529512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282be76e-6cf4-4067-8105-d830022ce0c7 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:20.578997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85371217-3670-4739-8916-abd980dd8706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:20.580153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85371217-3670-4739-8916-abd980dd8706 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:20.580667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85371217-3670-4739-8916-abd980dd8706 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:20.581172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85371217-3670-4739-8916-abd980dd8706 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:20.582538 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85371217-3670-4739-8916-abd980dd8706 None admin] RBAC: Adding query filter params (name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:20.582857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85371217-3670-4739-8916-abd980dd8706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:20.584364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85371217-3670-4739-8916-abd980dd8706 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:20.594158 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 302/582] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:20.595168 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85371217-3670-4739-8916-abd980dd8706 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:20.658147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec816a-c9dc-48ab-8b83-98bd2efc5fc9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:20.678223 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:20.705759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d21f0-9e51-4f4a-aed7-e175dcbb8cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:20.706420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d21f0-9e51-4f4a-aed7-e175dcbb8cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:20.707306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d21f0-9e51-4f4a-aed7-e175dcbb8cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:20.707892 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d21f0-9e51-4f4a-aed7-e175dcbb8cb6 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:20.708229 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d21f0-9e51-4f4a-aed7-e175dcbb8cb6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:20.708528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d21f0-9e51-4f4a-aed7-e175dcbb8cb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:20.709936 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d21f0-9e51-4f4a-aed7-e175dcbb8cb6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:20.710884 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85371217-3670-4739-8916-abd980dd8706 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:20.728049 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 281/583] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Aug 7 00:50:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:20.728892 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d21f0-9e51-4f4a-aed7-e175dcbb8cb6 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:20.739406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:20.762375 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e98fb-9cce-49e0-a49e-d7d79f58041b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:20.762985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e98fb-9cce-49e0-a49e-d7d79f58041b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:20.763261 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e98fb-9cce-49e0-a49e-d7d79f58041b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:20.763668 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e98fb-9cce-49e0-a49e-d7d79f58041b None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:20.764264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e98fb-9cce-49e0-a49e-d7d79f58041b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:20.764568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e98fb-9cce-49e0-a49e-d7d79f58041b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:20.766007 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e98fb-9cce-49e0-a49e-d7d79f58041b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:20.779191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 303/584] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:20.780059 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e98fb-9cce-49e0-a49e-d7d79f58041b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:20.859056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d21f0-9e51-4f4a-aed7-e175dcbb8cb6 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:20.896002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f91f33-b255-4823-b6e7-2d9b9e14ec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:20.896657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f91f33-b255-4823-b6e7-2d9b9e14ec91 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:20.896938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f91f33-b255-4823-b6e7-2d9b9e14ec91 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:20.897210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f91f33-b255-4823-b6e7-2d9b9e14ec91 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:20.908393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e98fb-9cce-49e0-a49e-d7d79f58041b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:20.912203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f91f33-b255-4823-b6e7-2d9b9e14ec91 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:20.914893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f91f33-b255-4823-b6e7-2d9b9e14ec91 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-82f91f33-b255-4823-b6e7-2d9b9e14ec91 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:20.928454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:20.937368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:20.939428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:20.939428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:20.939428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:20.939428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:20.939428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:20.939428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:20.939428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:20.939428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:20.939428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:50:20.939428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:20.939428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 282/585] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Aug 7 00:50:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:20.939428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f91f33-b255-4823-b6e7-2d9b9e14ec91 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:20.951708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568279c8-b997-4b02-b0d1-a0d6ee78dda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:20.952446 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568279c8-b997-4b02-b0d1-a0d6ee78dda7 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:20.952790 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568279c8-b997-4b02-b0d1-a0d6ee78dda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:20.953153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568279c8-b997-4b02-b0d1-a0d6ee78dda7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:20.953997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568279c8-b997-4b02-b0d1-a0d6ee78dda7 None admin] RBAC: Adding query filter params (role.id=05605552a8ef41ce895f7d776aefd260, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=04ad38e3598f4b15b74398dbdb9e69b3) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:20.954395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568279c8-b997-4b02-b0d1-a0d6ee78dda7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:20.955953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568279c8-b997-4b02-b0d1-a0d6ee78dda7 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:20.962603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 304/586] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:20 2022] GET /identity/v3/role_assignments?user.id=04ad38e3598f4b15b74398dbdb9e69b3&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=05605552a8ef41ce895f7d776aefd260 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:20.963608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568279c8-b997-4b02-b0d1-a0d6ee78dda7 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:20.979752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:21.037552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:21.085354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f91f33-b255-4823-b6e7-2d9b9e14ec91 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:21.122882 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568279c8-b997-4b02-b0d1-a0d6ee78dda7 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:21.129844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f3f14-d2d9-4098-9984-4ad9bb635a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:21.130749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f3f14-d2d9-4098-9984-4ad9bb635a95 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:21.130935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f3f14-d2d9-4098-9984-4ad9bb635a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:21.131188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f3f14-d2d9-4098-9984-4ad9bb635a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:21.146863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f3f14-d2d9-4098-9984-4ad9bb635a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:21.149659 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f3f14-d2d9-4098-9984-4ad9bb635a95 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:21.168597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c858da-67bf-4b34-88ef-db1cf312641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:21.169279 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c858da-67bf-4b34-88ef-db1cf312641a None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:21.169493 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c858da-67bf-4b34-88ef-db1cf312641a None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:21.169679 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c858da-67bf-4b34-88ef-db1cf312641a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c95f3f14-d2d9-4098-9984-4ad9bb635a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:21.176692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:21.177698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:21.179055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:21.179055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:21.179055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:21.183963 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c858da-67bf-4b34-88ef-db1cf312641a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:21.184597 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 283/587] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:21.185543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c858da-67bf-4b34-88ef-db1cf312641a None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:21.186381 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f3f14-d2d9-4098-9984-4ad9bb635a95 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-f8c858da-67bf-4b34-88ef-db1cf312641a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:21.202108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:21.203148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:21.204786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:21.204786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:21.204786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:21.208124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 305/588] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:21.210001 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c858da-67bf-4b34-88ef-db1cf312641a None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:21.307975 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:21.324614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f3f14-d2d9-4098-9984-4ad9bb635a95 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:21.364437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005affd8-7a16-408f-b975-91ec2b9c7b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:21.365121 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005affd8-7a16-408f-b975-91ec2b9c7b54 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:21.365400 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005affd8-7a16-408f-b975-91ec2b9c7b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:21.365670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005affd8-7a16-408f-b975-91ec2b9c7b54 None admin] PATH_INFO: `/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/345c25e7dd2341bcb4c53d0a5aa36b9d/roles/05605552a8ef41ce895f7d776aefd260` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:21.377022 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:21.384045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005affd8-7a16-408f-b975-91ec2b9c7b54 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9f64c951f44fd48eedc312b1f33694, user_id=345c25e7dd2341bcb4c53d0a5aa36b9d, role_id=05605552a8ef41ce895f7d776aefd260)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:21.385533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005affd8-7a16-408f-b975-91ec2b9c7b54 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:21.391193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c858da-67bf-4b34-88ef-db1cf312641a None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:21.411939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 284/589] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:50:21 2022] PUT /identity/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/345c25e7dd2341bcb4c53d0a5aa36b9d/roles/05605552a8ef41ce895f7d776aefd260 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:50:21.411939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005affd8-7a16-408f-b975-91ec2b9c7b54 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:21.476254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f05c4-8908-47cf-851f-d0e0604f4ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:21.478847 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f05c4-8908-47cf-851f-d0e0604f4ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:21.479392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f05c4-8908-47cf-851f-d0e0604f4ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:21.479942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f05c4-8908-47cf-851f-d0e0604f4ea1 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:21.481369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f05c4-8908-47cf-851f-d0e0604f4ea1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:21.481956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f05c4-8908-47cf-851f-d0e0604f4ea1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:21.484788 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f05c4-8908-47cf-851f-d0e0604f4ea1 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:21.527079 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 306/590] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Aug 7 00:50:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:21.528799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f05c4-8908-47cf-851f-d0e0604f4ea1 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:21.601989 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005affd8-7a16-408f-b975-91ec2b9c7b54 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:21.658453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4803e-9ef2-4da9-962e-b60e08f999e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:21.659267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4803e-9ef2-4da9-962e-b60e08f999e8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:21.659882 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4803e-9ef2-4da9-962e-b60e08f999e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:21.660360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4803e-9ef2-4da9-962e-b60e08f999e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:21.661272 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4803e-9ef2-4da9-962e-b60e08f999e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:21.661663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4803e-9ef2-4da9-962e-b60e08f999e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:21.663495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4803e-9ef2-4da9-962e-b60e08f999e8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:21.674427 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:21.684287 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 285/591] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:21.686502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4803e-9ef2-4da9-962e-b60e08f999e8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:21.759161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f05c4-8908-47cf-851f-d0e0604f4ea1 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:21.828894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ccafd-1b45-4bb2-a746-f5b1634dbf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:21.829371 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ccafd-1b45-4bb2-a746-f5b1634dbf01 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:21.829947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ccafd-1b45-4bb2-a746-f5b1634dbf01 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:21.830508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ccafd-1b45-4bb2-a746-f5b1634dbf01 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:21.832342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ccafd-1b45-4bb2-a746-f5b1634dbf01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:21.833135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ccafd-1b45-4bb2-a746-f5b1634dbf01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:21.835632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ccafd-1b45-4bb2-a746-f5b1634dbf01 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:21.862582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 307/592] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:21.862582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ccafd-1b45-4bb2-a746-f5b1634dbf01 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:21.881226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:21.906102 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4803e-9ef2-4da9-962e-b60e08f999e8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:21.978043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93f6f5-c02d-457d-bf93-c502bd9dc1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:21.978898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93f6f5-c02d-457d-bf93-c502bd9dc1ae None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:21.979439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93f6f5-c02d-457d-bf93-c502bd9dc1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:21.979885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93f6f5-c02d-457d-bf93-c502bd9dc1ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:21.997108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93f6f5-c02d-457d-bf93-c502bd9dc1ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:21.999229 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93f6f5-c02d-457d-bf93-c502bd9dc1ae None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-0c93f6f5-c02d-457d-bf93-c502bd9dc1ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:22.021290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:22.023088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:22.025081 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:22.025081 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:22.025081 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:22.025447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 286/593] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:22.026452 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93f6f5-c02d-457d-bf93-c502bd9dc1ae None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:22.041410 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ccafd-1b45-4bb2-a746-f5b1634dbf01 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:22.083999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adc497-8062-4b8e-9539-6785d2a01df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:22.085187 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adc497-8062-4b8e-9539-6785d2a01df8 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:22.085187 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adc497-8062-4b8e-9539-6785d2a01df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:22.085579 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adc497-8062-4b8e-9539-6785d2a01df8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:22.094835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adc497-8062-4b8e-9539-6785d2a01df8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:22.096671 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adc497-8062-4b8e-9539-6785d2a01df8 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:22.118018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-79adc497-8062-4b8e-9539-6785d2a01df8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:22.119484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:22.120918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:22.122590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:22.122590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:22.122590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:22.122590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:22.122590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:22.122590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:22.122590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:22.122590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:22.122590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:50:22.122590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:22.125291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 308/594] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:22.126518 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adc497-8062-4b8e-9539-6785d2a01df8 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:22.194952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93f6f5-c02d-457d-bf93-c502bd9dc1ae None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:22.236343 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:22.254964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d767e9-69ff-45b2-8b25-add262f9f096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:22.256063 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d767e9-69ff-45b2-8b25-add262f9f096 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:22.256429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d767e9-69ff-45b2-8b25-add262f9f096 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:22.256882 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d767e9-69ff-45b2-8b25-add262f9f096 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:22.266459 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d767e9-69ff-45b2-8b25-add262f9f096 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:22.268130 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d767e9-69ff-45b2-8b25-add262f9f096 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:22.276532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adc497-8062-4b8e-9539-6785d2a01df8 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:22.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-85d767e9-69ff-45b2-8b25-add262f9f096 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:22.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:22.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:22.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:22.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:22.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:22.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:22.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:22.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:22.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:22.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:22.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:22.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:22.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:22.287416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:22.288522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:22.289612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:22.289612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:22.289612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:22.289612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:22.289612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:22.289612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:22.289612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:22.289612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:22.291688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 287/595] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:22.293277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d767e9-69ff-45b2-8b25-add262f9f096 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:22.335862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4e466-8fbc-40e9-955b-b7a34e898676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:22.337292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4e466-8fbc-40e9-955b-b7a34e898676 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:22.337970 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4e466-8fbc-40e9-955b-b7a34e898676 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:22.338283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4e466-8fbc-40e9-955b-b7a34e898676 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:22.339014 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4e466-8fbc-40e9-955b-b7a34e898676 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:22.339388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4e466-8fbc-40e9-955b-b7a34e898676 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:22.341081 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4e466-8fbc-40e9-955b-b7a34e898676 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:22.358541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 309/596] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:22.360373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4e466-8fbc-40e9-955b-b7a34e898676 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:22.425803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d767e9-69ff-45b2-8b25-add262f9f096 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:22.439540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:22.475257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0329b4-d5df-44bc-9253-af284f4f2519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:22.476557 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0329b4-d5df-44bc-9253-af284f4f2519 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:22.477016 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0329b4-d5df-44bc-9253-af284f4f2519 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:22.477993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0329b4-d5df-44bc-9253-af284f4f2519 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:22.479223 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0329b4-d5df-44bc-9253-af284f4f2519 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:22.479715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0329b4-d5df-44bc-9253-af284f4f2519 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:22.481377 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0329b4-d5df-44bc-9253-af284f4f2519 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:22.506636 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 288/597] 10.222.0.20 () {56 vars in 1139 bytes} [Sun Aug 7 00:50:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:22.507835 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0329b4-d5df-44bc-9253-af284f4f2519 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:22.545280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4e466-8fbc-40e9-955b-b7a34e898676 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:22.594969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:22.604900 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd371c-6463-4e81-ab64-5c4648021ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:22.605930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd371c-6463-4e81-ab64-5c4648021ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:22.606222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd371c-6463-4e81-ab64-5c4648021ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:22.606494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd371c-6463-4e81-ab64-5c4648021ea8 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:22.607932 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd371c-6463-4e81-ab64-5c4648021ea8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:22.608500 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd371c-6463-4e81-ab64-5c4648021ea8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:22.610935 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd371c-6463-4e81-ab64-5c4648021ea8 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:22.640554 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 310/598] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:22.642312 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd371c-6463-4e81-ab64-5c4648021ea8 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:22.658768 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0329b4-d5df-44bc-9253-af284f4f2519 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:22.708199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3385aa-35f9-492e-81e7-f71fe5ddd1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:22.709670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3385aa-35f9-492e-81e7-f71fe5ddd1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:22.710149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3385aa-35f9-492e-81e7-f71fe5ddd1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:22.710848 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3385aa-35f9-492e-81e7-f71fe5ddd1a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:22.720123 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3385aa-35f9-492e-81e7-f71fe5ddd1a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:22.723222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3385aa-35f9-492e-81e7-f71fe5ddd1a8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:22.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-1b3385aa-35f9-492e-81e7-f71fe5ddd1a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:22.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:22.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:22.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:22.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:22.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:22.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:22.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:22.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:22.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:22.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:22.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:22.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:22.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:22.738601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:22.739565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:22.740514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:22.740514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:22.740514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:22.740514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:22.740514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:22.740514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:22.740514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:22.740514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:22.742864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 289/599] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:22.744167 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3385aa-35f9-492e-81e7-f71fe5ddd1a8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:22.786534 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:22.798335 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd371c-6463-4e81-ab64-5c4648021ea8 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:22.863652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d3d22-ab12-4cea-87df-1d019dd39196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:22.864360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d3d22-ab12-4cea-87df-1d019dd39196 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:22.864645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d3d22-ab12-4cea-87df-1d019dd39196 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:22.864918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d3d22-ab12-4cea-87df-1d019dd39196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:22.889225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d3d22-ab12-4cea-87df-1d019dd39196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:22.892737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d3d22-ab12-4cea-87df-1d019dd39196 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:22.899511 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3385aa-35f9-492e-81e7-f71fe5ddd1a8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-2f8d3d22-ab12-4cea-87df-1d019dd39196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:22.923286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:22.924345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:22.925339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:22.925339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:22.925339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:22.932182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 311/600] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:22.933698 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d3d22-ab12-4cea-87df-1d019dd39196 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:22.942315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6451c-a6e2-4bc4-bc3d-297dab85ae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:22.942997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6451c-a6e2-4bc4-bc3d-297dab85ae8f None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:22.943275 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6451c-a6e2-4bc4-bc3d-297dab85ae8f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:22.943548 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6451c-a6e2-4bc4-bc3d-297dab85ae8f None admin] PATH_INFO: `/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/803d0ab121784d688b58374aaa6a8e7c/roles/05605552a8ef41ce895f7d776aefd260` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:22.964847 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6451c-a6e2-4bc4-bc3d-297dab85ae8f None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9f64c951f44fd48eedc312b1f33694, user_id=803d0ab121784d688b58374aaa6a8e7c, role_id=05605552a8ef41ce895f7d776aefd260)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:22.967072 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6451c-a6e2-4bc4-bc3d-297dab85ae8f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:22.989090 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 290/601] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:50:22 2022] PUT /identity/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/803d0ab121784d688b58374aaa6a8e7c/roles/05605552a8ef41ce895f7d776aefd260 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:50:22.989986 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6451c-a6e2-4bc4-bc3d-297dab85ae8f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:23.001269 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:23.104819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d3d22-ab12-4cea-87df-1d019dd39196 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:23.157555 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0524617-6a67-4ddd-bd47-bbc220cd2741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:23.158190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0524617-6a67-4ddd-bd47-bbc220cd2741 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:23.158527 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0524617-6a67-4ddd-bd47-bbc220cd2741 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:23.158806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0524617-6a67-4ddd-bd47-bbc220cd2741 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:23.160150 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0524617-6a67-4ddd-bd47-bbc220cd2741 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:23.160461 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0524617-6a67-4ddd-bd47-bbc220cd2741 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:23.162010 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0524617-6a67-4ddd-bd47-bbc220cd2741 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:23.167413 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:23.187243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 312/602] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:23.190358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8824cee-ac7a-468e-a1af-35ad01a151f7 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:23.191442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8824cee-ac7a-468e-a1af-35ad01a151f7 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:23.192501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8824cee-ac7a-468e-a1af-35ad01a151f7 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:23.196156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 313/603] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:23.197854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8824cee-ac7a-468e-a1af-35ad01a151f7 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:23.206793 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6451c-a6e2-4bc4-bc3d-297dab85ae8f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:23.255348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fb585-9c6b-4066-8901-fef16183cc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:23.256308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fb585-9c6b-4066-8901-fef16183cc1c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:23.256883 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fb585-9c6b-4066-8901-fef16183cc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:23.258600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fb585-9c6b-4066-8901-fef16183cc1c None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:23.258600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fb585-9c6b-4066-8901-fef16183cc1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:23.258600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fb585-9c6b-4066-8901-fef16183cc1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:23.260244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fb585-9c6b-4066-8901-fef16183cc1c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:23.280346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 291/604] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:23.281832 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e3153-9138-4efd-92de-02df3159f08e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:23.282238 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e3153-9138-4efd-92de-02df3159f08e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:23.282617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e3153-9138-4efd-92de-02df3159f08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:23.309106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-cc6e3153-9138-4efd-92de-02df3159f08e None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:23.310502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cc6e3153-9138-4efd-92de-02df3159f08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:23.413866 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8824cee-ac7a-468e-a1af-35ad01a151f7 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:23.418507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:23.432256 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 292/605] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:23.434542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e3153-9138-4efd-92de-02df3159f08e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:23.459495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b65024-3caa-4858-ade4-a6fe71f9158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:23.460255 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b65024-3caa-4858-ade4-a6fe71f9158e None admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:23.460530 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b65024-3caa-4858-ade4-a6fe71f9158e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:23.460799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b65024-3caa-4858-ade4-a6fe71f9158e None admin] PATH_INFO: `/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/20b8a995891f46f1ab1672836752cc4e/roles/05605552a8ef41ce895f7d776aefd260` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:23.479070 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b65024-3caa-4858-ade4-a6fe71f9158e None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9f64c951f44fd48eedc312b1f33694, user_id=20b8a995891f46f1ab1672836752cc4e, role_id=05605552a8ef41ce895f7d776aefd260)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:23.480641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b65024-3caa-4858-ade4-a6fe71f9158e None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:23.499733 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 314/606] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:50:23 2022] PUT /identity/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/20b8a995891f46f1ab1672836752cc4e/roles/05605552a8ef41ce895f7d776aefd260 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:50:23.501183 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b65024-3caa-4858-ade4-a6fe71f9158e None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:23.539293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:23.591995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e3153-9138-4efd-92de-02df3159f08e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:23.699930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7156d-844e-4494-9474-df7c652c5439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:23.699930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7156d-844e-4494-9474-df7c652c5439 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:23.699930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7156d-844e-4494-9474-df7c652c5439 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:23.699930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7156d-844e-4494-9474-df7c652c5439 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:23.713106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7156d-844e-4494-9474-df7c652c5439 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:23.714582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7156d-844e-4494-9474-df7c652c5439 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:23.729901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-fbf7156d-844e-4494-9474-df7c652c5439 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:23.729901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:23.729901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:23.729901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:23.729901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:23.729901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:23.729901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:23.729901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:23.729901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:23.729901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:23.729901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:23.729901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:23.729901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:23.729901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:23.729901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:23.730877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:23.731806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:23.731806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:23.731806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:23.731806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:23.731806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:23.731806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:23.731806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:23.731806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:23.732282 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 293/607] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:23.739053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7156d-844e-4494-9474-df7c652c5439 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:23.750485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b65024-3caa-4858-ade4-a6fe71f9158e None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:23.803244 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffe1e0-f399-4633-a122-5be9db57a402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:23.803921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffe1e0-f399-4633-a122-5be9db57a402 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:23.804201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffe1e0-f399-4633-a122-5be9db57a402 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:23.804471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffe1e0-f399-4633-a122-5be9db57a402 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:23.819248 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffe1e0-f399-4633-a122-5be9db57a402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-73ffe1e0-f399-4633-a122-5be9db57a402 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:23.825273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:23.826245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:23.827098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:23.827098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:23.827098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:23.827098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:23.827098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:23.827098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:23.827098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:23.827098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:23.827098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:23.827098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:23.827098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:23.827098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:23.827098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 315/608] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:23.833895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffe1e0-f399-4633-a122-5be9db57a402 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:23.853481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:23.881636 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7156d-844e-4494-9474-df7c652c5439 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:23.924303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:23.936579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03259a06-2d8e-4ee8-8b9e-5287d7489fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:23.937201 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03259a06-2d8e-4ee8-8b9e-5287d7489fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:23.937481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03259a06-2d8e-4ee8-8b9e-5287d7489fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:23.937751 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03259a06-2d8e-4ee8-8b9e-5287d7489fc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:23.938453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03259a06-2d8e-4ee8-8b9e-5287d7489fc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:23.938757 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03259a06-2d8e-4ee8-8b9e-5287d7489fc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:23.940229 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03259a06-2d8e-4ee8-8b9e-5287d7489fc2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:23.985715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 294/609] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:23.990084 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03259a06-2d8e-4ee8-8b9e-5287d7489fc2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:24.098822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffe1e0-f399-4633-a122-5be9db57a402 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:24.146410 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6193ef-d37e-4188-a6cf-f503102d8d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:24.147064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6193ef-d37e-4188-a6cf-f503102d8d17 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:24.147366 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6193ef-d37e-4188-a6cf-f503102d8d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:24.147648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6193ef-d37e-4188-a6cf-f503102d8d17 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:24.148390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6193ef-d37e-4188-a6cf-f503102d8d17 None admin] RBAC: Adding query filter params (name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:24.148692 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6193ef-d37e-4188-a6cf-f503102d8d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:24.150102 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6193ef-d37e-4188-a6cf-f503102d8d17 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:24.161161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 316/610] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:24.162613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98477ec-0b84-4892-93af-83a374752ef5 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:24.162903 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98477ec-0b84-4892-93af-83a374752ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:24.163177 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98477ec-0b84-4892-93af-83a374752ef5 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:24.164895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 317/611] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:24.170983 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa873590-f9b6-45b3-bdf3-92ce64a32f43 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:24.171323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa873590-f9b6-45b3-bdf3-92ce64a32f43 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:24.171797 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa873590-f9b6-45b3-bdf3-92ce64a32f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:24.204147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03259a06-2d8e-4ee8-8b9e-5287d7489fc2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:24.205859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-fa873590-f9b6-45b3-bdf3-92ce64a32f43 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:24.210759 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-fa873590-f9b6-45b3-bdf3-92ce64a32f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:24.276306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96111236-4aea-4d3c-b667-10f0bf1a5281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:24.277902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96111236-4aea-4d3c-b667-10f0bf1a5281 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:24.278384 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96111236-4aea-4d3c-b667-10f0bf1a5281 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:24.278866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96111236-4aea-4d3c-b667-10f0bf1a5281 None admin] PATH_INFO: `/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/e393d9c50bbb4f69a48ae635d13b1197/roles/05605552a8ef41ce895f7d776aefd260` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:24.304961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96111236-4aea-4d3c-b667-10f0bf1a5281 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9f64c951f44fd48eedc312b1f33694, user_id=e393d9c50bbb4f69a48ae635d13b1197, role_id=05605552a8ef41ce895f7d776aefd260)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:24.306420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96111236-4aea-4d3c-b667-10f0bf1a5281 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:24.332011 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 295/612] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:50:23 2022] PUT /identity/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/e393d9c50bbb4f69a48ae635d13b1197/roles/05605552a8ef41ce895f7d776aefd260 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:50:24.332011 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96111236-4aea-4d3c-b667-10f0bf1a5281 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:24.332341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 318/613] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:24.349637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa873590-f9b6-45b3-bdf3-92ce64a32f43 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:24.384337 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:24.482238 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:24.572825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96111236-4aea-4d3c-b667-10f0bf1a5281 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:24.612149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffde68-e94b-4430-8754-47f83a9cdb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:24.612724 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffde68-e94b-4430-8754-47f83a9cdb69 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:24.613217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffde68-e94b-4430-8754-47f83a9cdb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:24.613606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffde68-e94b-4430-8754-47f83a9cdb69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:24.625201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa873590-f9b6-45b3-bdf3-92ce64a32f43 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:24.625958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffde68-e94b-4430-8754-47f83a9cdb69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:24.629324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffde68-e94b-4430-8754-47f83a9cdb69 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c9ffde68-e94b-4430-8754-47f83a9cdb69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:24.655740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:24.657600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:24.662546 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:24.662546 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:24.662546 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:24.662546 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 296/614] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:24.666890 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffde68-e94b-4430-8754-47f83a9cdb69 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:24.708440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29630cc0-8faa-4a1f-85e3-6f2948ada607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:24.709918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29630cc0-8faa-4a1f-85e3-6f2948ada607 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:24.710671 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29630cc0-8faa-4a1f-85e3-6f2948ada607 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:24.711522 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29630cc0-8faa-4a1f-85e3-6f2948ada607 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:24.732326 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29630cc0-8faa-4a1f-85e3-6f2948ada607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-29630cc0-8faa-4a1f-85e3-6f2948ada607 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:24.742314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:24.743819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:24.745247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:24.745247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:24.745247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:24.745247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:24.745247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:24.745247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:24.745247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:24.745247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:24.745247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:24.745247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:24.745247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:24.745247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:24.755093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 319/615] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:24.759245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29630cc0-8faa-4a1f-85e3-6f2948ada607 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:24.774545 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:24.786475 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffde68-e94b-4430-8754-47f83a9cdb69 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:24.834700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36758b-08eb-4b1f-89b3-33a3187e9f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:24.835663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36758b-08eb-4b1f-89b3-33a3187e9f72 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:24.836201 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36758b-08eb-4b1f-89b3-33a3187e9f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:24.836677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36758b-08eb-4b1f-89b3-33a3187e9f72 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:24.837566 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36758b-08eb-4b1f-89b3-33a3187e9f72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:24.838069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36758b-08eb-4b1f-89b3-33a3187e9f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:24.839647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36758b-08eb-4b1f-89b3-33a3187e9f72 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:24.866451 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 297/616] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:24.872713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36758b-08eb-4b1f-89b3-33a3187e9f72 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:24.940533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:25.012102 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29630cc0-8faa-4a1f-85e3-6f2948ada607 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:25.052742 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fc6ac-d2ff-415a-81ae-8a7eef5ae935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:25.053330 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fc6ac-d2ff-415a-81ae-8a7eef5ae935 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:25.053611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fc6ac-d2ff-415a-81ae-8a7eef5ae935 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:25.053881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fc6ac-d2ff-415a-81ae-8a7eef5ae935 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:25.054564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fc6ac-d2ff-415a-81ae-8a7eef5ae935 None admin] RBAC: Adding query filter params (name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:25.054863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fc6ac-d2ff-415a-81ae-8a7eef5ae935 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:25.056419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fc6ac-d2ff-415a-81ae-8a7eef5ae935 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:25.065716 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 320/617] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:25.078054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fc6ac-d2ff-415a-81ae-8a7eef5ae935 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:25.138151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36758b-08eb-4b1f-89b3-33a3187e9f72 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:25.182468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54764c3e-e62a-4e23-88a6-dcbfc483b358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:25.183126 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54764c3e-e62a-4e23-88a6-dcbfc483b358 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:25.183404 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54764c3e-e62a-4e23-88a6-dcbfc483b358 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:25.183670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54764c3e-e62a-4e23-88a6-dcbfc483b358 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:25.198220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54764c3e-e62a-4e23-88a6-dcbfc483b358 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:25.199752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54764c3e-e62a-4e23-88a6-dcbfc483b358 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-54764c3e-e62a-4e23-88a6-dcbfc483b358 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:25.214183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:25.215236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:25.216244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:25.216244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:25.216244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:25.216244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:25.216244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:25.216244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:25.216244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:25.216244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:25.216244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:50:25.216244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:25.216244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 298/618] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:50:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:25.221724 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54764c3e-e62a-4e23-88a6-dcbfc483b358 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:25.236497 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:25.346000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54764c3e-e62a-4e23-88a6-dcbfc483b358 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:25.384730 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f844c-0091-40be-a1fc-ff8deb7d8ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:25.385401 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f844c-0091-40be-a1fc-ff8deb7d8ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:25.385680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f844c-0091-40be-a1fc-ff8deb7d8ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:25.386001 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f844c-0091-40be-a1fc-ff8deb7d8ba7 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:25.386774 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f844c-0091-40be-a1fc-ff8deb7d8ba7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:25.387042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f844c-0091-40be-a1fc-ff8deb7d8ba7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:25.388741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f844c-0091-40be-a1fc-ff8deb7d8ba7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:25.405298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fc6ac-d2ff-415a-81ae-8a7eef5ae935 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:25.412043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 299/619] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Aug 7 00:50:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:25.414286 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f844c-0091-40be-a1fc-ff8deb7d8ba7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:25.468304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:25.493701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da4faa-be46-4cf4-97cc-7b1071917567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:25.494357 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da4faa-be46-4cf4-97cc-7b1071917567 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:25.494641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da4faa-be46-4cf4-97cc-7b1071917567 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:25.494916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da4faa-be46-4cf4-97cc-7b1071917567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:25.521716 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da4faa-be46-4cf4-97cc-7b1071917567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:25.523219 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da4faa-be46-4cf4-97cc-7b1071917567 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:25.542374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-09da4faa-be46-4cf4-97cc-7b1071917567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:25.557263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:25.558309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:25.559628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:25.559628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:25.559628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:25.559628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 321/620] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 481 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:25.566986 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da4faa-be46-4cf4-97cc-7b1071917567 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:25.583631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f844c-0091-40be-a1fc-ff8deb7d8ba7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:25.662785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660f0f6-8b01-4475-bf64-66b87df75d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:25.664118 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660f0f6-8b01-4475-bf64-66b87df75d04 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:25.664716 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660f0f6-8b01-4475-bf64-66b87df75d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:25.665301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660f0f6-8b01-4475-bf64-66b87df75d04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:25.684684 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660f0f6-8b01-4475-bf64-66b87df75d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:25.697024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660f0f6-8b01-4475-bf64-66b87df75d04 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-3660f0f6-8b01-4475-bf64-66b87df75d04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:25.725196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:25.726355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:25.727580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:25.727580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:25.727580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:25.727788 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da4faa-be46-4cf4-97cc-7b1071917567 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:25.730156 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 300/621] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:25.739379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660f0f6-8b01-4475-bf64-66b87df75d04 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:25.809577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f1c60-119f-42bc-a7a7-5e89c041b424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:25.810204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f1c60-119f-42bc-a7a7-5e89c041b424 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:25.810481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f1c60-119f-42bc-a7a7-5e89c041b424 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:25.810751 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f1c60-119f-42bc-a7a7-5e89c041b424 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:25.811418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f1c60-119f-42bc-a7a7-5e89c041b424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:25.811713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f1c60-119f-42bc-a7a7-5e89c041b424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:25.813134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f1c60-119f-42bc-a7a7-5e89c041b424 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:25.845646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 322/622] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:25.851981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f1c60-119f-42bc-a7a7-5e89c041b424 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:25.949331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660f0f6-8b01-4475-bf64-66b87df75d04 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:26.000315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:26.016043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:26.039218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b34465-364e-4a85-9b8b-83f90a8ee49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:26.040260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34465-364e-4a85-9b8b-83f90a8ee49f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:26.040547 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34465-364e-4a85-9b8b-83f90a8ee49f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:26.040826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b34465-364e-4a85-9b8b-83f90a8ee49f None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:26.041728 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b34465-364e-4a85-9b8b-83f90a8ee49f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:26.042036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b34465-364e-4a85-9b8b-83f90a8ee49f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:26.044384 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b34465-364e-4a85-9b8b-83f90a8ee49f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:26.059254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 301/623] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:26.060720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5c111-a5cf-4af7-a1b6-efe55adff2dc None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:26.061010 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5c111-a5cf-4af7-a1b6-efe55adff2dc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:26.061282 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5c111-a5cf-4af7-a1b6-efe55adff2dc None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:26.067097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 302/624] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:26.068141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5c111-a5cf-4af7-a1b6-efe55adff2dc None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:26.097595 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f1c60-119f-42bc-a7a7-5e89c041b424 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:26.147627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea028b91-3f16-4e04-9c1e-8428a8fd8fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:26.148443 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea028b91-3f16-4e04-9c1e-8428a8fd8fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:26.148812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea028b91-3f16-4e04-9c1e-8428a8fd8fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:26.149125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea028b91-3f16-4e04-9c1e-8428a8fd8fe0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:26.157650 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea028b91-3f16-4e04-9c1e-8428a8fd8fe0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:26.159626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea028b91-3f16-4e04-9c1e-8428a8fd8fe0 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-ea028b91-3f16-4e04-9c1e-8428a8fd8fe0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:26.174356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:26.175943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:26.178626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:26.178626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:26.178626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:26.178626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:26.178626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:26.178626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:26.178626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:26.178626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:26.178626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:50:26.178626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:26.178626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 323/625] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:50:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:26.178626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85391250-2e7f-4a74-8563-bced351c9655 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:26.178626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85391250-2e7f-4a74-8563-bced351c9655 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:26.180369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85391250-2e7f-4a74-8563-bced351c9655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:26.202381 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5c111-a5cf-4af7-a1b6-efe55adff2dc None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:26.210398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-85391250-2e7f-4a74-8563-bced351c9655 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:26.211698 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-85391250-2e7f-4a74-8563-bced351c9655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:26.247802 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedae885-cb72-49a4-be98-40b636e98060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:26.248797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae885-cb72-49a4-be98-40b636e98060 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:26.249215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae885-cb72-49a4-be98-40b636e98060 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:26.249589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae885-cb72-49a4-be98-40b636e98060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:26.259543 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedae885-cb72-49a4-be98-40b636e98060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:26.261224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedae885-cb72-49a4-be98-40b636e98060 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:26.276312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-cedae885-cb72-49a4-be98-40b636e98060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:26.276312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:26.276312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:26.276312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:26.276312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:26.276312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:26.276312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:26.276312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:26.276312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:26.276312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:26.276312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:26.276312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:26.276312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:26.276312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:26.276312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:26.278003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:26.279755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:26.279755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:26.279755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:26.279755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:26.279755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:26.279755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:26.279755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:26.279755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:26.285620 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 303/626] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:26.286744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedae885-cb72-49a4-be98-40b636e98060 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:26.302410 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 324/627] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:26.303309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85391250-2e7f-4a74-8563-bced351c9655 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:26.338983 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:26.385146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:26.433161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85391250-2e7f-4a74-8563-bced351c9655 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:26.478062 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedae885-cb72-49a4-be98-40b636e98060 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:26.478512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dbf6f-f940-4f19-bfa9-f3e4d3b9b87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:26.479654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dbf6f-f940-4f19-bfa9-f3e4d3b9b87c None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:26.480210 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dbf6f-f940-4f19-bfa9-f3e4d3b9b87c None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:26.480706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dbf6f-f940-4f19-bfa9-f3e4d3b9b87c None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:26.482037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dbf6f-f940-4f19-bfa9-f3e4d3b9b87c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:26.482568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dbf6f-f940-4f19-bfa9-f3e4d3b9b87c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:26.485377 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dbf6f-f940-4f19-bfa9-f3e4d3b9b87c None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:26.512955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 325/628] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:26.512955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817de84-5dbf-43d2-a03d-d62afb8c9c0c None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:26.512955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817de84-5dbf-43d2-a03d-d62afb8c9c0c None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:26.512955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817de84-5dbf-43d2-a03d-d62afb8c9c0c None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:26.514165 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 326/629] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:26.515575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817de84-5dbf-43d2-a03d-d62afb8c9c0c None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:26.526781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ce699-74e7-4ec1-9079-98d0c60880f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:26.527804 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ce699-74e7-4ec1-9079-98d0c60880f9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:26.528331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ce699-74e7-4ec1-9079-98d0c60880f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:26.528810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ce699-74e7-4ec1-9079-98d0c60880f9 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:26.529782 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ce699-74e7-4ec1-9079-98d0c60880f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:26.530312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ce699-74e7-4ec1-9079-98d0c60880f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:26.532000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ce699-74e7-4ec1-9079-98d0c60880f9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:26.567951 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 304/630] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Aug 7 00:50:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:26.567951 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ce699-74e7-4ec1-9079-98d0c60880f9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:26.690016 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:26.705572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817de84-5dbf-43d2-a03d-d62afb8c9c0c None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:26.730632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:26.739743 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ce699-74e7-4ec1-9079-98d0c60880f9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:26.752738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406624f-e67a-4edb-b563-fc636f9e699b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:26.754260 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406624f-e67a-4edb-b563-fc636f9e699b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:26.754542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406624f-e67a-4edb-b563-fc636f9e699b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:26.754815 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406624f-e67a-4edb-b563-fc636f9e699b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:26.771404 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406624f-e67a-4edb-b563-fc636f9e699b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-d406624f-e67a-4edb-b563-fc636f9e699b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:26.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:26.778476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:26.779557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:26.779557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:26.779557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:26.779557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:26.779557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:26.779557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:26.779557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:26.779557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:26.779557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:26.779557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:26.779557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:26.779557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:26.783323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 327/631] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:26.785665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be44a-3c36-48e9-8132-c8ff09fac06f None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:26.785937 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be44a-3c36-48e9-8132-c8ff09fac06f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:26.786178 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4be44a-3c36-48e9-8132-c8ff09fac06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:26.802875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978f610-5f19-4f5e-bb95-7402dab42026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:26.803577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978f610-5f19-4f5e-bb95-7402dab42026 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:26.804013 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978f610-5f19-4f5e-bb95-7402dab42026 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:26.804414 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978f610-5f19-4f5e-bb95-7402dab42026 None admin] PATH_INFO: `/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/04ad38e3598f4b15b74398dbdb9e69b3/roles/05605552a8ef41ce895f7d776aefd260` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:26.808600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-ce4be44a-3c36-48e9-8132-c8ff09fac06f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:26.810137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ce4be44a-3c36-48e9-8132-c8ff09fac06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:26.829463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978f610-5f19-4f5e-bb95-7402dab42026 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9f64c951f44fd48eedc312b1f33694, user_id=04ad38e3598f4b15b74398dbdb9e69b3, role_id=05605552a8ef41ce895f7d776aefd260)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:26.831670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978f610-5f19-4f5e-bb95-7402dab42026 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:26.846873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 305/632] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:50:26 2022] PUT /identity/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/04ad38e3598f4b15b74398dbdb9e69b3/roles/05605552a8ef41ce895f7d776aefd260 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:50:26.848122 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978f610-5f19-4f5e-bb95-7402dab42026 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:26.952481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 328/633] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:26.954717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4be44a-3c36-48e9-8132-c8ff09fac06f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:26.996492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978f610-5f19-4f5e-bb95-7402dab42026 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:27.051382 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f36b5-7f7e-4fea-a670-0d218c14c5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:27.052066 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f36b5-7f7e-4fea-a670-0d218c14c5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:27.052340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f36b5-7f7e-4fea-a670-0d218c14c5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:27.052618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f36b5-7f7e-4fea-a670-0d218c14c5d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:27.086588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:27.090650 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:27.125697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4be44a-3c36-48e9-8132-c8ff09fac06f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:27.166251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f36b5-7f7e-4fea-a670-0d218c14c5d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:27.168446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f36b5-7f7e-4fea-a670-0d218c14c5d8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:27.171472 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b403c-ef46-462b-8c6d-bc34328c9b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:27.172426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b403c-ef46-462b-8c6d-bc34328c9b6f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:27.172883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b403c-ef46-462b-8c6d-bc34328c9b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:27.173349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b403c-ef46-462b-8c6d-bc34328c9b6f None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:27.174206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b403c-ef46-462b-8c6d-bc34328c9b6f None admin] RBAC: Adding query filter params (name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:27.174564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b403c-ef46-462b-8c6d-bc34328c9b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:27.176130 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b403c-ef46-462b-8c6d-bc34328c9b6f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:27.185566 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 329/634] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:27.186426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b403c-ef46-462b-8c6d-bc34328c9b6f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:27.323457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 306/635] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:50:27.326073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c461b20-7a7b-4fd0-86ad-38bc77cbe2b0 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:27.326593 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c461b20-7a7b-4fd0-86ad-38bc77cbe2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:27.327102 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c461b20-7a7b-4fd0-86ad-38bc77cbe2b0 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:27.329637 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 307/636] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:27.335115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c461b20-7a7b-4fd0-86ad-38bc77cbe2b0 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:27.335238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b403c-ef46-462b-8c6d-bc34328c9b6f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:27.385538 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592f983-0bb9-4c24-a4ab-20e032af431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:27.386198 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592f983-0bb9-4c24-a4ab-20e032af431a None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:27.386475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592f983-0bb9-4c24-a4ab-20e032af431a None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:27.386757 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592f983-0bb9-4c24-a4ab-20e032af431a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:27.400180 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592f983-0bb9-4c24-a4ab-20e032af431a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-4592f983-0bb9-4c24-a4ab-20e032af431a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:27.405468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:27.407191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:27.409989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:27.409989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:27.409989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:27.409989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:27.409989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:27.409989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:27.409989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:27.409989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:27.409989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:27.409989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:27.409989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:27.409989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:27.409989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 330/637] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:27.409989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592f983-0bb9-4c24-a4ab-20e032af431a None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:27.412816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:27.415537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:27.509057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c461b20-7a7b-4fd0-86ad-38bc77cbe2b0 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:27.550379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80285a-4b4a-4e39-813b-415f250a641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:27.551388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80285a-4b4a-4e39-813b-415f250a641a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:27.551982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80285a-4b4a-4e39-813b-415f250a641a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:27.552256 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80285a-4b4a-4e39-813b-415f250a641a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:27.555553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592f983-0bb9-4c24-a4ab-20e032af431a None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:27.564307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80285a-4b4a-4e39-813b-415f250a641a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:27.566819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80285a-4b4a-4e39-813b-415f250a641a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-bc80285a-4b4a-4e39-813b-415f250a641a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:27.590380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:27.592284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:27.593342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:27.593342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:27.593342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:27.593342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 308/638] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:27.594526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb88145-a68e-4c12-8667-1c51ede35dc3 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:27.594526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb88145-a68e-4c12-8667-1c51ede35dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:27.594945 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb88145-a68e-4c12-8667-1c51ede35dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:27.605265 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80e4c3-e124-461b-a62e-8f8e17c68a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:27.606095 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80e4c3-e124-461b-a62e-8f8e17c68a0b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:27.606553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80e4c3-e124-461b-a62e-8f8e17c68a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:27.607024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80e4c3-e124-461b-a62e-8f8e17c68a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:27.621659 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80e4c3-e124-461b-a62e-8f8e17c68a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:27.622396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-bfb88145-a68e-4c12-8667-1c51ede35dc3 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:27.623532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80e4c3-e124-461b-a62e-8f8e17c68a0b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:27.623714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bfb88145-a68e-4c12-8667-1c51ede35dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-ea80e4c3-e124-461b-a62e-8f8e17c68a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:27.658163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:27.660066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:27.660991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:27.660991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:27.660991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:27.666254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 331/639] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:27.666254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80e4c3-e124-461b-a62e-8f8e17c68a0b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:27.732201 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 309/640] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:27.733741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb88145-a68e-4c12-8667-1c51ede35dc3 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:27.772024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:27.780269 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:27.852054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80e4c3-e124-461b-a62e-8f8e17c68a0b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:27.868958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb88145-a68e-4c12-8667-1c51ede35dc3 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:27.915343 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b92d1-9960-4155-9f27-0409d400ca69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:27.915994 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b92d1-9960-4155-9f27-0409d400ca69 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:27.916284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b92d1-9960-4155-9f27-0409d400ca69 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:27.916599 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b92d1-9960-4155-9f27-0409d400ca69 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:27.917195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b92d1-9960-4155-9f27-0409d400ca69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:27.917477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fc110-6330-406a-ae9a-4b2530cfb889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:27.917657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b92d1-9960-4155-9f27-0409d400ca69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:27.918513 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fc110-6330-406a-ae9a-4b2530cfb889 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:27.918860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b92d1-9960-4155-9f27-0409d400ca69 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:27.919018 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fc110-6330-406a-ae9a-4b2530cfb889 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:27.919475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fc110-6330-406a-ae9a-4b2530cfb889 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:27.920390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fc110-6330-406a-ae9a-4b2530cfb889 None admin] RBAC: Adding query filter params (name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:27.920885 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fc110-6330-406a-ae9a-4b2530cfb889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:27.923502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fc110-6330-406a-ae9a-4b2530cfb889 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:27.932648 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 310/641] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:27.937757 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b92d1-9960-4155-9f27-0409d400ca69 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:27.945954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 332/642] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:27.945954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fc110-6330-406a-ae9a-4b2530cfb889 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:28.084537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:28.096592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b92d1-9960-4155-9f27-0409d400ca69 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:28.117241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fc110-6330-406a-ae9a-4b2530cfb889 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:28.137156 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b2919-6f51-4af5-9227-82719ed8cad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:28.137785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b2919-6f51-4af5-9227-82719ed8cad4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:28.138069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b2919-6f51-4af5-9227-82719ed8cad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:28.138346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b2919-6f51-4af5-9227-82719ed8cad4 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:28.139008 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b2919-6f51-4af5-9227-82719ed8cad4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:28.139314 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b2919-6f51-4af5-9227-82719ed8cad4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:28.140742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b2919-6f51-4af5-9227-82719ed8cad4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:28.154016 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:28.167060 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 311/643] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:28.168897 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b2919-6f51-4af5-9227-82719ed8cad4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:28.174243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f4195-3c2d-4a04-845d-5f5aa3369d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:28.175507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f4195-3c2d-4a04-845d-5f5aa3369d21 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:28.176255 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f4195-3c2d-4a04-845d-5f5aa3369d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:28.176255 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f4195-3c2d-4a04-845d-5f5aa3369d21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:28.187476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f4195-3c2d-4a04-845d-5f5aa3369d21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-612f4195-3c2d-4a04-845d-5f5aa3369d21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:28.192881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:28.194140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:28.195476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:28.195476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:28.195476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:28.195476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:28.195476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:28.195476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:28.195476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:28.195476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:28.195476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:28.195476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:28.195476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:28.195476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:28.195476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 333/644] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:28.195476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f4195-3c2d-4a04-845d-5f5aa3369d21 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:28.326846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f4195-3c2d-4a04-845d-5f5aa3369d21 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:28.332656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b2919-6f51-4af5-9227-82719ed8cad4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:28.367173 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492c267-a2d7-4a0a-b197-8309c1652976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:28.368159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c267-a2d7-4a0a-b197-8309c1652976 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:28.368526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c267-a2d7-4a0a-b197-8309c1652976 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:28.368930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c267-a2d7-4a0a-b197-8309c1652976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:28.386851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492c267-a2d7-4a0a-b197-8309c1652976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:28.389188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492c267-a2d7-4a0a-b197-8309c1652976 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:28.390179 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd314e0-10d9-416f-b9f8-9d21895c8fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:28.390827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd314e0-10d9-416f-b9f8-9d21895c8fac None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:28.391110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd314e0-10d9-416f-b9f8-9d21895c8fac None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:28.391384 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd314e0-10d9-416f-b9f8-9d21895c8fac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:28.400247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd314e0-10d9-416f-b9f8-9d21895c8fac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:28.402174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd314e0-10d9-416f-b9f8-9d21895c8fac None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-fbd314e0-10d9-416f-b9f8-9d21895c8fac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:28.417124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:28.418596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:28.419778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:28.419778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:28.419778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:28.419778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:28.419778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:28.419778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:28.419778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:28.419778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:28.419778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:50:28.419778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:28.419778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 312/645] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:50:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:28.419778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd314e0-10d9-416f-b9f8-9d21895c8fac None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-8492c267-a2d7-4a0a-b197-8309c1652976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:28.432486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:28.434045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:28.435347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:28.435347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:28.435347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:28.443310 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 334/646] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:28.443310 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492c267-a2d7-4a0a-b197-8309c1652976 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:28.443561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:28.490570 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:28.561446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd314e0-10d9-416f-b9f8-9d21895c8fac None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:28.604250 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e18de-eeba-4736-bfc6-516a1f2ecdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:28.605273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e18de-eeba-4736-bfc6-516a1f2ecdec None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:28.605739 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e18de-eeba-4736-bfc6-516a1f2ecdec None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:28.606275 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e18de-eeba-4736-bfc6-516a1f2ecdec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:28.614260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e18de-eeba-4736-bfc6-516a1f2ecdec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:28.616203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e18de-eeba-4736-bfc6-516a1f2ecdec None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:28.622435 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492c267-a2d7-4a0a-b197-8309c1652976 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:28.630095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-f46e18de-eeba-4736-bfc6-516a1f2ecdec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:28.630095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:28.630095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:28.630095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:28.630095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:28.630095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:28.630095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:28.630095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:28.630095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:28.630095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:28.630095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:28.630095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:28.630095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:28.630095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:28.630095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:28.631036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:28.632101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:28.632101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:28.632101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:28.632101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:28.632101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:28.632101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:28.632101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:28.632101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:28.641965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 313/647] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:28.641965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e18de-eeba-4736-bfc6-516a1f2ecdec None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:28.679280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6edde4-0392-490f-941a-941b0aa2a3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:28.680015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6edde4-0392-490f-941a-941b0aa2a3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:28.680339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6edde4-0392-490f-941a-941b0aa2a3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:28.680562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6edde4-0392-490f-941a-941b0aa2a3d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:28.681953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6edde4-0392-490f-941a-941b0aa2a3d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:28.681953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6edde4-0392-490f-941a-941b0aa2a3d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:28.690029 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6edde4-0392-490f-941a-941b0aa2a3d1 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:28.703996 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 335/648] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:28.705795 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6edde4-0392-490f-941a-941b0aa2a3d1 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:28.733814 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:28.777003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e18de-eeba-4736-bfc6-516a1f2ecdec None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:28.818120 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4528d-ed84-4d34-9033-bb0ddd81f4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:28.819042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4528d-ed84-4d34-9033-bb0ddd81f4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:28.819321 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4528d-ed84-4d34-9033-bb0ddd81f4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:28.819592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4528d-ed84-4d34-9033-bb0ddd81f4d8 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:28.820368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4528d-ed84-4d34-9033-bb0ddd81f4d8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:28.820694 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4528d-ed84-4d34-9033-bb0ddd81f4d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:28.822124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4528d-ed84-4d34-9033-bb0ddd81f4d8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:28.843478 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 314/649] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Aug 7 00:50:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:28.850767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4528d-ed84-4d34-9033-bb0ddd81f4d8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:28.852315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:28.868656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6edde4-0392-490f-941a-941b0aa2a3d1 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:28.910969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5527f-40ba-49a9-9865-8e4d9db27d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:28.911693 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5527f-40ba-49a9-9865-8e4d9db27d3d None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:28.912103 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5527f-40ba-49a9-9865-8e4d9db27d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:28.912468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5527f-40ba-49a9-9865-8e4d9db27d3d None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:28.913243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5527f-40ba-49a9-9865-8e4d9db27d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:28.913644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5527f-40ba-49a9-9865-8e4d9db27d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:28.915124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5527f-40ba-49a9-9865-8e4d9db27d3d None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:28.933607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 336/650] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:28.933607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5527f-40ba-49a9-9865-8e4d9db27d3d None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:28.995763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4528d-ed84-4d34-9033-bb0ddd81f4d8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:29.027672 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:29.040798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a2024-4a6e-4401-83a8-7040cddc6759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:29.041976 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a2024-4a6e-4401-83a8-7040cddc6759 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:29.042581 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a2024-4a6e-4401-83a8-7040cddc6759 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:29.043127 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a2024-4a6e-4401-83a8-7040cddc6759 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:29.044627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a2024-4a6e-4401-83a8-7040cddc6759 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:29.045255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a2024-4a6e-4401-83a8-7040cddc6759 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:29.047623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a2024-4a6e-4401-83a8-7040cddc6759 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:29.076628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 315/651] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:29.076628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a2024-4a6e-4401-83a8-7040cddc6759 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:29.098251 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5527f-40ba-49a9-9865-8e4d9db27d3d None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:29.137465 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863b835-a12d-4e63-a2cc-df4dd78d9f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:29.138600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863b835-a12d-4e63-a2cc-df4dd78d9f01 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:29.139043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863b835-a12d-4e63-a2cc-df4dd78d9f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:29.139321 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863b835-a12d-4e63-a2cc-df4dd78d9f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:29.152327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863b835-a12d-4e63-a2cc-df4dd78d9f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:29.153843 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863b835-a12d-4e63-a2cc-df4dd78d9f01 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-2863b835-a12d-4e63-a2cc-df4dd78d9f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:29.177276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:29.178786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:29.180422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:29.180422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:29.180422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:29.180422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 337/652] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:29.180821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863b835-a12d-4e63-a2cc-df4dd78d9f01 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:29.185267 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:29.210263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a2024-4a6e-4401-83a8-7040cddc6759 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:29.255673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31f434-5eca-458c-9134-ac428b0176d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:29.256621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31f434-5eca-458c-9134-ac428b0176d5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:29.256996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31f434-5eca-458c-9134-ac428b0176d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:29.257360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31f434-5eca-458c-9134-ac428b0176d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:29.313898 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863b835-a12d-4e63-a2cc-df4dd78d9f01 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:29.327201 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:29.342119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31f434-5eca-458c-9134-ac428b0176d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:29.343572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31f434-5eca-458c-9134-ac428b0176d5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:29.367821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513071aa-057a-489c-b324-1b10b00f5a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:29.368970 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513071aa-057a-489c-b324-1b10b00f5a49 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:29.369440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513071aa-057a-489c-b324-1b10b00f5a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:29.369906 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513071aa-057a-489c-b324-1b10b00f5a49 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:29.382479 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513071aa-057a-489c-b324-1b10b00f5a49 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:29.383976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513071aa-057a-489c-b324-1b10b00f5a49 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-513071aa-057a-489c-b324-1b10b00f5a49 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:29.396836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:29.398826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:29.400752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:29.400752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:29.400752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:29.400752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:29.400752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:29.400752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:29.400752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:29.400752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:29.400752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:50:29.400752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:29.400752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 338/653] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Aug 7 00:50:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:29.400752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513071aa-057a-489c-b324-1b10b00f5a49 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:29.475233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:29.490633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 316/654] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:50:29.492773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022bea-47e7-4af1-bf3a-47e02b29a577 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:29.493146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022bea-47e7-4af1-bf3a-47e02b29a577 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:29.493520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022bea-47e7-4af1-bf3a-47e02b29a577 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:29.495532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 317/655] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:29.496790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0022bea-47e7-4af1-bf3a-47e02b29a577 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:29.534861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513071aa-057a-489c-b324-1b10b00f5a49 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:29.577395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b034c-b2ca-46f2-9272-86d8c21c4edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:29.578025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b034c-b2ca-46f2-9272-86d8c21c4edc None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:29.578305 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b034c-b2ca-46f2-9272-86d8c21c4edc None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:29.578578 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b034c-b2ca-46f2-9272-86d8c21c4edc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:29.579332 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b034c-b2ca-46f2-9272-86d8c21c4edc None admin] RBAC: Adding query filter params (role.id=05605552a8ef41ce895f7d776aefd260, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=345c25e7dd2341bcb4c53d0a5aa36b9d) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:29.579649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b034c-b2ca-46f2-9272-86d8c21c4edc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:29.581586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b034c-b2ca-46f2-9272-86d8c21c4edc None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:29.595004 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 339/656] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:29 2022] GET /identity/v3/role_assignments?user.id=345c25e7dd2341bcb4c53d0a5aa36b9d&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=05605552a8ef41ce895f7d776aefd260 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:29.597576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b034c-b2ca-46f2-9272-86d8c21c4edc None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:29.654290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:29.678259 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0022bea-47e7-4af1-bf3a-47e02b29a577 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:29.794072 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b034c-b2ca-46f2-9272-86d8c21c4edc None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:29.832366 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:29.849024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807c872-2922-45bc-a06d-f16eba72e5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:29.850064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807c872-2922-45bc-a06d-f16eba72e5de None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:29.850396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807c872-2922-45bc-a06d-f16eba72e5de None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:29.850780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807c872-2922-45bc-a06d-f16eba72e5de None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:29.851977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807c872-2922-45bc-a06d-f16eba72e5de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:29.852304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807c872-2922-45bc-a06d-f16eba72e5de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:29.854067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807c872-2922-45bc-a06d-f16eba72e5de None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:29.861611 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5ef70-5cdf-4e67-9070-9d3e42501859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:29.863434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5ef70-5cdf-4e67-9070-9d3e42501859 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:29.863434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5ef70-5cdf-4e67-9070-9d3e42501859 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:29.863751 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5ef70-5cdf-4e67-9070-9d3e42501859 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:29.864488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5ef70-5cdf-4e67-9070-9d3e42501859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:29.864795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5ef70-5cdf-4e67-9070-9d3e42501859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:29.866192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5ef70-5cdf-4e67-9070-9d3e42501859 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:29.879026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 340/657] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Aug 7 00:50:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:29.879977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807c872-2922-45bc-a06d-f16eba72e5de None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:29.880545 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 318/658] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:29.881969 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67a3ac-b599-49ee-9b16-e0006cee8bb3 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:29.882316 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67a3ac-b599-49ee-9b16-e0006cee8bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:29.882591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67a3ac-b599-49ee-9b16-e0006cee8bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:29.904640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-8b67a3ac-b599-49ee-9b16-e0006cee8bb3 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:29.906165 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8b67a3ac-b599-49ee-9b16-e0006cee8bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:30.008150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 319/659] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:30.008150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67a3ac-b599-49ee-9b16-e0006cee8bb3 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:30.038927 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807c872-2922-45bc-a06d-f16eba72e5de None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:30.090007 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded44b1-7790-41b5-8aa0-a9a2fd7e0b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:30.090646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded44b1-7790-41b5-8aa0-a9a2fd7e0b24 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:30.090977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded44b1-7790-41b5-8aa0-a9a2fd7e0b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:30.091299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded44b1-7790-41b5-8aa0-a9a2fd7e0b24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:30.104850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded44b1-7790-41b5-8aa0-a9a2fd7e0b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:30.106562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded44b1-7790-41b5-8aa0-a9a2fd7e0b24 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-fded44b1-7790-41b5-8aa0-a9a2fd7e0b24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:30.129654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:30.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:30.131951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:30.131951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:30.131951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:30.133626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 341/660] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:30.134700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded44b1-7790-41b5-8aa0-a9a2fd7e0b24 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:30.157368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:30.189684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:30.196552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67a3ac-b599-49ee-9b16-e0006cee8bb3 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:30.244669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b962eb-391e-451f-84d5-f6edaef09da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:30.245293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b962eb-391e-451f-84d5-f6edaef09da0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:30.245568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b962eb-391e-451f-84d5-f6edaef09da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:30.245834 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b962eb-391e-451f-84d5-f6edaef09da0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:30.282669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded44b1-7790-41b5-8aa0-a9a2fd7e0b24 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:30.325100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c52d3-7875-41fb-9678-b679593371e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:30.325729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c52d3-7875-41fb-9678-b679593371e0 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:30.326011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c52d3-7875-41fb-9678-b679593371e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:30.326277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c52d3-7875-41fb-9678-b679593371e0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:30.335121 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c52d3-7875-41fb-9678-b679593371e0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:30.336774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c52d3-7875-41fb-9678-b679593371e0 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:30.341917 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b962eb-391e-451f-84d5-f6edaef09da0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:30.343406 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b962eb-391e-451f-84d5-f6edaef09da0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-815c52d3-7875-41fb-9678-b679593371e0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:30.352149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:30.353411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:30.354869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:30.354869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:30.354869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:30.354869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:30.354869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:30.354869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:30.354869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:30.354869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:30.354869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:50:30.354869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:30.354869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 342/661] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:30.354869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c52d3-7875-41fb-9678-b679593371e0 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:30.450333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:30.480999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 320/662] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:50:30.482095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b962eb-391e-451f-84d5-f6edaef09da0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:30.520811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:30.530193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c52d3-7875-41fb-9678-b679593371e0 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:30.579531 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eee42c-165f-4305-b3cf-dcec8ebabf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:30.580206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eee42c-165f-4305-b3cf-dcec8ebabf57 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:30.580501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eee42c-165f-4305-b3cf-dcec8ebabf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:30.581315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eee42c-165f-4305-b3cf-dcec8ebabf57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:30.593538 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eee42c-165f-4305-b3cf-dcec8ebabf57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-73eee42c-165f-4305-b3cf-dcec8ebabf57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:30.599637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:30.600864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:30.601879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:30.601879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:30.601879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:30.601879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:30.601879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:30.601879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:30.601879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:30.601879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:30.601879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:30.601879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:30.601879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:30.601879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:30.606104 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 343/663] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:30.607054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eee42c-165f-4305-b3cf-dcec8ebabf57 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:30.636648 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b962eb-391e-451f-84d5-f6edaef09da0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:30.697227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd26596-a6bf-4748-a354-2310cbfc3caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:30.698270 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd26596-a6bf-4748-a354-2310cbfc3caa None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:30.698825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd26596-a6bf-4748-a354-2310cbfc3caa None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:30.699163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd26596-a6bf-4748-a354-2310cbfc3caa None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:30.700212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd26596-a6bf-4748-a354-2310cbfc3caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:30.700762 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd26596-a6bf-4748-a354-2310cbfc3caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:30.703219 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd26596-a6bf-4748-a354-2310cbfc3caa None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:30.724806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 321/664] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:30.726348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd26596-a6bf-4748-a354-2310cbfc3caa None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:30.749234 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eee42c-165f-4305-b3cf-dcec8ebabf57 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:30.786587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:30.797560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d8174-52f4-4192-b124-51d06b67f608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:30.798183 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d8174-52f4-4192-b124-51d06b67f608 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:30.798516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d8174-52f4-4192-b124-51d06b67f608 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:30.798785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d8174-52f4-4192-b124-51d06b67f608 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:30.800173 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d8174-52f4-4192-b124-51d06b67f608 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:30.800484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d8174-52f4-4192-b124-51d06b67f608 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:30.801943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d8174-52f4-4192-b124-51d06b67f608 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:30.822072 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 344/665] 10.222.0.20 () {56 vars in 1139 bytes} [Sun Aug 7 00:50:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:30.822917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d8174-52f4-4192-b124-51d06b67f608 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:30.840874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:30.887373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd26596-a6bf-4748-a354-2310cbfc3caa None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:30.934787 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148f132-9848-4739-847e-f49d23491bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:30.935687 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f132-9848-4739-847e-f49d23491bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:30.936002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f132-9848-4739-847e-f49d23491bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:30.936263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f132-9848-4739-847e-f49d23491bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:30.940205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d8174-52f4-4192-b124-51d06b67f608 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:30.951990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148f132-9848-4739-847e-f49d23491bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:30.954056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148f132-9848-4739-847e-f49d23491bf9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-1148f132-9848-4739-847e-f49d23491bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:30.973163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:30.974537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:30.975555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:30.975555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:30.975555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:30.975555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 322/666] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:30.975555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148f132-9848-4739-847e-f49d23491bf9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:30.983693 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8ce60-db47-40f8-9650-7774bbbc6d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:30.984401 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8ce60-db47-40f8-9650-7774bbbc6d92 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:30.984676 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8ce60-db47-40f8-9650-7774bbbc6d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:30.984950 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8ce60-db47-40f8-9650-7774bbbc6d92 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:30.985630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8ce60-db47-40f8-9650-7774bbbc6d92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:30.985934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8ce60-db47-40f8-9650-7774bbbc6d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:30.987875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8ce60-db47-40f8-9650-7774bbbc6d92 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:31.000152 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 345/667] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:31.004944 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8ce60-db47-40f8-9650-7774bbbc6d92 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:31.081713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:31.100338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148f132-9848-4739-847e-f49d23491bf9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:31.106760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:31.145393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0651a6d-4894-48e1-9337-5af74654f381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:31.145942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0651a6d-4894-48e1-9337-5af74654f381 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:31.146213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0651a6d-4894-48e1-9337-5af74654f381 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:31.146594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0651a6d-4894-48e1-9337-5af74654f381 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:31.148507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8ce60-db47-40f8-9650-7774bbbc6d92 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:31.154377 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0651a6d-4894-48e1-9337-5af74654f381 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:31.156116 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0651a6d-4894-48e1-9337-5af74654f381 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:31.170366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-d0651a6d-4894-48e1-9337-5af74654f381 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:31.170366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:31.170366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:31.170366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:31.170366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:31.170366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:31.170366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:31.170366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:31.170366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:31.170366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:31.170366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:31.170366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:31.170366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:31.170366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:31.170366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:31.171420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:31.172586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:31.172586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:31.172586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:31.172586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:31.172586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:31.172586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:31.172586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:31.172586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:31.175283 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 323/668] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:31.176431 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0651a6d-4894-48e1-9337-5af74654f381 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:31.200510 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050c8f5-b378-4307-b493-3ff5a5359f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:31.201420 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050c8f5-b378-4307-b493-3ff5a5359f39 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:31.201746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050c8f5-b378-4307-b493-3ff5a5359f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:31.202083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050c8f5-b378-4307-b493-3ff5a5359f39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:31.306215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0651a6d-4894-48e1-9337-5af74654f381 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:31.306463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050c8f5-b378-4307-b493-3ff5a5359f39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:31.309223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050c8f5-b378-4307-b493-3ff5a5359f39 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:31.353902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02557124-2ab5-45ee-8c7b-a03f1f54c5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:31.354974 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02557124-2ab5-45ee-8c7b-a03f1f54c5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:31.355335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02557124-2ab5-45ee-8c7b-a03f1f54c5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:31.355629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02557124-2ab5-45ee-8c7b-a03f1f54c5a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:31.356528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02557124-2ab5-45ee-8c7b-a03f1f54c5a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:31.356842 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02557124-2ab5-45ee-8c7b-a03f1f54c5a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:31.358345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02557124-2ab5-45ee-8c7b-a03f1f54c5a8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:31.376398 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 324/669] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:31.378173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02557124-2ab5-45ee-8c7b-a03f1f54c5a8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:31.396353 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:31.446736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:31.479586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 346/670] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:50:31.481061 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050c8f5-b378-4307-b493-3ff5a5359f39 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:31.556801 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02557124-2ab5-45ee-8c7b-a03f1f54c5a8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:31.603594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21573f3-e870-4b42-8a8e-e532338b8b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:31.604366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21573f3-e870-4b42-8a8e-e532338b8b71 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:31.604716 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21573f3-e870-4b42-8a8e-e532338b8b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:31.605060 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21573f3-e870-4b42-8a8e-e532338b8b71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:31.620940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21573f3-e870-4b42-8a8e-e532338b8b71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:31.622884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21573f3-e870-4b42-8a8e-e532338b8b71 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:31.634503 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050c8f5-b378-4307-b493-3ff5a5359f39 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-f21573f3-e870-4b42-8a8e-e532338b8b71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:31.649437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:31.651700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:31.653626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:31.653626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:31.653626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:31.655961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 325/671] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:31.656520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21573f3-e870-4b42-8a8e-e532338b8b71 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:31.683199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910256-a7da-4806-8b1a-6e0e6fa1ec77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:31.684127 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910256-a7da-4806-8b1a-6e0e6fa1ec77 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:31.684508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910256-a7da-4806-8b1a-6e0e6fa1ec77 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:31.684792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910256-a7da-4806-8b1a-6e0e6fa1ec77 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:31.685505 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e910256-a7da-4806-8b1a-6e0e6fa1ec77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:31.685814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e910256-a7da-4806-8b1a-6e0e6fa1ec77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:31.687306 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e910256-a7da-4806-8b1a-6e0e6fa1ec77 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:31.704637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 347/672] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:31.706028 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910256-a7da-4806-8b1a-6e0e6fa1ec77 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:31.736502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:31.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:31.785011 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21573f3-e870-4b42-8a8e-e532338b8b71 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:31.826236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c30e02-2181-4403-85cd-c17e65d02fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:31.827193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c30e02-2181-4403-85cd-c17e65d02fdb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:31.827650 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c30e02-2181-4403-85cd-c17e65d02fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:31.828104 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c30e02-2181-4403-85cd-c17e65d02fdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:31.829883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910256-a7da-4806-8b1a-6e0e6fa1ec77 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:31.837492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c30e02-2181-4403-85cd-c17e65d02fdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:31.839515 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c30e02-2181-4403-85cd-c17e65d02fdb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:31.852360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-a3c30e02-2181-4403-85cd-c17e65d02fdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:31.852360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:31.852360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:31.852360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:31.852360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:31.852360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:31.852360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:31.852360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:31.852360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:31.852360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:31.852360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:31.852360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:31.852360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:31.852360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:31.852360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:31.859154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:31.860600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:31.860600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:31.860600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:31.860600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:31.860600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:31.860600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:31.860600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:31.860600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:31.860600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 326/673] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:31.860600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c30e02-2181-4403-85cd-c17e65d02fdb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:31.878388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401f817-5462-4d51-a22c-f91970aaccba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:31.879134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401f817-5462-4d51-a22c-f91970aaccba None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:31.879408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401f817-5462-4d51-a22c-f91970aaccba None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:31.879676 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401f817-5462-4d51-a22c-f91970aaccba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:31.891346 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401f817-5462-4d51-a22c-f91970aaccba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:31.892883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401f817-5462-4d51-a22c-f91970aaccba None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-9401f817-5462-4d51-a22c-f91970aaccba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:31.909860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:31.911097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:31.912201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:31.912201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:31.912201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:31.912201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 348/674] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:31.912201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401f817-5462-4d51-a22c-f91970aaccba None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:31.978392 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c30e02-2181-4403-85cd-c17e65d02fdb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:32.007334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:32.021133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:32.023320 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80c47-d39b-4468-a7b6-0d25e6f0a5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:32.024061 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80c47-d39b-4468-a7b6-0d25e6f0a5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:32.024436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80c47-d39b-4468-a7b6-0d25e6f0a5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:32.024781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d80c47-d39b-4468-a7b6-0d25e6f0a5e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:32.025601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d80c47-d39b-4468-a7b6-0d25e6f0a5e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:32.025957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d80c47-d39b-4468-a7b6-0d25e6f0a5e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:32.027666 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d80c47-d39b-4468-a7b6-0d25e6f0a5e5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:32.038439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401f817-5462-4d51-a22c-f91970aaccba None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:32.044386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 327/675] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:32.050149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80c47-d39b-4468-a7b6-0d25e6f0a5e5 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:32.083395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b596770-a823-43b8-af00-e3ba8a2aa97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:32.084189 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b596770-a823-43b8-af00-e3ba8a2aa97b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:32.084522 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b596770-a823-43b8-af00-e3ba8a2aa97b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:32.084976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b596770-a823-43b8-af00-e3ba8a2aa97b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:32.085797 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b596770-a823-43b8-af00-e3ba8a2aa97b None admin] RBAC: Adding query filter params (role.id=05605552a8ef41ce895f7d776aefd260, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=803d0ab121784d688b58374aaa6a8e7c) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:32.086078 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b596770-a823-43b8-af00-e3ba8a2aa97b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:32.087928 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b596770-a823-43b8-af00-e3ba8a2aa97b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:32.103940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 349/676] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:31 2022] GET /identity/v3/role_assignments?user.id=803d0ab121784d688b58374aaa6a8e7c&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=05605552a8ef41ce895f7d776aefd260 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:32.103940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b596770-a823-43b8-af00-e3ba8a2aa97b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:32.198338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d80c47-d39b-4468-a7b6-0d25e6f0a5e5 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:32.245330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ee4ea-6700-4ae7-bce9-5369af313c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:32.246628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ee4ea-6700-4ae7-bce9-5369af313c36 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:32.247204 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ee4ea-6700-4ae7-bce9-5369af313c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:32.247781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ee4ea-6700-4ae7-bce9-5369af313c36 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:32.249221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ee4ea-6700-4ae7-bce9-5369af313c36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:32.250173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ee4ea-6700-4ae7-bce9-5369af313c36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:32.253847 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ee4ea-6700-4ae7-bce9-5369af313c36 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:32.261467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b596770-a823-43b8-af00-e3ba8a2aa97b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:32.287609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 328/677] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:32.289435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ee4ea-6700-4ae7-bce9-5369af313c36 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:32.306079 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6d634-5b53-4cb3-99e9-9d5613ab38c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:32.306973 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6d634-5b53-4cb3-99e9-9d5613ab38c6 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:32.307407 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6d634-5b53-4cb3-99e9-9d5613ab38c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:32.307830 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6d634-5b53-4cb3-99e9-9d5613ab38c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:32.308688 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6d634-5b53-4cb3-99e9-9d5613ab38c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:32.309167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6d634-5b53-4cb3-99e9-9d5613ab38c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:32.310616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6d634-5b53-4cb3-99e9-9d5613ab38c6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:32.327697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 350/678] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:32.329913 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6d634-5b53-4cb3-99e9-9d5613ab38c6 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:32.355106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:32.368201 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:32.459379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ee4ea-6700-4ae7-bce9-5369af313c36 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:32.511761 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6d634-5b53-4cb3-99e9-9d5613ab38c6 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:32.516416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342f5fe-0d68-4fca-8bea-75a3e105cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:32.517530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342f5fe-0d68-4fca-8bea-75a3e105cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:32.517888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342f5fe-0d68-4fca-8bea-75a3e105cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:32.518708 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342f5fe-0d68-4fca-8bea-75a3e105cfd6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:32.531870 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342f5fe-0d68-4fca-8bea-75a3e105cfd6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:32.533711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342f5fe-0d68-4fca-8bea-75a3e105cfd6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-9342f5fe-0d68-4fca-8bea-75a3e105cfd6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:32.547030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:32.548995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:32.553496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:32.553496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:32.553496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:32.553496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:32.553496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:32.553496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:32.553496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:32.553496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:32.553496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:50:32.553496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:32.553496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 329/679] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:50:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:32.553496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342f5fe-0d68-4fca-8bea-75a3e105cfd6 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:32.576064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2398206-7ee4-4d7b-8340-03e89d8581ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:32.576706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2398206-7ee4-4d7b-8340-03e89d8581ce None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:32.577557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2398206-7ee4-4d7b-8340-03e89d8581ce None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:32.577860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2398206-7ee4-4d7b-8340-03e89d8581ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:32.578683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2398206-7ee4-4d7b-8340-03e89d8581ce None admin] RBAC: Adding query filter params (role.id=05605552a8ef41ce895f7d776aefd260, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=20b8a995891f46f1ab1672836752cc4e) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:32.578952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2398206-7ee4-4d7b-8340-03e89d8581ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:32.581095 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2398206-7ee4-4d7b-8340-03e89d8581ce None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:32.590020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 351/680] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:32 2022] GET /identity/v3/role_assignments?user.id=20b8a995891f46f1ab1672836752cc4e&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=05605552a8ef41ce895f7d776aefd260 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:32.590221 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02960ce9-9c8a-4040-8632-60303368e7ba None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:32.590571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02960ce9-9c8a-4040-8632-60303368e7ba None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:32.590846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02960ce9-9c8a-4040-8632-60303368e7ba None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:32.599628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 352/681] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:32.599628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02960ce9-9c8a-4040-8632-60303368e7ba None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:32.775569 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:32.776586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342f5fe-0d68-4fca-8bea-75a3e105cfd6 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:32.778492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:32.819542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02960ce9-9c8a-4040-8632-60303368e7ba None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:32.823759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce07d46-54b3-4691-80e0-4b7fcf4d8df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:32.824713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce07d46-54b3-4691-80e0-4b7fcf4d8df2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:32.824836 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce07d46-54b3-4691-80e0-4b7fcf4d8df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:32.825010 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce07d46-54b3-4691-80e0-4b7fcf4d8df2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:32.834084 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce07d46-54b3-4691-80e0-4b7fcf4d8df2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:32.835545 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce07d46-54b3-4691-80e0-4b7fcf4d8df2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:32.847692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-6ce07d46-54b3-4691-80e0-4b7fcf4d8df2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:32.847692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:32.847692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:32.847692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:32.847692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:32.847692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:32.847692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:32.847692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:32.847692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:32.847692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:32.847692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:32.847692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:32.847692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:32.847692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:32.847692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:32.849596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:32.851387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:32.851387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:32.851387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:32.851387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:32.851387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:32.851387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:32.851387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:32.851387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:32.855684 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 330/682] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:32.856050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29cf40-0b41-4b93-9988-8b9ce002b15b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:32.856319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29cf40-0b41-4b93-9988-8b9ce002b15b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:32.856750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29cf40-0b41-4b93-9988-8b9ce002b15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:32.881436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-eb29cf40-0b41-4b93-9988-8b9ce002b15b None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:32.882657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-eb29cf40-0b41-4b93-9988-8b9ce002b15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:32.885633 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1a52b-8a23-4660-83a4-af2ca68545b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:32.886869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1a52b-8a23-4660-83a4-af2ca68545b2 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:32.887286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1a52b-8a23-4660-83a4-af2ca68545b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:32.887627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1a52b-8a23-4660-83a4-af2ca68545b2 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:32.890162 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1a52b-8a23-4660-83a4-af2ca68545b2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:32.890803 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1a52b-8a23-4660-83a4-af2ca68545b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:32.893543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1a52b-8a23-4660-83a4-af2ca68545b2 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:32.930801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 353/683] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Aug 7 00:50:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:32.932670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1a52b-8a23-4660-83a4-af2ca68545b2 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:32.993828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 331/684] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:32.995267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29cf40-0b41-4b93-9988-8b9ce002b15b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:33.108463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1a52b-8a23-4660-83a4-af2ca68545b2 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:33.162711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62651e4f-c41a-4448-80b9-c51a95f5d995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:33.163286 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:33.163497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62651e4f-c41a-4448-80b9-c51a95f5d995 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:33.163771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62651e4f-c41a-4448-80b9-c51a95f5d995 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:33.164118 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62651e4f-c41a-4448-80b9-c51a95f5d995 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:33.165596 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62651e4f-c41a-4448-80b9-c51a95f5d995 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:33.165949 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62651e4f-c41a-4448-80b9-c51a95f5d995 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:33.168220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62651e4f-c41a-4448-80b9-c51a95f5d995 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:33.170468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:33.184003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29cf40-0b41-4b93-9988-8b9ce002b15b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:33.191948 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 354/685] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:33.191948 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62651e4f-c41a-4448-80b9-c51a95f5d995 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:33.257002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6599e1e-9799-491b-9e95-0d1efd530488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:33.257763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6599e1e-9799-491b-9e95-0d1efd530488 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:33.258175 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6599e1e-9799-491b-9e95-0d1efd530488 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:33.258499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6599e1e-9799-491b-9e95-0d1efd530488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:33.385357 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62651e4f-c41a-4448-80b9-c51a95f5d995 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:33.414979 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6599e1e-9799-491b-9e95-0d1efd530488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:33.417770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6599e1e-9799-491b-9e95-0d1efd530488 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:33.441624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808c4ef-f166-45d1-b5b0-d48aec442eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:33.443218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808c4ef-f166-45d1-b5b0-d48aec442eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:33.443715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808c4ef-f166-45d1-b5b0-d48aec442eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:33.444184 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808c4ef-f166-45d1-b5b0-d48aec442eb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:33.460673 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808c4ef-f166-45d1-b5b0-d48aec442eb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:33.463257 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808c4ef-f166-45d1-b5b0-d48aec442eb0 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-4808c4ef-f166-45d1-b5b0-d48aec442eb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:33.489869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:33.491327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:33.492614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:33.492614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:33.492614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:33.492614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 355/686] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:33.493801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808c4ef-f166-45d1-b5b0-d48aec442eb0 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:33.579260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:33.585453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:33.593415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 332/687] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:50:33.594817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6599e1e-9799-491b-9e95-0d1efd530488 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:33.686252 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808c4ef-f166-45d1-b5b0-d48aec442eb0 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:33.709547 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6599e1e-9799-491b-9e95-0d1efd530488 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:33.749108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b169f-0751-442e-8074-1eed26616edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:33.749529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc12f3a-aefc-4d7f-97da-fb0eae37bf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:33.750000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b169f-0751-442e-8074-1eed26616edb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:33.750387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b169f-0751-442e-8074-1eed26616edb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:33.750560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc12f3a-aefc-4d7f-97da-fb0eae37bf62 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:33.750863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b169f-0751-442e-8074-1eed26616edb None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:33.751027 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc12f3a-aefc-4d7f-97da-fb0eae37bf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:33.751401 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc12f3a-aefc-4d7f-97da-fb0eae37bf62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:33.751785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b169f-0751-442e-8074-1eed26616edb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:33.752213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b169f-0751-442e-8074-1eed26616edb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:33.753407 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc12f3a-aefc-4d7f-97da-fb0eae37bf62 None admin] RBAC: Adding query filter params (role.id=05605552a8ef41ce895f7d776aefd260, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=e393d9c50bbb4f69a48ae635d13b1197) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:33.754180 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc12f3a-aefc-4d7f-97da-fb0eae37bf62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:33.754415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b169f-0751-442e-8074-1eed26616edb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:33.756856 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc12f3a-aefc-4d7f-97da-fb0eae37bf62 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:33.767975 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 333/688] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:33.769169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b169f-0751-442e-8074-1eed26616edb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:33.773713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 356/689] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:33 2022] GET /identity/v3/role_assignments?user.id=e393d9c50bbb4f69a48ae635d13b1197&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=05605552a8ef41ce895f7d776aefd260 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:33.775177 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc12f3a-aefc-4d7f-97da-fb0eae37bf62 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:33.835387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:33.895693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b169f-0751-442e-8074-1eed26616edb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:33.936860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57b85a-306b-463e-87c2-9619d38ee7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:33.937485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57b85a-306b-463e-87c2-9619d38ee7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:33.937770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57b85a-306b-463e-87c2-9619d38ee7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:33.938051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57b85a-306b-463e-87c2-9619d38ee7a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:33.951688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57b85a-306b-463e-87c2-9619d38ee7a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:33.953206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57b85a-306b-463e-87c2-9619d38ee7a4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-4d57b85a-306b-463e-87c2-9619d38ee7a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:33.970080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:33.973605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:33.975174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:33.975174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:33.975174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:33.976319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 334/690] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:33.979282 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57b85a-306b-463e-87c2-9619d38ee7a4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:34.130591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57b85a-306b-463e-87c2-9619d38ee7a4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:34.136110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:34.142009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc12f3a-aefc-4d7f-97da-fb0eae37bf62 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:34.157405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:34.183872 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386186cf-77fc-4311-a7bf-ef6d62645d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:34.184533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386186cf-77fc-4311-a7bf-ef6d62645d64 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:34.184816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386186cf-77fc-4311-a7bf-ef6d62645d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:34.185085 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386186cf-77fc-4311-a7bf-ef6d62645d64 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:34.185743 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386186cf-77fc-4311-a7bf-ef6d62645d64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:34.186045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386186cf-77fc-4311-a7bf-ef6d62645d64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:34.187504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386186cf-77fc-4311-a7bf-ef6d62645d64 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:34.199055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95721027-3952-42d1-a6f1-7aa0b363d422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:34.200839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95721027-3952-42d1-a6f1-7aa0b363d422 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:34.201340 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95721027-3952-42d1-a6f1-7aa0b363d422 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:34.201930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95721027-3952-42d1-a6f1-7aa0b363d422 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:34.202767 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95721027-3952-42d1-a6f1-7aa0b363d422 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:34.207989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95721027-3952-42d1-a6f1-7aa0b363d422 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:34.216778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 335/691] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:34.223278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386186cf-77fc-4311-a7bf-ef6d62645d64 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:34.238185 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 357/692] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:50:33 2022] POST /identity/v3/users => generated 254 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:50:34.391426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386186cf-77fc-4311-a7bf-ef6d62645d64 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:34.435687 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cec102-4d78-4052-b560-16f5b9fd7953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:34.436381 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cec102-4d78-4052-b560-16f5b9fd7953 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:34.436713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cec102-4d78-4052-b560-16f5b9fd7953 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:34.436999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cec102-4d78-4052-b560-16f5b9fd7953 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:34.446315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cec102-4d78-4052-b560-16f5b9fd7953 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:34.447886 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cec102-4d78-4052-b560-16f5b9fd7953 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:34.461341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-11cec102-4d78-4052-b560-16f5b9fd7953 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:34.461341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:34.461341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:34.461341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:34.461341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:34.461341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:34.461341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:34.461341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:34.461341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:34.461341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:34.461341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:34.461341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:34.461341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:34.461341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:34.461341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:34.463185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:34.464885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:34.464885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:34.464885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:34.464885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:34.464885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:34.464885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:34.464885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:34.464885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:34.464885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 336/693] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:34.468881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95721027-3952-42d1-a6f1-7aa0b363d422 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:34.575473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdca2b6-ae79-4f52-94fb-e7ee10edf832 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:34.575923 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdca2b6-ae79-4f52-94fb-e7ee10edf832 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:34.576081 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdca2b6-ae79-4f52-94fb-e7ee10edf832 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:34.579002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 337/694] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:34.583805 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c829d19-af02-4464-bcdf-fad1aafe8e6e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:34.584113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c829d19-af02-4464-bcdf-fad1aafe8e6e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:34.584415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c829d19-af02-4464-bcdf-fad1aafe8e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:34.606585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9c829d19-af02-4464-bcdf-fad1aafe8e6e None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:34.607815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9c829d19-af02-4464-bcdf-fad1aafe8e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:34.633411 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:34.647280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95721027-3952-42d1-a6f1-7aa0b363d422 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:34.697946 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de769e-20bd-4324-81a3-bac6d064f962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:34.698536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de769e-20bd-4324-81a3-bac6d064f962 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:34.698813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de769e-20bd-4324-81a3-bac6d064f962 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:34.699083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de769e-20bd-4324-81a3-bac6d064f962 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:34.699846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de769e-20bd-4324-81a3-bac6d064f962 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:34.700230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de769e-20bd-4324-81a3-bac6d064f962 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:34.701669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de769e-20bd-4324-81a3-bac6d064f962 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:34.723738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 358/696] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:34.724128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 338/696] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:50:34.733353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de769e-20bd-4324-81a3-bac6d064f962 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:34.746675 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c829d19-af02-4464-bcdf-fad1aafe8e6e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:34.797328 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:34.890593 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c829d19-af02-4464-bcdf-fad1aafe8e6e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:34.891233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de769e-20bd-4324-81a3-bac6d064f962 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:34.942637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46cea0-983a-4526-ac35-6b4132b4b3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:34.944113 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46cea0-983a-4526-ac35-6b4132b4b3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:34.945121 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46cea0-983a-4526-ac35-6b4132b4b3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:34.946182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46cea0-983a-4526-ac35-6b4132b4b3a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:34.947430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46cea0-983a-4526-ac35-6b4132b4b3a9 None admin] RBAC: Adding query filter params (role.id=05605552a8ef41ce895f7d776aefd260, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=04ad38e3598f4b15b74398dbdb9e69b3) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:34.947748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46cea0-983a-4526-ac35-6b4132b4b3a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:34.949801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46cea0-983a-4526-ac35-6b4132b4b3a9 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:34.950699 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc1954-3db7-4dcb-a878-394a2dc46b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:34.951599 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc1954-3db7-4dcb-a878-394a2dc46b66 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:34.952244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc1954-3db7-4dcb-a878-394a2dc46b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:34.952719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc1954-3db7-4dcb-a878-394a2dc46b66 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:34.953549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc1954-3db7-4dcb-a878-394a2dc46b66 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:34.955265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc1954-3db7-4dcb-a878-394a2dc46b66 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:34.963934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 359/697] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:34 2022] GET /identity/v3/role_assignments?user.id=04ad38e3598f4b15b74398dbdb9e69b3&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=05605552a8ef41ce895f7d776aefd260 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-bfcc1954-3db7-4dcb-a878-394a2dc46b66 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:34.977876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:34.979113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:34.980540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:34.980540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:34.980540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:34.980540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:34.980540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:34.980540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:34.980540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:34.980540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:34.980540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:34.980540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:34.980540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:50:34.980540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:34.980540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:50:34.980540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:34.983558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 339/698] 10.222.0.20 () {56 vars in 1129 bytes} [Sun Aug 7 00:50:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:34.986499 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46cea0-983a-4526-ac35-6b4132b4b3a9 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:35.123668 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:35.140788 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46cea0-983a-4526-ac35-6b4132b4b3a9 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:35.206475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2b89a-59c6-45cb-8bf4-0d80b3f2963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:35.207423 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2b89a-59c6-45cb-8bf4-0d80b3f2963d None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:35.207945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2b89a-59c6-45cb-8bf4-0d80b3f2963d None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:35.208364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2b89a-59c6-45cb-8bf4-0d80b3f2963d None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:35.209181 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2b89a-59c6-45cb-8bf4-0d80b3f2963d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:35.209702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2b89a-59c6-45cb-8bf4-0d80b3f2963d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:35.212272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2b89a-59c6-45cb-8bf4-0d80b3f2963d None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:35.226328 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 360/699] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Aug 7 00:50:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:35.231395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc1954-3db7-4dcb-a878-394a2dc46b66 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:35.266318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:35.392277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc1954-3db7-4dcb-a878-394a2dc46b66 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:35.431971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad1308-634d-4953-9160-1a62d16a4fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:35.432961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad1308-634d-4953-9160-1a62d16a4fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:35.433447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad1308-634d-4953-9160-1a62d16a4fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:35.433944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad1308-634d-4953-9160-1a62d16a4fa6 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:35.434841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad1308-634d-4953-9160-1a62d16a4fa6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:35.435356 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad1308-634d-4953-9160-1a62d16a4fa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:35.436981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad1308-634d-4953-9160-1a62d16a4fa6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:35.445309 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 340/700] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Aug 7 00:50:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:35.553361 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f72ddf-f941-4c9f-997b-3e986c4e6ce3 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:35.553568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f72ddf-f941-4c9f-997b-3e986c4e6ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:35.553900 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f72ddf-f941-4c9f-997b-3e986c4e6ce3 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:35.555655 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 361/701] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:35.561584 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644bf4-6049-4f51-b93a-43cd75f58d69 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:35.561928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644bf4-6049-4f51-b93a-43cd75f58d69 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:35.562148 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644bf4-6049-4f51-b93a-43cd75f58d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:35.583279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-87644bf4-6049-4f51-b93a-43cd75f58d69 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:35.584616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-87644bf4-6049-4f51-b93a-43cd75f58d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:35.678884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 341/702] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:35.706050 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f72ddf-f941-4c9f-997b-3e986c4e6ce3 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:35.914670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f72ddf-f941-4c9f-997b-3e986c4e6ce3 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:35.967327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043f522-a764-4c04-9f8a-8fabd6900944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:35.968065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043f522-a764-4c04-9f8a-8fabd6900944 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:35.968340 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043f522-a764-4c04-9f8a-8fabd6900944 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:35.968609 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043f522-a764-4c04-9f8a-8fabd6900944 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:35.988421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043f522-a764-4c04-9f8a-8fabd6900944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-b043f522-a764-4c04-9f8a-8fabd6900944 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:35.993607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:35.994576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:35.995434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:35.995434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:35.995434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:35.995434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:35.995434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:35.995434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:35.995434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:35.995434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:35.995434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:35.995434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:35.995434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:50:35.995434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:35.995434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 362/703] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:50:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:36.003399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644bf4-6049-4f51-b93a-43cd75f58d69 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:36.044557 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:36.170017 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644bf4-6049-4f51-b93a-43cd75f58d69 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:36.209075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d70d9-3581-451e-b437-546511cedc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:36.209700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d70d9-3581-451e-b437-546511cedc64 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:36.209977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d70d9-3581-451e-b437-546511cedc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:36.210246 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d70d9-3581-451e-b437-546511cedc64 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:36.210933 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d70d9-3581-451e-b437-546511cedc64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:36.211230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d70d9-3581-451e-b437-546511cedc64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:36.212643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d70d9-3581-451e-b437-546511cedc64 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:36.223387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 342/704] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:50:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:36.233033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043f522-a764-4c04-9f8a-8fabd6900944 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:36.252926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:36.362535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043f522-a764-4c04-9f8a-8fabd6900944 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:36.407797 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5f844-7130-42b7-8d88-fd085e858106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:36.408517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5f844-7130-42b7-8d88-fd085e858106 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:36.408877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5f844-7130-42b7-8d88-fd085e858106 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:36.409211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5f844-7130-42b7-8d88-fd085e858106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:36.430402 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5f844-7130-42b7-8d88-fd085e858106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:36.431779 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5f844-7130-42b7-8d88-fd085e858106 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-bbe5f844-7130-42b7-8d88-fd085e858106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:36.447938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:36.449011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:36.449917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:36.449917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:36.449917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:36.449917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 363/705] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:36.455034 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d70d9-3581-451e-b437-546511cedc64 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:36.569573 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:36.597535 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d70d9-3581-451e-b437-546511cedc64 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:36.634600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db7609-2138-435e-9641-2a2eb336ef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:36.635585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db7609-2138-435e-9641-2a2eb336ef62 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:36.636514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db7609-2138-435e-9641-2a2eb336ef62 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:36.636990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db7609-2138-435e-9641-2a2eb336ef62 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:36.637882 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db7609-2138-435e-9641-2a2eb336ef62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:36.638403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db7609-2138-435e-9641-2a2eb336ef62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:36.640021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db7609-2138-435e-9641-2a2eb336ef62 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:36.654726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 343/706] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:36.660576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5f844-7130-42b7-8d88-fd085e858106 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:36.766571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:36.820136 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5f844-7130-42b7-8d88-fd085e858106 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:36.864364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db29a82-9e11-4e7d-95f0-42e897846c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:36.865015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db29a82-9e11-4e7d-95f0-42e897846c65 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:36.865297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db29a82-9e11-4e7d-95f0-42e897846c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:36.865572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db29a82-9e11-4e7d-95f0-42e897846c65 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:36.874399 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db29a82-9e11-4e7d-95f0-42e897846c65 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:36.875889 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db29a82-9e11-4e7d-95f0-42e897846c65 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-4db29a82-9e11-4e7d-95f0-42e897846c65 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:36.897964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:36.899023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:36.900030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:36.900030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:36.900030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:36.900030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:36.900030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:36.900030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:36.900030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:36.900030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:36.900030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:50:36.900030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:36.900030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 364/707] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Aug 7 00:50:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:36.904881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db7609-2138-435e-9641-2a2eb336ef62 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:37.065686 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db7609-2138-435e-9641-2a2eb336ef62 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:37.129437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b2324-c769-463c-845e-8c7a6542450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:37.130453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b2324-c769-463c-845e-8c7a6542450f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:37.130935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b2324-c769-463c-845e-8c7a6542450f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:37.131433 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b2324-c769-463c-845e-8c7a6542450f None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:37.132439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b2324-c769-463c-845e-8c7a6542450f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:37.132961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b2324-c769-463c-845e-8c7a6542450f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:37.134598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b2324-c769-463c-845e-8c7a6542450f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:37.139236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:37.161090 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 344/708] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Aug 7 00:50:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:37.166560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db29a82-9e11-4e7d-95f0-42e897846c65 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:37.178583 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e58a8-86c1-42cd-9383-427c51f07c34 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:37.179348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e58a8-86c1-42cd-9383-427c51f07c34 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:37.179867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e58a8-86c1-42cd-9383-427c51f07c34 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:37.181992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 345/709] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:37.187764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d4711-a26b-4172-984c-5918b62d239d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:37.188384 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d4711-a26b-4172-984c-5918b62d239d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:37.188885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d4711-a26b-4172-984c-5918b62d239d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:37.233992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-228d4711-a26b-4172-984c-5918b62d239d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:37.238866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-228d4711-a26b-4172-984c-5918b62d239d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:37.384810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db29a82-9e11-4e7d-95f0-42e897846c65 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:37.390904 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 346/710] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:50:37.425418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:37.440923 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d4711-a26b-4172-984c-5918b62d239d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:37.443805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3a491-0996-4539-9fa6-c0bf61c5d1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:37.444464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3a491-0996-4539-9fa6-c0bf61c5d1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:37.445644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3a491-0996-4539-9fa6-c0bf61c5d1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:37.445644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3a491-0996-4539-9fa6-c0bf61c5d1d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:37.563850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3a491-0996-4539-9fa6-c0bf61c5d1d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:37.565984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3a491-0996-4539-9fa6-c0bf61c5d1d1 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:37.614602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d4711-a26b-4172-984c-5918b62d239d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:37.650354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:37.669251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce066756-880b-453d-91aa-b00f3baea174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:37.669906 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce066756-880b-453d-91aa-b00f3baea174 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:37.670177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce066756-880b-453d-91aa-b00f3baea174 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:37.670447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce066756-880b-453d-91aa-b00f3baea174 None admin] PATH_INFO: `/v3/services/network` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:37.671102 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce066756-880b-453d-91aa-b00f3baea174 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:37.672474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce066756-880b-453d-91aa-b00f3baea174 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-ce066756-880b-453d-91aa-b00f3baea174 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:37.683172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:37.685199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:37.686815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:37.686815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:37.686815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:37.686815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:37.686815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:37.686815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:37.686815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:37.686815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:37.686815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:37.686815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:37.686815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:50:37.686815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:37.686815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:50:37.686815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:37.699957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 347/711] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:37 2022] GET /identity/v3/services/network => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:37.699957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577c130-0c4b-49b7-9fe0-5fd46ec4b7ff None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:37.699957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577c130-0c4b-49b7-9fe0-5fd46ec4b7ff None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:37.699957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577c130-0c4b-49b7-9fe0-5fd46ec4b7ff None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:37.699957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 348/712] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:37.699957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577c130-0c4b-49b7-9fe0-5fd46ec4b7ff None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:37.707077 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 365/713] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:50:37.708485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3442d1-4c63-4b5f-aadf-86ad987fb2a3 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:37.708771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3442d1-4c63-4b5f-aadf-86ad987fb2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:37.709039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3442d1-4c63-4b5f-aadf-86ad987fb2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:37.734389 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-ef3442d1-4c63-4b5f-aadf-86ad987fb2a3 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:37.735587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ef3442d1-4c63-4b5f-aadf-86ad987fb2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:37.767720 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:37.844854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577c130-0c4b-49b7-9fe0-5fd46ec4b7ff None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:37.845419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 366/714] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:37.846483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3442d1-4c63-4b5f-aadf-86ad987fb2a3 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:37.902206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d064a-826c-4b4c-8e09-8e67f67cba4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:37.902946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d064a-826c-4b4c-8e09-8e67f67cba4a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:37.903290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d064a-826c-4b4c-8e09-8e67f67cba4a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:37.903626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d064a-826c-4b4c-8e09-8e67f67cba4a None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:37.904403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d064a-826c-4b4c-8e09-8e67f67cba4a None admin] RBAC: Adding query filter params (name=network) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:37.904772 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d064a-826c-4b4c-8e09-8e67f67cba4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:37.906353 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d064a-826c-4b4c-8e09-8e67f67cba4a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:37.912482 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 349/715] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Aug 7 00:50:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:37.913599 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d064a-826c-4b4c-8e09-8e67f67cba4a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:37.976130 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:38.011285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3442d1-4c63-4b5f-aadf-86ad987fb2a3 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:38.043947 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d064a-826c-4b4c-8e09-8e67f67cba4a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:38.054828 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ada3b0-3cc4-4427-b2ed-5c460ec7977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:38.055732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ada3b0-3cc4-4427-b2ed-5c460ec7977d None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:38.056114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ada3b0-3cc4-4427-b2ed-5c460ec7977d None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:38.056396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ada3b0-3cc4-4427-b2ed-5c460ec7977d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:38.068402 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ada3b0-3cc4-4427-b2ed-5c460ec7977d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:38.070017 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ada3b0-3cc4-4427-b2ed-5c460ec7977d None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:38.082760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc51c0-1cf8-4ca7-8ac4-3326f4b857c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:38.083407 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc51c0-1cf8-4ca7-8ac4-3326f4b857c7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:38.083680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc51c0-1cf8-4ca7-8ac4-3326f4b857c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:38.084006 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc51c0-1cf8-4ca7-8ac4-3326f4b857c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-57ada3b0-3cc4-4427-b2ed-5c460ec7977d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:38.086141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:38.088238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:38.090601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:38.090601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:38.090601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:38.090601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 367/716] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:38.090601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ada3b0-3cc4-4427-b2ed-5c460ec7977d None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:38.095151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc51c0-1cf8-4ca7-8ac4-3326f4b857c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:38.100363 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-91fc51c0-1cf8-4ca7-8ac4-3326f4b857c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:38.101245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:38.103403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:38.108677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:38.108677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:38.108677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:38.108677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:38.108677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:38.108677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:38.108677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:38.108677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:38.108677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:38.108677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:38.108677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:38.108677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:38.108677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 350/717] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:38.108677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef4664-0478-4d6c-8f4a-7e4a4c99c70c None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:38.109473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef4664-0478-4d6c-8f4a-7e4a4c99c70c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:38.109473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef4664-0478-4d6c-8f4a-7e4a4c99c70c None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:38.109473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 351/718] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:38.109473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef4664-0478-4d6c-8f4a-7e4a4c99c70c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:38.218505 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ada3b0-3cc4-4427-b2ed-5c460ec7977d None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:38.230516 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef4664-0478-4d6c-8f4a-7e4a4c99c70c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:38.244011 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:38.258709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf7347-32c8-477a-b0b7-5899c699d408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:38.259335 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf7347-32c8-477a-b0b7-5899c699d408 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:38.259614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf7347-32c8-477a-b0b7-5899c699d408 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:38.259890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf7347-32c8-477a-b0b7-5899c699d408 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:38.260561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf7347-32c8-477a-b0b7-5899c699d408 None admin] RBAC: Adding query filter params (type=network) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:38.260866 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf7347-32c8-477a-b0b7-5899c699d408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:38.262308 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf7347-32c8-477a-b0b7-5899c699d408 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:38.269295 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404f698-e812-4d06-8261-17f1658464b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:38.270184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404f698-e812-4d06-8261-17f1658464b5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:38.270444 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404f698-e812-4d06-8261-17f1658464b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:38.270594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 368/719] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Aug 7 00:50:38 2022] GET /identity/v3/services?type=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:38.270732 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404f698-e812-4d06-8261-17f1658464b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:38.271348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404f698-e812-4d06-8261-17f1658464b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:38.271482 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf7347-32c8-477a-b0b7-5899c699d408 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:38.271642 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404f698-e812-4d06-8261-17f1658464b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:38.273043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404f698-e812-4d06-8261-17f1658464b5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:38.286948 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 352/720] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:38.288398 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52869ba0-6483-428b-ae6b-344571bf250c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:38.288680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52869ba0-6483-428b-ae6b-344571bf250c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:38.288952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52869ba0-6483-428b-ae6b-344571bf250c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:38.313355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-52869ba0-6483-428b-ae6b-344571bf250c None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:38.315529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-52869ba0-6483-428b-ae6b-344571bf250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:38.384217 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:38.407164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 353/721] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:38.409638 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47220e3-a6f7-4426-8b09-9a0afa93ad9f None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:38.410110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47220e3-a6f7-4426-8b09-9a0afa93ad9f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:38.410390 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47220e3-a6f7-4426-8b09-9a0afa93ad9f None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:38.411935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 354/722] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:38.416884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47220e3-a6f7-4426-8b09-9a0afa93ad9f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:38.438368 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf7347-32c8-477a-b0b7-5899c699d408 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:38.491882 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2e0cc-62f4-4988-9c38-e06517887634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:38.492713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2e0cc-62f4-4988-9c38-e06517887634 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:38.492989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2e0cc-62f4-4988-9c38-e06517887634 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:38.493259 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2e0cc-62f4-4988-9c38-e06517887634 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:38.494103 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2e0cc-62f4-4988-9c38-e06517887634 None admin] RBAC: Adding query filter params (name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:38.494401 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2e0cc-62f4-4988-9c38-e06517887634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:38.496731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2e0cc-62f4-4988-9c38-e06517887634 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:38.508920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 369/723] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:38.510287 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868edc-4126-4dbb-9698-58829393bf7b None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:38.510570 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868edc-4126-4dbb-9698-58829393bf7b None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:38.510840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868edc-4126-4dbb-9698-58829393bf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:38.533517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-da868edc-4126-4dbb-9698-58829393bf7b None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:38.534741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-da868edc-4126-4dbb-9698-58829393bf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:38.580657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:38.585666 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47220e3-a6f7-4426-8b09-9a0afa93ad9f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:38.626268 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2d99d-3284-41cc-81af-8e93c5a3935b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:38.631987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2d99d-3284-41cc-81af-8e93c5a3935b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:38.632168 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 370/724] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:38.632252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2d99d-3284-41cc-81af-8e93c5a3935b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:38.632252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2d99d-3284-41cc-81af-8e93c5a3935b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:38.632395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da868edc-4126-4dbb-9698-58829393bf7b None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:38.643784 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2d99d-3284-41cc-81af-8e93c5a3935b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:38.645643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2d99d-3284-41cc-81af-8e93c5a3935b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:38.661910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-5ec2d99d-3284-41cc-81af-8e93c5a3935b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:38.661910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:38.661910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:38.661910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:38.661910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:38.661910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:38.661910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:38.661910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:38.661910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:38.661910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:38.661910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:38.661910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:38.661910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:38.661910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:38.661910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:38.663000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:38.663956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:38.663956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:38.663956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:38.663956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:38.663956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:38.663956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:38.663956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:38.663956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:38.663956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 355/725] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:38.663956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2d99d-3284-41cc-81af-8e93c5a3935b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:38.717634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:38.761376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da868edc-4126-4dbb-9698-58829393bf7b None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:38.799859 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2d99d-3284-41cc-81af-8e93c5a3935b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:38.800489 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67186efb-33dd-473c-b755-d493059db368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:38.801138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186efb-33dd-473c-b755-d493059db368 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:38.801419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186efb-33dd-473c-b755-d493059db368 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:38.801687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67186efb-33dd-473c-b755-d493059db368 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:38.813991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67186efb-33dd-473c-b755-d493059db368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-67186efb-33dd-473c-b755-d493059db368 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:38.819831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:38.820836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:38.821791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:38.821791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:38.821791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:38.821791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:38.821791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:38.821791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:38.821791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:38.821791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:38.821791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:38.821791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:38.821791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:50:38.821791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:38.821791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 371/726] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:50:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:38.821791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67186efb-33dd-473c-b755-d493059db368 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:38.846899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2f794-c726-44c1-8e36-8aa7aead9021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:38.847603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2f794-c726-44c1-8e36-8aa7aead9021 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:38.847803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2f794-c726-44c1-8e36-8aa7aead9021 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:38.848114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2f794-c726-44c1-8e36-8aa7aead9021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:38.860160 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2f794-c726-44c1-8e36-8aa7aead9021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:38.861669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2f794-c726-44c1-8e36-8aa7aead9021 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e2f2f794-c726-44c1-8e36-8aa7aead9021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:38.878453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:38.879476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:38.880462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:38.880462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:38.880462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:38.881480 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 356/727] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:38.882655 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2f794-c726-44c1-8e36-8aa7aead9021 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:38.899891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:38.961297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67186efb-33dd-473c-b755-d493059db368 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:38.989725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:39.001797 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a4cd9-b897-4f06-962c-5e3c019c6948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:39.002951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a4cd9-b897-4f06-962c-5e3c019c6948 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:39.003238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a4cd9-b897-4f06-962c-5e3c019c6948 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:39.003513 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a4cd9-b897-4f06-962c-5e3c019c6948 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:39.004212 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a4cd9-b897-4f06-962c-5e3c019c6948 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:39.005617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a4cd9-b897-4f06-962c-5e3c019c6948 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:39.006950 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2f794-c726-44c1-8e36-8aa7aead9021 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:39.023980 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 372/728] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Aug 7 00:50:38 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:50:39.024804 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a4cd9-b897-4f06-962c-5e3c019c6948 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:39.087880 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f265ad-aa17-40ec-b7d2-17c150da970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:39.088757 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f265ad-aa17-40ec-b7d2-17c150da970e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:39.089113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f265ad-aa17-40ec-b7d2-17c150da970e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:39.089471 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f265ad-aa17-40ec-b7d2-17c150da970e None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:39.090306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f265ad-aa17-40ec-b7d2-17c150da970e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:39.090716 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f265ad-aa17-40ec-b7d2-17c150da970e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:39.092650 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f265ad-aa17-40ec-b7d2-17c150da970e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:39.112002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 357/729] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:39.112002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f265ad-aa17-40ec-b7d2-17c150da970e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:39.177405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a4cd9-b897-4f06-962c-5e3c019c6948 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:39.212654 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:39.228636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2bd8a-53db-41ba-a9ec-3686e9c62aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:39.229293 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2bd8a-53db-41ba-a9ec-3686e9c62aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:39.229519 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2bd8a-53db-41ba-a9ec-3686e9c62aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:39.229799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2bd8a-53db-41ba-a9ec-3686e9c62aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:39.230453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2bd8a-53db-41ba-a9ec-3686e9c62aa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:39.230750 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2bd8a-53db-41ba-a9ec-3686e9c62aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:39.232186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2bd8a-53db-41ba-a9ec-3686e9c62aa6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:39.242966 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 373/730] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:50:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:39.247013 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2bd8a-53db-41ba-a9ec-3686e9c62aa6 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:39.253870 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f265ad-aa17-40ec-b7d2-17c150da970e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:39.298332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438662b-cf9f-43a7-9929-096492a09b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:39.299385 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438662b-cf9f-43a7-9929-096492a09b5b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:39.299801 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438662b-cf9f-43a7-9929-096492a09b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:39.300129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438662b-cf9f-43a7-9929-096492a09b5b None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:39.300779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438662b-cf9f-43a7-9929-096492a09b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:39.301079 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438662b-cf9f-43a7-9929-096492a09b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:39.303146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438662b-cf9f-43a7-9929-096492a09b5b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:39.316853 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:39.319053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 358/731] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:39.320173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438662b-cf9f-43a7-9929-096492a09b5b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:39.390119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2bd8a-53db-41ba-a9ec-3686e9c62aa6 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:39.427495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcc0c0-6f4d-48b4-b420-a6b5c7896047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:39.428233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcc0c0-6f4d-48b4-b420-a6b5c7896047 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:39.428517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcc0c0-6f4d-48b4-b420-a6b5c7896047 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:39.428801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcc0c0-6f4d-48b4-b420-a6b5c7896047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:39.429734 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcc0c0-6f4d-48b4-b420-a6b5c7896047 None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=20b8a995891f46f1ab1672836752cc4e) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:39.430140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcc0c0-6f4d-48b4-b420-a6b5c7896047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:39.431779 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcc0c0-6f4d-48b4-b420-a6b5c7896047 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:39.438564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 374/732] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:39 2022] GET /identity/v3/role_assignments?user.id=20b8a995891f46f1ab1672836752cc4e&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=638e1fc82db44124ae615c46408110a7 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:39.439521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcc0c0-6f4d-48b4-b420-a6b5c7896047 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:39.451776 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438662b-cf9f-43a7-9929-096492a09b5b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:39.486328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:39.498321 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee9329-bf17-4ff1-a16f-122786088fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:39.498973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee9329-bf17-4ff1-a16f-122786088fcb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:39.499252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee9329-bf17-4ff1-a16f-122786088fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:39.499523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee9329-bf17-4ff1-a16f-122786088fcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:39.512427 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee9329-bf17-4ff1-a16f-122786088fcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:39.514019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee9329-bf17-4ff1-a16f-122786088fcb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c7ee9329-bf17-4ff1-a16f-122786088fcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:39.531779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:39.532854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:39.533973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:39.533973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:39.533973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:39.533973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 359/733] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:39.546288 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee9329-bf17-4ff1-a16f-122786088fcb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:39.564775 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcc0c0-6f4d-48b4-b420-a6b5c7896047 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:39.576397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:39.613802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55360a9-cca5-42cb-af53-10bb96823e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:39.614586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55360a9-cca5-42cb-af53-10bb96823e91 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:39.614925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55360a9-cca5-42cb-af53-10bb96823e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:39.615252 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55360a9-cca5-42cb-af53-10bb96823e91 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:39.644834 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55360a9-cca5-42cb-af53-10bb96823e91 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:39.646819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55360a9-cca5-42cb-af53-10bb96823e91 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-f55360a9-cca5-42cb-af53-10bb96823e91 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:39.679997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:39.681054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:39.682026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:39.682026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:39.682026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:39.682026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:39.682026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:39.682026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:39.682026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:39.682026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:39.682026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:50:39.682026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:39.684426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 375/734] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Aug 7 00:50:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:39.696966 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55360a9-cca5-42cb-af53-10bb96823e91 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:39.697300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee9329-bf17-4ff1-a16f-122786088fcb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:39.740922 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8344a-9282-4e85-95a8-dbc0b67b1a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:39.741538 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8344a-9282-4e85-95a8-dbc0b67b1a85 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:39.741813 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8344a-9282-4e85-95a8-dbc0b67b1a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:39.743317 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8344a-9282-4e85-95a8-dbc0b67b1a85 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:39.744031 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8344a-9282-4e85-95a8-dbc0b67b1a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:39.744371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8344a-9282-4e85-95a8-dbc0b67b1a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:39.745747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8344a-9282-4e85-95a8-dbc0b67b1a85 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:39.760276 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 360/735] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:39.769374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8344a-9282-4e85-95a8-dbc0b67b1a85 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:39.835856 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55360a9-cca5-42cb-af53-10bb96823e91 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:39.860267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:39.925850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be8775-3777-4c38-bd43-4628e7473ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:39.926489 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be8775-3777-4c38-bd43-4628e7473ddd None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:39.926767 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be8775-3777-4c38-bd43-4628e7473ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:39.927034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be8775-3777-4c38-bd43-4628e7473ddd None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:39.927852 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be8775-3777-4c38-bd43-4628e7473ddd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:39.928107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be8775-3777-4c38-bd43-4628e7473ddd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:39.929570 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be8775-3777-4c38-bd43-4628e7473ddd None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:39.937665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8344a-9282-4e85-95a8-dbc0b67b1a85 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:39.977031 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cb235-5d33-40de-94c4-d0ea1e6cfd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:39.978036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cb235-5d33-40de-94c4-d0ea1e6cfd54 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:39.978547 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cb235-5d33-40de-94c4-d0ea1e6cfd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:39.979025 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cb235-5d33-40de-94c4-d0ea1e6cfd54 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:39.986245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 376/736] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Aug 7 00:50:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:39.988318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704cb235-5d33-40de-94c4-d0ea1e6cfd54 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:39.990000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704cb235-5d33-40de-94c4-d0ea1e6cfd54 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:39.992929 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be8775-3777-4c38-bd43-4628e7473ddd None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-704cb235-5d33-40de-94c4-d0ea1e6cfd54 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:40.003188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:40.004241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:40.005217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:40.005217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:40.005217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:40.005217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:40.005217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:40.005217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:40.005217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:40.005217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:40.005217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:50:40.005217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:40.007742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 361/737] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:50:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:40.013221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cb235-5d33-40de-94c4-d0ea1e6cfd54 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:40.101762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:40.134307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cb235-5d33-40de-94c4-d0ea1e6cfd54 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:40.146509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:40.182310 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05977f-9c47-43b9-abb8-db0579010348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:40.183442 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05977f-9c47-43b9-abb8-db0579010348 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:40.183842 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05977f-9c47-43b9-abb8-db0579010348 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:40.184277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05977f-9c47-43b9-abb8-db0579010348 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:40.185136 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05977f-9c47-43b9-abb8-db0579010348 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:40.185549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05977f-9c47-43b9-abb8-db0579010348 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:40.187108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05977f-9c47-43b9-abb8-db0579010348 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:40.209330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 362/738] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Aug 7 00:50:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:40.214911 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05977f-9c47-43b9-abb8-db0579010348 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:40.329509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05977f-9c47-43b9-abb8-db0579010348 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:40.372009 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b112a-652c-4f5e-9e2e-8695488e00a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:40.372790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b112a-652c-4f5e-9e2e-8695488e00a5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:40.373190 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b112a-652c-4f5e-9e2e-8695488e00a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:40.373567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b112a-652c-4f5e-9e2e-8695488e00a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:40.378560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be8775-3777-4c38-bd43-4628e7473ddd None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:40.408799 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:40.452068 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469ae56-cb33-4520-a574-f682e390e295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:40.452777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469ae56-cb33-4520-a574-f682e390e295 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:40.452948 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469ae56-cb33-4520-a574-f682e390e295 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:40.453220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469ae56-cb33-4520-a574-f682e390e295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:40.458136 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b112a-652c-4f5e-9e2e-8695488e00a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:40.459606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b112a-652c-4f5e-9e2e-8695488e00a5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:40.571044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469ae56-cb33-4520-a574-f682e390e295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:40.573693 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469ae56-cb33-4520-a574-f682e390e295 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:40.615264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:40.655256 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 363/739] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:40 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:50:40.656945 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d5e17-2879-4746-b9b2-37ac492ca491 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:40.657304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d5e17-2879-4746-b9b2-37ac492ca491 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:40.657733 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d5e17-2879-4746-b9b2-37ac492ca491 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:40.664114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 364/740] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:40.664949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d5e17-2879-4746-b9b2-37ac492ca491 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:40.718897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 377/741] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:39 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 726 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:50:40.721764 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0976bb-8854-4798-b884-63df4e0eb996 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:40.722284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0976bb-8854-4798-b884-63df4e0eb996 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:40.722781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0976bb-8854-4798-b884-63df4e0eb996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:40.745572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-ff0976bb-8854-4798-b884-63df4e0eb996 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:40.746947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ff0976bb-8854-4798-b884-63df4e0eb996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:40.750425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:40.801258 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d5e17-2879-4746-b9b2-37ac492ca491 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:40.839336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 378/742] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:50:40.840560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0976bb-8854-4798-b884-63df4e0eb996 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:40.867798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a493f-37f7-4bdf-874e-99446804d758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:40.869080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a493f-37f7-4bdf-874e-99446804d758 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:40.869375 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a493f-37f7-4bdf-874e-99446804d758 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:40.869818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a493f-37f7-4bdf-874e-99446804d758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:40.885882 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a493f-37f7-4bdf-874e-99446804d758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:40.887750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a493f-37f7-4bdf-874e-99446804d758 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-540a493f-37f7-4bdf-874e-99446804d758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:40.908387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:40.910056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:40.911509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:40.911509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:40.911509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:40.911509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 365/743] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:40.911509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a493f-37f7-4bdf-874e-99446804d758 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:40.941932 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:41.001587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0976bb-8854-4798-b884-63df4e0eb996 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:41.047343 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857612f8-0f2e-4864-8702-423f034849eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:41.048624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857612f8-0f2e-4864-8702-423f034849eb None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:41.049910 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857612f8-0f2e-4864-8702-423f034849eb None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:41.050676 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857612f8-0f2e-4864-8702-423f034849eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:41.052750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a493f-37f7-4bdf-874e-99446804d758 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:41.064122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857612f8-0f2e-4864-8702-423f034849eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:41.066236 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857612f8-0f2e-4864-8702-423f034849eb None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:41.070069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-857612f8-0f2e-4864-8702-423f034849eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:41.085243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:41.086268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:41.087176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:41.087176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:41.087176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:41.089236 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 379/744] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:41.090398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857612f8-0f2e-4864-8702-423f034849eb None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:41.099662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273ab93-f22a-433e-8243-b69f321eaa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:41.100334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273ab93-f22a-433e-8243-b69f321eaa17 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:41.100615 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273ab93-f22a-433e-8243-b69f321eaa17 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:41.100888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273ab93-f22a-433e-8243-b69f321eaa17 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:41.101547 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273ab93-f22a-433e-8243-b69f321eaa17 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:41.103665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273ab93-f22a-433e-8243-b69f321eaa17 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:41.125222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 366/745] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Aug 7 00:50:40 2022] POST /identity/v3/services => generated 240 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:50:41.127958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273ab93-f22a-433e-8243-b69f321eaa17 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:41.350355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273ab93-f22a-433e-8243-b69f321eaa17 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:41.354073 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857612f8-0f2e-4864-8702-423f034849eb None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:41.375122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:41.404835 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9cac0-7253-46c6-9c3f-42445255268c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:41.405464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9cac0-7253-46c6-9c3f-42445255268c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:41.405766 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9cac0-7253-46c6-9c3f-42445255268c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:41.406039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9cac0-7253-46c6-9c3f-42445255268c None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:41.406869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9cac0-7253-46c6-9c3f-42445255268c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:41.406985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9cac0-7253-46c6-9c3f-42445255268c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:41.408556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9cac0-7253-46c6-9c3f-42445255268c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:41.422045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 367/746] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:41.424286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f993c-8be4-4d69-9d08-870d1b02a526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:41.425437 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f993c-8be4-4d69-9d08-870d1b02a526 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:41.426132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f993c-8be4-4d69-9d08-870d1b02a526 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:41.426642 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f993c-8be4-4d69-9d08-870d1b02a526 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:41.427637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f993c-8be4-4d69-9d08-870d1b02a526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:41.427765 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9cac0-7253-46c6-9c3f-42445255268c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:41.428572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f993c-8be4-4d69-9d08-870d1b02a526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:41.430520 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f993c-8be4-4d69-9d08-870d1b02a526 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:41.448155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 380/747] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:41.451917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f993c-8be4-4d69-9d08-870d1b02a526 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:41.462657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:41.552618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9cac0-7253-46c6-9c3f-42445255268c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:41.596479 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39633af3-e650-4c6d-816a-3f9679d2ca78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:41.597140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39633af3-e650-4c6d-816a-3f9679d2ca78 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:41.597394 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39633af3-e650-4c6d-816a-3f9679d2ca78 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:41.597830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39633af3-e650-4c6d-816a-3f9679d2ca78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:41.601019 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f993c-8be4-4d69-9d08-870d1b02a526 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:41.605378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39633af3-e650-4c6d-816a-3f9679d2ca78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:41.606847 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39633af3-e650-4c6d-816a-3f9679d2ca78 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:41.619556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-39633af3-e650-4c6d-816a-3f9679d2ca78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:41.619556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:41.619556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:41.619556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:41.619556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:41.619556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:41.619556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:41.619556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:41.619556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:41.619556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:41.619556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:41.619556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:41.619556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:41.619556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:41.619556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:41.620595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:41.621946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:41.621946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:41.621946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:41.621946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:41.621946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:41.621946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:41.621946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:41.621946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:41.621946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 368/748] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:41.622450 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c16c9-c5bb-448c-9cc3-b4d2e8516292 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:41.622733 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c16c9-c5bb-448c-9cc3-b4d2e8516292 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:41.623939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c16c9-c5bb-448c-9cc3-b4d2e8516292 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:41.629304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 369/749] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:41.630208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c16c9-c5bb-448c-9cc3-b4d2e8516292 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:41.641812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6af123-d7d8-4ced-b837-1b6500c3ae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:41.643034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6af123-d7d8-4ced-b837-1b6500c3ae5b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:41.643837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6af123-d7d8-4ced-b837-1b6500c3ae5b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:41.644355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6af123-d7d8-4ced-b837-1b6500c3ae5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:41.652883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6af123-d7d8-4ced-b837-1b6500c3ae5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:41.654597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6af123-d7d8-4ced-b837-1b6500c3ae5b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:41.668484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-0b6af123-d7d8-4ced-b837-1b6500c3ae5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:41.668484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:41.668484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:41.668484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:41.668484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:41.668484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:41.668484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:41.668484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:41.668484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:41.668484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:41.668484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:41.668484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:41.668484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:41.668484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:41.668484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:41.670829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:41.674353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:41.674353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:41.674353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:41.674353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:41.674353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:41.674353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:41.674353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:41.674353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:41.674353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 381/750] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:41.674353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248221fd-5154-42e2-939a-26c6541757d0 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:41.674353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248221fd-5154-42e2-939a-26c6541757d0 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:41.676727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248221fd-5154-42e2-939a-26c6541757d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:41.697534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-248221fd-5154-42e2-939a-26c6541757d0 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:41.698763 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-248221fd-5154-42e2-939a-26c6541757d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:41.729129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:41.739182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:41.757629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c16c9-c5bb-448c-9cc3-b4d2e8516292 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:41.787187 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 382/751] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:50:41.787914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248221fd-5154-42e2-939a-26c6541757d0 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:41.799585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e40eb-b42e-4d49-a61a-f6aa709c5a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:41.800641 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e40eb-b42e-4d49-a61a-f6aa709c5a88 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:41.801142 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e40eb-b42e-4d49-a61a-f6aa709c5a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:41.801563 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e40eb-b42e-4d49-a61a-f6aa709c5a88 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:41.802461 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e40eb-b42e-4d49-a61a-f6aa709c5a88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:41.802967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e40eb-b42e-4d49-a61a-f6aa709c5a88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:41.808646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e40eb-b42e-4d49-a61a-f6aa709c5a88 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:41.832300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 370/752] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:41.833630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e40eb-b42e-4d49-a61a-f6aa709c5a88 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:41.911655 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248221fd-5154-42e2-939a-26c6541757d0 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:41.954411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec58ba-fdfb-4700-ad71-bf892f386105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:41.955780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec58ba-fdfb-4700-ad71-bf892f386105 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:41.956359 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec58ba-fdfb-4700-ad71-bf892f386105 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:41.956644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec58ba-fdfb-4700-ad71-bf892f386105 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:41.957352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec58ba-fdfb-4700-ad71-bf892f386105 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:41.957840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec58ba-fdfb-4700-ad71-bf892f386105 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:41.959098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec58ba-fdfb-4700-ad71-bf892f386105 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:41.963619 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e40eb-b42e-4d49-a61a-f6aa709c5a88 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:41.971948 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 383/753] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:41.972778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec58ba-fdfb-4700-ad71-bf892f386105 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:41.996498 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:42.005595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ddf26-d165-4554-925f-98e56973897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:42.006239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ddf26-d165-4554-925f-98e56973897d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:42.006522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ddf26-d165-4554-925f-98e56973897d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:42.006796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ddf26-d165-4554-925f-98e56973897d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:42.007388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ddf26-d165-4554-925f-98e56973897d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:42.008792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ddf26-d165-4554-925f-98e56973897d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-ad4ddf26-d165-4554-925f-98e56973897d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:42.018679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:42.019759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:42.020925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:42.020925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:42.020925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:42.020925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:42.020925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:42.020925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:42.020925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:42.020925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:42.020925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:42.020925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:42.020925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:50:42.020925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:42.020925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:50:42.020925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:42.020925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 371/754] 10.222.0.20 () {56 vars in 1129 bytes} [Sun Aug 7 00:50:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:42.022188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80326ee8-47a9-436d-b20f-3570d52fb550 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:42.022188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80326ee8-47a9-436d-b20f-3570d52fb550 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:42.022188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80326ee8-47a9-436d-b20f-3570d52fb550 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:42.026997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 372/755] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:42.026997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80326ee8-47a9-436d-b20f-3570d52fb550 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:42.037819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:42.097006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec58ba-fdfb-4700-ad71-bf892f386105 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:42.134150 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3f269-fd3f-47d3-8bcc-bf36e7aa9c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:42.134757 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3f269-fd3f-47d3-8bcc-bf36e7aa9c15 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:42.135037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3f269-fd3f-47d3-8bcc-bf36e7aa9c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:42.135238 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80326ee8-47a9-436d-b20f-3570d52fb550 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:42.135360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3f269-fd3f-47d3-8bcc-bf36e7aa9c15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:42.136064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3f269-fd3f-47d3-8bcc-bf36e7aa9c15 None admin] RBAC: Adding query filter params (role.id=05605552a8ef41ce895f7d776aefd260, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=d89e8e9616b34203a3fa71611fed1665) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:42.136372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3f269-fd3f-47d3-8bcc-bf36e7aa9c15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:42.137822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3f269-fd3f-47d3-8bcc-bf36e7aa9c15 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:42.144388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 384/756] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:41 2022] GET /identity/v3/role_assignments?user.id=d89e8e9616b34203a3fa71611fed1665&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=05605552a8ef41ce895f7d776aefd260 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:42.145490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3f269-fd3f-47d3-8bcc-bf36e7aa9c15 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:42.184624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d93d0-66a2-4ee0-888a-1d665b9cec14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:42.185564 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d93d0-66a2-4ee0-888a-1d665b9cec14 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:42.186062 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d93d0-66a2-4ee0-888a-1d665b9cec14 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:42.186543 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d93d0-66a2-4ee0-888a-1d665b9cec14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:42.187763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d93d0-66a2-4ee0-888a-1d665b9cec14 None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=04ad38e3598f4b15b74398dbdb9e69b3) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:42.188189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d93d0-66a2-4ee0-888a-1d665b9cec14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:42.190752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d93d0-66a2-4ee0-888a-1d665b9cec14 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:42.203053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 373/757] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:42 2022] GET /identity/v3/role_assignments?user.id=04ad38e3598f4b15b74398dbdb9e69b3&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=638e1fc82db44124ae615c46408110a7 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:42.203053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d04eb-c33a-41f6-a57f-23d716167d80 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:42.203053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d04eb-c33a-41f6-a57f-23d716167d80 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:42.203053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d04eb-c33a-41f6-a57f-23d716167d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:42.235589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ee9d04eb-c33a-41f6-a57f-23d716167d80 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:42.238844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ee9d04eb-c33a-41f6-a57f-23d716167d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:42.331429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:42.365575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3f269-fd3f-47d3-8bcc-bf36e7aa9c15 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:42.387363 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 374/758] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:50:42.413272 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d04eb-c33a-41f6-a57f-23d716167d80 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:42.414942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d03fae-ea0a-47e1-ab7d-0ba40cec23e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:42.415747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d03fae-ea0a-47e1-ab7d-0ba40cec23e9 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:42.416215 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d03fae-ea0a-47e1-ab7d-0ba40cec23e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:42.416528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:42.416782 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d03fae-ea0a-47e1-ab7d-0ba40cec23e9 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:42.417558 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d03fae-ea0a-47e1-ab7d-0ba40cec23e9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:42.418063 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d03fae-ea0a-47e1-ab7d-0ba40cec23e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:42.419602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d03fae-ea0a-47e1-ab7d-0ba40cec23e9 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:42.425847 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 385/759] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Aug 7 00:50:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:42.431115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d03fae-ea0a-47e1-ab7d-0ba40cec23e9 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:42.532347 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d04eb-c33a-41f6-a57f-23d716167d80 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:42.557757 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d03fae-ea0a-47e1-ab7d-0ba40cec23e9 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:42.571488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab48eaf-ef3a-4a4f-90f0-d6e1b69a2c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:42.572193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab48eaf-ef3a-4a4f-90f0-d6e1b69a2c94 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:42.572464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab48eaf-ef3a-4a4f-90f0-d6e1b69a2c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:42.572739 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab48eaf-ef3a-4a4f-90f0-d6e1b69a2c94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:42.585253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab48eaf-ef3a-4a4f-90f0-d6e1b69a2c94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-6ab48eaf-ef3a-4a4f-90f0-d6e1b69a2c94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:42.590333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:42.591305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:42.592594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:42.592594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:42.592594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:42.592594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:42.592594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:42.592594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:42.592594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:42.592594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:42.592594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:42.592594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:42.592594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:50:42.592594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:42.592594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 375/760] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:50:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:42.597780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab48eaf-ef3a-4a4f-90f0-d6e1b69a2c94 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:42.601075 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc1fc1-dd07-4b3c-b143-186166f92b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:42.602435 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc1fc1-dd07-4b3c-b143-186166f92b79 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:42.602970 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc1fc1-dd07-4b3c-b143-186166f92b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:42.603456 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc1fc1-dd07-4b3c-b143-186166f92b79 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:42.604319 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc1fc1-dd07-4b3c-b143-186166f92b79 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:42.604834 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc1fc1-dd07-4b3c-b143-186166f92b79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:42.606490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc1fc1-dd07-4b3c-b143-186166f92b79 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:42.612862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 386/761] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Aug 7 00:50:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:42.624363 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc1fc1-dd07-4b3c-b143-186166f92b79 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:42.647812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:42.676551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:42.725727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab48eaf-ef3a-4a4f-90f0-d6e1b69a2c94 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:42.805333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e741b6-e7b4-487c-9306-fd89a7a12acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:42.806058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e741b6-e7b4-487c-9306-fd89a7a12acc None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:42.806428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e741b6-e7b4-487c-9306-fd89a7a12acc None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:42.806791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e741b6-e7b4-487c-9306-fd89a7a12acc None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:42.807565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e741b6-e7b4-487c-9306-fd89a7a12acc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:42.808077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e741b6-e7b4-487c-9306-fd89a7a12acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:42.809640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e741b6-e7b4-487c-9306-fd89a7a12acc None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:42.831969 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 376/762] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:50:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:42.835197 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc1fc1-dd07-4b3c-b143-186166f92b79 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:42.836339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e741b6-e7b4-487c-9306-fd89a7a12acc None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:42.897396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d3d8a-fc2b-40e7-8e80-5eddbbca9131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:42.898798 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d3d8a-fc2b-40e7-8e80-5eddbbca9131 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:42.899327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d3d8a-fc2b-40e7-8e80-5eddbbca9131 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:42.900860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d3d8a-fc2b-40e7-8e80-5eddbbca9131 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:42.901770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d3d8a-fc2b-40e7-8e80-5eddbbca9131 None admin] RBAC: Adding query filter params (interface=public, service_id=7874db58ae12447592454131fafbe4a0, region_id=RegionOne) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:42.902931 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d3d8a-fc2b-40e7-8e80-5eddbbca9131 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:42.904974 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d3d8a-fc2b-40e7-8e80-5eddbbca9131 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:42.922576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 387/763] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Aug 7 00:50:42 2022] GET /identity/v3/endpoints?service_id=7874db58ae12447592454131fafbe4a0&interface=public®ion_id=RegionOne => generated 194 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:42.927837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d3d8a-fc2b-40e7-8e80-5eddbbca9131 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:43.042809 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e741b6-e7b4-487c-9306-fd89a7a12acc None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:43.061518 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:43.102783 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:43.113021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d3d8a-fc2b-40e7-8e80-5eddbbca9131 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:43.123596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a0846-d58c-4f1b-9f34-4546a1d145ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:43.124408 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a0846-d58c-4f1b-9f34-4546a1d145ef None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:43.124786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a0846-d58c-4f1b-9f34-4546a1d145ef None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:43.125152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a0846-d58c-4f1b-9f34-4546a1d145ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:43.140704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a0846-d58c-4f1b-9f34-4546a1d145ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:43.142309 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a0846-d58c-4f1b-9f34-4546a1d145ef None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-cf4a0846-d58c-4f1b-9f34-4546a1d145ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:43.177257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:43.178462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:43.179618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:43.179618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:43.179618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:43.184470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 377/764] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:43.187976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab7df7-0dab-4ede-b98e-a99feb7bd3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:43.188715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab7df7-0dab-4ede-b98e-a99feb7bd3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:43.189089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab7df7-0dab-4ede-b98e-a99feb7bd3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:43.189649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab7df7-0dab-4ede-b98e-a99feb7bd3e3 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:43.190549 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab7df7-0dab-4ede-b98e-a99feb7bd3e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:43.191872 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a0846-d58c-4f1b-9f34-4546a1d145ef None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:43.193627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab7df7-0dab-4ede-b98e-a99feb7bd3e3 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:43.212962 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 388/765] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Aug 7 00:50:42 2022] GET /identity/v3/services => generated 772 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:43.347222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a0846-d58c-4f1b-9f34-4546a1d145ef None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:43.395140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab793158-e670-416e-9449-598cf17534b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:43.395803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab793158-e670-416e-9449-598cf17534b2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:43.396060 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab793158-e670-416e-9449-598cf17534b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:43.396329 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab793158-e670-416e-9449-598cf17534b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:43.396980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab793158-e670-416e-9449-598cf17534b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:43.397277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab793158-e670-416e-9449-598cf17534b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:43.398631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab793158-e670-416e-9449-598cf17534b2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:43.412783 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 378/766] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:43.418969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab7df7-0dab-4ede-b98e-a99feb7bd3e3 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:43.460725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e073f-e18d-414c-b810-e0c4e1e8c3c3 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:43.461154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e073f-e18d-414c-b810-e0c4e1e8c3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:43.461525 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e073f-e18d-414c-b810-e0c4e1e8c3c3 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:43.463203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 379/767] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:50:43.470296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e614675-ad5e-47e6-adb3-0fe47d704d08 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:43.472140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e614675-ad5e-47e6-adb3-0fe47d704d08 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:43.472140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e614675-ad5e-47e6-adb3-0fe47d704d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:43.500394 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5e614675-ad5e-47e6-adb3-0fe47d704d08 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:43.503434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5e614675-ad5e-47e6-adb3-0fe47d704d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:43.568537 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab7df7-0dab-4ede-b98e-a99feb7bd3e3 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:43.574443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:43.608024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2eedca-35c1-4ef6-b97f-67c5580c2df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:43.608560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2eedca-35c1-4ef6-b97f-67c5580c2df2 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:43.608847 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2eedca-35c1-4ef6-b97f-67c5580c2df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:43.609121 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2eedca-35c1-4ef6-b97f-67c5580c2df2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:43.618209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2eedca-35c1-4ef6-b97f-67c5580c2df2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:43.624678 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2eedca-35c1-4ef6-b97f-67c5580c2df2 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:43.628908 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-5c2eedca-35c1-4ef6-b97f-67c5580c2df2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:43.640372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:43.641591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:43.643042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:43.643042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:43.643042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:43.643042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:43.643042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:43.643042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:43.643042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:43.643042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:43.643042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:50:43.643042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:43.645774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 389/768] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Aug 7 00:50:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:43.660833 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2eedca-35c1-4ef6-b97f-67c5580c2df2 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:43.671933 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 380/769] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:50:43.711017 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e614675-ad5e-47e6-adb3-0fe47d704d08 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:43.804420 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2eedca-35c1-4ef6-b97f-67c5580c2df2 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:43.864597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cafc9e-28bf-4358-b16a-eb22be81e978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:43.865492 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cafc9e-28bf-4358-b16a-eb22be81e978 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:43.865940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cafc9e-28bf-4358-b16a-eb22be81e978 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:43.866405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cafc9e-28bf-4358-b16a-eb22be81e978 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:43.867313 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cafc9e-28bf-4358-b16a-eb22be81e978 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:43.867789 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cafc9e-28bf-4358-b16a-eb22be81e978 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:43.875951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cafc9e-28bf-4358-b16a-eb22be81e978 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:43.876114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e614675-ad5e-47e6-adb3-0fe47d704d08 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:43.921934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 390/770] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Aug 7 00:50:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:43.926939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cafc9e-28bf-4358-b16a-eb22be81e978 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:43.927609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680afdeb-2e3c-4d4b-a9af-9557b38f7e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:43.928342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680afdeb-2e3c-4d4b-a9af-9557b38f7e46 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:43.928629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680afdeb-2e3c-4d4b-a9af-9557b38f7e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:43.928908 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680afdeb-2e3c-4d4b-a9af-9557b38f7e46 None admin] PATH_INFO: `/v3/services/network` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:43.929592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680afdeb-2e3c-4d4b-a9af-9557b38f7e46 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:43.931359 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680afdeb-2e3c-4d4b-a9af-9557b38f7e46 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-680afdeb-2e3c-4d4b-a9af-9557b38f7e46 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:43.958940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:43.960033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:43.960901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:43.960901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:43.960901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:43.960901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:43.960901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:43.960901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:43.960901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:43.960901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:43.960901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:43.960901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:43.960901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:50:43.960901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:43.960901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:50:43.960901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:43.968275 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 381/771] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:43 2022] GET /identity/v3/services/network => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:43.969218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680afdeb-2e3c-4d4b-a9af-9557b38f7e46 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:43.998832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:44.049371 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cafc9e-28bf-4358-b16a-eb22be81e978 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:44.073358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:44.091575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c5dbc-a0dc-4679-9f0d-56bc478537c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:44.092303 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c5dbc-a0dc-4679-9f0d-56bc478537c5 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:44.092640 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c5dbc-a0dc-4679-9f0d-56bc478537c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:44.092920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c5dbc-a0dc-4679-9f0d-56bc478537c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:44.105674 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c5dbc-a0dc-4679-9f0d-56bc478537c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:44.107164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c5dbc-a0dc-4679-9f0d-56bc478537c5 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-f12c5dbc-a0dc-4679-9f0d-56bc478537c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:44.124665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:44.127580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:44.129793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:44.129793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:44.129793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:44.129793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 391/772] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:44.133198 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c5dbc-a0dc-4679-9f0d-56bc478537c5 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:44.262139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680afdeb-2e3c-4d4b-a9af-9557b38f7e46 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:44.287036 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c5dbc-a0dc-4679-9f0d-56bc478537c5 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:44.308304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:44.331848 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c847f1c-4529-47da-9e88-cea03a6537af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:44.332630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847f1c-4529-47da-9e88-cea03a6537af None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:44.332913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847f1c-4529-47da-9e88-cea03a6537af None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:44.333771 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847f1c-4529-47da-9e88-cea03a6537af None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:44.334453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c847f1c-4529-47da-9e88-cea03a6537af None admin] RBAC: Adding query filter params (name=network) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:44.334760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c847f1c-4529-47da-9e88-cea03a6537af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:44.336186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c847f1c-4529-47da-9e88-cea03a6537af None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:44.342540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 382/773] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Aug 7 00:50:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:44.348623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c847f1c-4529-47da-9e88-cea03a6537af None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:44.377685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b5155-babc-4640-aa8c-1ad95ce573b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:44.378235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b5155-babc-4640-aa8c-1ad95ce573b0 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:44.378511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b5155-babc-4640-aa8c-1ad95ce573b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:44.378780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b5155-babc-4640-aa8c-1ad95ce573b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:44.379455 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b5155-babc-4640-aa8c-1ad95ce573b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:44.379757 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b5155-babc-4640-aa8c-1ad95ce573b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:44.381190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b5155-babc-4640-aa8c-1ad95ce573b0 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:44.410602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 392/774] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:44.413611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b5155-babc-4640-aa8c-1ad95ce573b0 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:44.546815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:44.560353 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c847f1c-4529-47da-9e88-cea03a6537af None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:44.610061 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b5155-babc-4640-aa8c-1ad95ce573b0 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:44.635021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d253b-1344-4474-9451-51c38ceaf103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:44.637065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d253b-1344-4474-9451-51c38ceaf103 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:44.637617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d253b-1344-4474-9451-51c38ceaf103 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:44.639994 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d253b-1344-4474-9451-51c38ceaf103 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:44.640827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d253b-1344-4474-9451-51c38ceaf103 None admin] RBAC: Adding query filter params (type=network) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:44.641458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d253b-1344-4474-9451-51c38ceaf103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:44.645785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d253b-1344-4474-9451-51c38ceaf103 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:44.656154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 383/775] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Aug 7 00:50:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:44.662632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d253b-1344-4474-9451-51c38ceaf103 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:44.695232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bfa76-435d-4a7d-bd3d-fae0dafe6076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:44.696487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bfa76-435d-4a7d-bd3d-fae0dafe6076 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:44.700000 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bfa76-435d-4a7d-bd3d-fae0dafe6076 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:44.703085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bfa76-435d-4a7d-bd3d-fae0dafe6076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:44.723413 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bfa76-435d-4a7d-bd3d-fae0dafe6076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:44.727366 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bfa76-435d-4a7d-bd3d-fae0dafe6076 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:44.745049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-c38bfa76-435d-4a7d-bd3d-fae0dafe6076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:44.745049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:44.745049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:44.745049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:44.745049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:44.745049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:44.745049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:44.745049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:44.745049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:44.745049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:44.745049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:44.745049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:44.745049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:44.745049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:44.745049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:44.746494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:44.747768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:44.747768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:44.747768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:44.747768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:44.747768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:44.747768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:44.747768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:44.747768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:44.750730 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 393/776] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:44.753273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93ffa5-8115-42a7-937a-cf3aebca6404 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:44.753634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93ffa5-8115-42a7-937a-cf3aebca6404 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:44.753980 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93ffa5-8115-42a7-937a-cf3aebca6404 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:44.756259 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 394/777] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:44.758056 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93ffa5-8115-42a7-937a-cf3aebca6404 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:44.807094 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:44.838260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d253b-1344-4474-9451-51c38ceaf103 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:44.884993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6904cf-5b8e-4257-8b25-aa7250403644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:44.885692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6904cf-5b8e-4257-8b25-aa7250403644 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:44.885960 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6904cf-5b8e-4257-8b25-aa7250403644 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:44.886247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6904cf-5b8e-4257-8b25-aa7250403644 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:44.886875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6904cf-5b8e-4257-8b25-aa7250403644 None admin] RBAC: Adding query filter params (interface=public, service_id=be33856e87b14ba3952b75c8717dec6a, region_id=RegionOne) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:44.887180 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6904cf-5b8e-4257-8b25-aa7250403644 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:44.887381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93ffa5-8115-42a7-937a-cf3aebca6404 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:44.888654 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6904cf-5b8e-4257-8b25-aa7250403644 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:44.901828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 384/778] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Aug 7 00:50:44 2022] GET /identity/v3/endpoints?service_id=be33856e87b14ba3952b75c8717dec6a&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:44.901828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c780d-7326-459d-a52d-0a69afd4a823 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:44.901828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c780d-7326-459d-a52d-0a69afd4a823 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:44.901828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c780d-7326-459d-a52d-0a69afd4a823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:44.917503 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-854c780d-7326-459d-a52d-0a69afd4a823 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:44.918668 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-854c780d-7326-459d-a52d-0a69afd4a823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:44.928494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2805054-e82c-45ac-8634-653394a1f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:44.929102 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2805054-e82c-45ac-8634-653394a1f61a None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:44.929380 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2805054-e82c-45ac-8634-653394a1f61a None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:44.929649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2805054-e82c-45ac-8634-653394a1f61a None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:44.930346 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2805054-e82c-45ac-8634-653394a1f61a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:44.930648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2805054-e82c-45ac-8634-653394a1f61a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:44.932121 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2805054-e82c-45ac-8634-653394a1f61a None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:44.938223 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:44.944997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 395/779] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:44.944997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6721560-5bc6-481c-92b0-23ca77774c09 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:44.944997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6721560-5bc6-481c-92b0-23ca77774c09 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:44.944997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6721560-5bc6-481c-92b0-23ca77774c09 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:44.944997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 396/780] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:44.944997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6721560-5bc6-481c-92b0-23ca77774c09 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:45.001473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 385/781] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:50:45.003262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c780d-7326-459d-a52d-0a69afd4a823 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:45.058111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:45.070735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6721560-5bc6-481c-92b0-23ca77774c09 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:45.108120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18f83e-edec-43ce-bb0a-3a0553b9e091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:45.108732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f83e-edec-43ce-bb0a-3a0553b9e091 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:45.109007 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f83e-edec-43ce-bb0a-3a0553b9e091 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:45.109271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f83e-edec-43ce-bb0a-3a0553b9e091 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:45.109869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18f83e-edec-43ce-bb0a-3a0553b9e091 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:45.112116 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18f83e-edec-43ce-bb0a-3a0553b9e091 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:45.125097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 397/782] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Aug 7 00:50:44 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:45.125097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd292-ced5-48b9-9c94-d669c7c7fa4d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:45.125097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd292-ced5-48b9-9c94-d669c7c7fa4d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:45.125097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd292-ced5-48b9-9c94-d669c7c7fa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:45.139016 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5e0fd292-ced5-48b9-9c94-d669c7c7fa4d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:45.140206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5e0fd292-ced5-48b9-9c94-d669c7c7fa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:45.141613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c780d-7326-459d-a52d-0a69afd4a823 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:45.203643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611d5e2-046e-4373-8c4e-b211435076bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:45.204358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611d5e2-046e-4373-8c4e-b211435076bc None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:45.204648 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611d5e2-046e-4373-8c4e-b211435076bc None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:45.205016 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611d5e2-046e-4373-8c4e-b211435076bc None admin] PATH_INFO: `/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/20b8a995891f46f1ab1672836752cc4e/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:45.208716 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611d5e2-046e-4373-8c4e-b211435076bc None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9f64c951f44fd48eedc312b1f33694, user_id=20b8a995891f46f1ab1672836752cc4e, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:45.211391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611d5e2-046e-4373-8c4e-b211435076bc None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:45.228429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 398/783] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:50:45.229644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fd292-ced5-48b9-9c94-d669c7c7fa4d None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:45.230762 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 386/784] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:50:45 2022] PUT /identity/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/20b8a995891f46f1ab1672836752cc4e/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:50:45.262848 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611d5e2-046e-4373-8c4e-b211435076bc None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:45.289964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:45.412856 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611d5e2-046e-4373-8c4e-b211435076bc None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:45.413948 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:45.434370 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fd292-ced5-48b9-9c94-d669c7c7fa4d None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:45.463862 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47762ee-c6d4-4d9d-a28e-7c121256d17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:45.464708 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47762ee-c6d4-4d9d-a28e-7c121256d17c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:45.464999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47762ee-c6d4-4d9d-a28e-7c121256d17c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:45.465274 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47762ee-c6d4-4d9d-a28e-7c121256d17c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:45.481232 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47762ee-c6d4-4d9d-a28e-7c121256d17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:45.483368 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec3449-9800-4069-b0b4-edf4947d398d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:45.484329 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec3449-9800-4069-b0b4-edf4947d398d None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:45.484804 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec3449-9800-4069-b0b4-edf4947d398d None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:45.485301 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec3449-9800-4069-b0b4-edf4947d398d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-b47762ee-c6d4-4d9d-a28e-7c121256d17c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:45.486797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:45.487935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:45.488821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:45.488821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:45.488821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:45.488821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:45.488821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:45.488821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:45.488821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:45.488821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:45.488821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:45.488821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:45.488821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:45.488821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:45.488821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 387/785] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:45.494763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47762ee-c6d4-4d9d-a28e-7c121256d17c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:45.504690 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec3449-9800-4069-b0b4-edf4947d398d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-26ec3449-9800-4069-b0b4-edf4947d398d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:45.511876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:45.512914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:45.513781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:45.513781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:45.513781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:45.513781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:45.513781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:45.513781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:45.513781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:45.513781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:45.513781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:45.513781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:45.513781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:50:45.513781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:45.516738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 399/786] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:50:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:45.523568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec3449-9800-4069-b0b4-edf4947d398d None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:45.594217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:45.630268 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47762ee-c6d4-4d9d-a28e-7c121256d17c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:45.673418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec3449-9800-4069-b0b4-edf4947d398d None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:45.681822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839fd59-de16-4ed5-a624-b4eeda4837de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:45.682435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839fd59-de16-4ed5-a624-b4eeda4837de None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:45.683173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839fd59-de16-4ed5-a624-b4eeda4837de None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:45.683456 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839fd59-de16-4ed5-a624-b4eeda4837de None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:45.684170 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839fd59-de16-4ed5-a624-b4eeda4837de None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:45.684473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839fd59-de16-4ed5-a624-b4eeda4837de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:45.686227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839fd59-de16-4ed5-a624-b4eeda4837de None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:45.697841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 388/787] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:45.699196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320d17b-e16a-4a2c-b505-a5899dd7e132 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:45.699476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320d17b-e16a-4a2c-b505-a5899dd7e132 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:45.699747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320d17b-e16a-4a2c-b505-a5899dd7e132 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:45.701724 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 389/788] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:45.706631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320d17b-e16a-4a2c-b505-a5899dd7e132 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:45.719110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ce04f-e3d0-414c-a993-c0d5005e8ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:45.719873 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ce04f-e3d0-414c-a993-c0d5005e8ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:45.720288 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ce04f-e3d0-414c-a993-c0d5005e8ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:45.721159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ce04f-e3d0-414c-a993-c0d5005e8ed5 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:45.721945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ce04f-e3d0-414c-a993-c0d5005e8ed5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:45.722369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ce04f-e3d0-414c-a993-c0d5005e8ed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:45.723853 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ce04f-e3d0-414c-a993-c0d5005e8ed5 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:45.733378 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 400/789] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:50:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:45.734838 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf39d-c96c-4734-a65e-14399fc43541 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:45.735230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf39d-c96c-4734-a65e-14399fc43541 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:45.735824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf39d-c96c-4734-a65e-14399fc43541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:45.829023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320d17b-e16a-4a2c-b505-a5899dd7e132 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:45.868800 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:45.871712 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78ff6b-2567-4e83-a58a-4ba02c8dfaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:45.872567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78ff6b-2567-4e83-a58a-4ba02c8dfaee None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:45.872989 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78ff6b-2567-4e83-a58a-4ba02c8dfaee None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:45.873427 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78ff6b-2567-4e83-a58a-4ba02c8dfaee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:45.876073 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-40acf39d-c96c-4734-a65e-14399fc43541 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:45.877300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:45.878217 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-40acf39d-c96c-4734-a65e-14399fc43541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:45.887047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78ff6b-2567-4e83-a58a-4ba02c8dfaee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:45.888797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78ff6b-2567-4e83-a58a-4ba02c8dfaee None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-1e78ff6b-2567-4e83-a58a-4ba02c8dfaee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:45.904719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:45.905755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:45.906656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:45.906656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:45.906656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:45.909839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 390/790] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:45.910939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78ff6b-2567-4e83-a58a-4ba02c8dfaee None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:45.959435 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 401/791] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:50:45.959435 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acf39d-c96c-4734-a65e-14399fc43541 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:46.046994 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78ff6b-2567-4e83-a58a-4ba02c8dfaee None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:46.062361 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acf39d-c96c-4734-a65e-14399fc43541 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:46.084954 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bc788-795d-48d1-aae2-2f7e259b4483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:46.086453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bc788-795d-48d1-aae2-2f7e259b4483 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:46.086914 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bc788-795d-48d1-aae2-2f7e259b4483 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:46.087604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bc788-795d-48d1-aae2-2f7e259b4483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:46.100700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e9092-b784-46cb-98c3-97dcfee499a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:46.101407 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e9092-b784-46cb-98c3-97dcfee499a6 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:46.101787 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e9092-b784-46cb-98c3-97dcfee499a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:46.102146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e9092-b784-46cb-98c3-97dcfee499a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:46.102491 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bc788-795d-48d1-aae2-2f7e259b4483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:46.102942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e9092-b784-46cb-98c3-97dcfee499a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:46.103315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e9092-b784-46cb-98c3-97dcfee499a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:46.104634 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bc788-795d-48d1-aae2-2f7e259b4483 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:46.104886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e9092-b784-46cb-98c3-97dcfee499a6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:46.107803 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:46.120840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 402/792] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:46.121942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e9092-b784-46cb-98c3-97dcfee499a6 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-678bc788-795d-48d1-aae2-2f7e259b4483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:46.124308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:46.125234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:46.126155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:46.126155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:46.126155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:46.129073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 391/793] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:46.130058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bc788-795d-48d1-aae2-2f7e259b4483 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:46.197221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:46.237923 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e9092-b784-46cb-98c3-97dcfee499a6 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:46.276346 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105b860-c306-4eea-b540-6142fcbf368d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:46.277180 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105b860-c306-4eea-b540-6142fcbf368d None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:46.277545 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105b860-c306-4eea-b540-6142fcbf368d None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:46.277897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105b860-c306-4eea-b540-6142fcbf368d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:46.278590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105b860-c306-4eea-b540-6142fcbf368d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:46.279846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bc788-795d-48d1-aae2-2f7e259b4483 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:46.280180 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105b860-c306-4eea-b540-6142fcbf368d None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-3105b860-c306-4eea-b540-6142fcbf368d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:46.292732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:46.293982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:46.295011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:46.295011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:46.295011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:46.295011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:46.295011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:46.295011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:46.295011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:46.295011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:46.295011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:46.295011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:46.295011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:50:46.295011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:46.295011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:50:46.295011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:46.301581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 403/794] 10.222.0.20 () {56 vars in 1129 bytes} [Sun Aug 7 00:50:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:46.301581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105b860-c306-4eea-b540-6142fcbf368d None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:46.334385 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995cffb-40b6-4427-afe0-aa720383fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:46.335585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995cffb-40b6-4427-afe0-aa720383fff1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:46.336057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995cffb-40b6-4427-afe0-aa720383fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:46.336849 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995cffb-40b6-4427-afe0-aa720383fff1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:46.346969 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995cffb-40b6-4427-afe0-aa720383fff1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:46.348867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995cffb-40b6-4427-afe0-aa720383fff1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-7995cffb-40b6-4427-afe0-aa720383fff1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:46.365920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:46.367205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:46.368873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:46.368873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:46.368873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:46.368873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:46.368873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:46.368873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:46.368873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:46.368873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:46.368873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:50:46.368873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:46.370397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 392/795] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Aug 7 00:50:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:46.371456 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995cffb-40b6-4427-afe0-aa720383fff1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:46.380594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:46.447382 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105b860-c306-4eea-b540-6142fcbf368d None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:46.485145 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:46.488648 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995cffb-40b6-4427-afe0-aa720383fff1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:46.497502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b67d6-353c-42e3-bd61-3acd9b358d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:46.499117 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b67d6-353c-42e3-bd61-3acd9b358d7c None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:46.499563 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b67d6-353c-42e3-bd61-3acd9b358d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:46.500005 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b67d6-353c-42e3-bd61-3acd9b358d7c None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:46.501294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b67d6-353c-42e3-bd61-3acd9b358d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:46.502296 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b67d6-353c-42e3-bd61-3acd9b358d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:46.504898 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b67d6-353c-42e3-bd61-3acd9b358d7c None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:46.531031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 404/796] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:46.532570 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b67d6-353c-42e3-bd61-3acd9b358d7c None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:46.535541 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93622f6c-1c0e-464e-b9c4-f416b310d61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:46.536573 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93622f6c-1c0e-464e-b9c4-f416b310d61a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:46.536814 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93622f6c-1c0e-464e-b9c4-f416b310d61a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:46.537190 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93622f6c-1c0e-464e-b9c4-f416b310d61a None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:46.538750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93622f6c-1c0e-464e-b9c4-f416b310d61a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:46.538750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93622f6c-1c0e-464e-b9c4-f416b310d61a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:46.539863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93622f6c-1c0e-464e-b9c4-f416b310d61a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:46.550244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 393/797] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Aug 7 00:50:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:46.550244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93622f6c-1c0e-464e-b9c4-f416b310d61a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:46.669590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b67d6-353c-42e3-bd61-3acd9b358d7c None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:46.685024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93622f6c-1c0e-464e-b9c4-f416b310d61a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:46.699380 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:46.721331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61499fa4-fb9c-4f7a-a169-ed70f15da388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:46.722373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61499fa4-fb9c-4f7a-a169-ed70f15da388 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:46.722836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61499fa4-fb9c-4f7a-a169-ed70f15da388 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:46.723282 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61499fa4-fb9c-4f7a-a169-ed70f15da388 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:46.724599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61499fa4-fb9c-4f7a-a169-ed70f15da388 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:46.725389 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61499fa4-fb9c-4f7a-a169-ed70f15da388 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:46.727346 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61499fa4-fb9c-4f7a-a169-ed70f15da388 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:46.727506 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f0e7-e382-4b96-83ff-376aeb734d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:46.728117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f0e7-e382-4b96-83ff-376aeb734d43 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:46.728471 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f0e7-e382-4b96-83ff-376aeb734d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:46.728803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f0e7-e382-4b96-83ff-376aeb734d43 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:46.737328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7f0e7-e382-4b96-83ff-376aeb734d43 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:46.738919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7f0e7-e382-4b96-83ff-376aeb734d43 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c0f7f0e7-e382-4b96-83ff-376aeb734d43 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:46.750968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:46.752296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:46.753265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:46.753265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:46.753265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:46.753265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:46.753265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:46.753265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:46.753265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:46.753265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:46.753265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:50:46.753265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:46.757292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 394/799] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:50:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:46.757557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 405/799] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Aug 7 00:50:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:46.758124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f0e7-e382-4b96-83ff-376aeb734d43 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:46.759006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61499fa4-fb9c-4f7a-a169-ed70f15da388 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:46.786958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:46.869552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f0e7-e382-4b96-83ff-376aeb734d43 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:46.874582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61499fa4-fb9c-4f7a-a169-ed70f15da388 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:46.907255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0c820-7c31-40fe-a454-e6ce3cb64826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:46.907960 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0c820-7c31-40fe-a454-e6ce3cb64826 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:46.908248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0c820-7c31-40fe-a454-e6ce3cb64826 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:46.908519 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0c820-7c31-40fe-a454-e6ce3cb64826 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:46.909259 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0c820-7c31-40fe-a454-e6ce3cb64826 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:46.909550 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0c820-7c31-40fe-a454-e6ce3cb64826 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:46.910981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0c820-7c31-40fe-a454-e6ce3cb64826 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:46.914684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f5b3a-258f-4667-a15c-5bd7eaa17be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:46.915581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f5b3a-258f-4667-a15c-5bd7eaa17be0 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:46.916251 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f5b3a-258f-4667-a15c-5bd7eaa17be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:46.916359 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 395/800] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Aug 7 00:50:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:46.916811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f5b3a-258f-4667-a15c-5bd7eaa17be0 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:46.917065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0c820-7c31-40fe-a454-e6ce3cb64826 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:46.917963 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f5b3a-258f-4667-a15c-5bd7eaa17be0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:46.918474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f5b3a-258f-4667-a15c-5bd7eaa17be0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:46.920305 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f5b3a-258f-4667-a15c-5bd7eaa17be0 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:46.940578 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 406/801] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Aug 7 00:50:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:46.941845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f5b3a-258f-4667-a15c-5bd7eaa17be0 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:46.980913 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:47.022366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:47.035549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0c820-7c31-40fe-a454-e6ce3cb64826 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:47.062051 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f5b3a-258f-4667-a15c-5bd7eaa17be0 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:47.073234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cc791-4f70-4494-a3d1-1426e5ef7ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:47.073844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cc791-4f70-4494-a3d1-1426e5ef7ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:47.074129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cc791-4f70-4494-a3d1-1426e5ef7ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:47.074401 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cc791-4f70-4494-a3d1-1426e5ef7ee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:47.087849 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cc791-4f70-4494-a3d1-1426e5ef7ee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:47.089340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cc791-4f70-4494-a3d1-1426e5ef7ee7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:47.102862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c88148-e365-4a5c-bef8-0c927bf48ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:47.103846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c88148-e365-4a5c-bef8-0c927bf48ddf None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:47.104285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c88148-e365-4a5c-bef8-0c927bf48ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:47.104696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c88148-e365-4a5c-bef8-0c927bf48ddf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-703cc791-4f70-4494-a3d1-1426e5ef7ee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:47.104808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:47.105891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:47.106921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:47.106921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:47.106921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:47.106921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 396/802] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:47.107168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cc791-4f70-4494-a3d1-1426e5ef7ee7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:47.107991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c88148-e365-4a5c-bef8-0c927bf48ddf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:47.109504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c88148-e365-4a5c-bef8-0c927bf48ddf None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:47.142491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 407/803] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 00:50:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:50:47.144033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c88148-e365-4a5c-bef8-0c927bf48ddf None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:47.275957 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:47.294453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c88148-e365-4a5c-bef8-0c927bf48ddf None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:47.338997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7e12d-74ed-4d16-8c72-66664e44b3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:47.339940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7e12d-74ed-4d16-8c72-66664e44b3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:47.340553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7e12d-74ed-4d16-8c72-66664e44b3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:47.340999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7e12d-74ed-4d16-8c72-66664e44b3a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:47.341846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7e12d-74ed-4d16-8c72-66664e44b3a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:47.342315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7e12d-74ed-4d16-8c72-66664e44b3a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:47.343885 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7e12d-74ed-4d16-8c72-66664e44b3a2 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:47.359067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 408/804] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:47.364974 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7e12d-74ed-4d16-8c72-66664e44b3a2 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:47.373330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cc791-4f70-4494-a3d1-1426e5ef7ee7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:47.427055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3222b04-70eb-4daf-a7fb-ce826bb53922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:47.428072 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3222b04-70eb-4daf-a7fb-ce826bb53922 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:47.428534 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3222b04-70eb-4daf-a7fb-ce826bb53922 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:47.428983 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3222b04-70eb-4daf-a7fb-ce826bb53922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:47.441121 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:47.443858 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3222b04-70eb-4daf-a7fb-ce826bb53922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:47.445810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3222b04-70eb-4daf-a7fb-ce826bb53922 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-d3222b04-70eb-4daf-a7fb-ce826bb53922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:47.464352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:47.465371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:47.466282 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:47.466282 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:47.466282 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:47.468819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 397/805] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:47.475260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3222b04-70eb-4daf-a7fb-ce826bb53922 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:47.511442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7e12d-74ed-4d16-8c72-66664e44b3a2 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:47.560783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1a916-6dc6-4592-9bde-ba52f3f9e2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:47.561706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1a916-6dc6-4592-9bde-ba52f3f9e2bc None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:47.562050 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1a916-6dc6-4592-9bde-ba52f3f9e2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:47.562328 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1a916-6dc6-4592-9bde-ba52f3f9e2bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:47.571995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1a916-6dc6-4592-9bde-ba52f3f9e2bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:47.574284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1a916-6dc6-4592-9bde-ba52f3f9e2bc None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:47.590851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-28a1a916-6dc6-4592-9bde-ba52f3f9e2bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:47.590851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:47.590851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:47.590851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:47.590851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:47.590851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:47.590851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:47.590851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:47.590851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:47.590851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:47.590851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:47.590851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:47.590851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:47.590851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:47.590851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:47.591844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:47.592805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:47.592805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:47.592805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:47.592805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:47.592805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:47.592805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:47.592805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:47.592805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:47.592805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 409/806] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:47.594178 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b7b46-fbf7-4952-9937-4c569ff86ca7 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:47.594703 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b7b46-fbf7-4952-9937-4c569ff86ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:47.594853 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b7b46-fbf7-4952-9937-4c569ff86ca7 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:47.597166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 410/807] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:47.599185 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25121f53-f2d6-429e-8aa4-29a4be4e6df4 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:47.599590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25121f53-f2d6-429e-8aa4-29a4be4e6df4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:47.599868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25121f53-f2d6-429e-8aa4-29a4be4e6df4 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:47.602500 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 411/808] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:47.604201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a3672-8b8d-42d2-aa9d-47440be6d233 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:47.604484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a3672-8b8d-42d2-aa9d-47440be6d233 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:47.604759 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a3672-8b8d-42d2-aa9d-47440be6d233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:47.608924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3222b04-70eb-4daf-a7fb-ce826bb53922 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:47.625565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-910a3672-8b8d-42d2-aa9d-47440be6d233 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:47.627429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-910a3672-8b8d-42d2-aa9d-47440be6d233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:47.629962 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:47.652435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa2e67-f4f1-4e9f-a682-b31bf54ed1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:47.653066 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa2e67-f4f1-4e9f-a682-b31bf54ed1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:47.653348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa2e67-f4f1-4e9f-a682-b31bf54ed1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:47.653625 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa2e67-f4f1-4e9f-a682-b31bf54ed1a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:47.654289 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa2e67-f4f1-4e9f-a682-b31bf54ed1a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:47.654595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa2e67-f4f1-4e9f-a682-b31bf54ed1a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:47.656037 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa2e67-f4f1-4e9f-a682-b31bf54ed1a8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:47.671491 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 398/809] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:47.672491 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa2e67-f4f1-4e9f-a682-b31bf54ed1a8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:47.712073 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 412/810] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:50:47.713280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f5350-0154-479a-9bc9-0d6a9979d2e7 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:47.713565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f5350-0154-479a-9bc9-0d6a9979d2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:47.713892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f5350-0154-479a-9bc9-0d6a9979d2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:47.736785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c99f5350-0154-479a-9bc9-0d6a9979d2e7 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:47.737985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c99f5350-0154-479a-9bc9-0d6a9979d2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:47.756438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:47.807493 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa2e67-f4f1-4e9f-a682-b31bf54ed1a8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:47.812601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 413/811] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:50:47.813184 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f5350-0154-479a-9bc9-0d6a9979d2e7 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:47.854589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b5378-24e3-4716-b2b7-3665f5441978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:47.855333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b5378-24e3-4716-b2b7-3665f5441978 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:47.855614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b5378-24e3-4716-b2b7-3665f5441978 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:47.855894 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b5378-24e3-4716-b2b7-3665f5441978 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:47.856645 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b5378-24e3-4716-b2b7-3665f5441978 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:47.856952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b5378-24e3-4716-b2b7-3665f5441978 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:47.858395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b5378-24e3-4716-b2b7-3665f5441978 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:47.871417 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 399/812] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:47.873513 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b5378-24e3-4716-b2b7-3665f5441978 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:47.895434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:47.936203 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f5350-0154-479a-9bc9-0d6a9979d2e7 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:47.972372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6d120-5744-4548-b2e3-8636f5562e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:47.973003 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6d120-5744-4548-b2e3-8636f5562e96 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:47.973279 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6d120-5744-4548-b2e3-8636f5562e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:47.973548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6d120-5744-4548-b2e3-8636f5562e96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:47.980757 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6d120-5744-4548-b2e3-8636f5562e96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:47.982205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6d120-5744-4548-b2e3-8636f5562e96 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:47.991212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b5378-24e3-4716-b2b7-3665f5441978 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:47.994132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-b4c6d120-5744-4548-b2e3-8636f5562e96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:47.994132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:47.994132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:47.994132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:47.994132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:47.994132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:47.994132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:47.994132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:47.994132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:47.994132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:47.994132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:47.994132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:47.994132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:47.994132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:47.994132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:47.995047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:47.995991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:47.995991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:47.995991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:47.995991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:47.995991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:47.995991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:47.995991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:47.995991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:47.995991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 414/813] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:47.996487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6d120-5744-4548-b2e3-8636f5562e96 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:48.009203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:48.034099 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca51c0-9e47-446e-82f6-59e8c507491c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:48.034912 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca51c0-9e47-446e-82f6-59e8c507491c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:48.036046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca51c0-9e47-446e-82f6-59e8c507491c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:48.036335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca51c0-9e47-446e-82f6-59e8c507491c None admin] PATH_INFO: `/v3/services/network` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:48.036931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca51c0-9e47-446e-82f6-59e8c507491c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:48.038315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca51c0-9e47-446e-82f6-59e8c507491c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e3ca51c0-9e47-446e-82f6-59e8c507491c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:48.050572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:48.051627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:48.057702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:48.057702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:48.057702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:48.057702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:48.057702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:48.057702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:48.057702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:48.057702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:48.057702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:48.057702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:48.057702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:50:48.057702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:48.057702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:50:48.057702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:48.057702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 400/814] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:47 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:48.058535 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca51c0-9e47-446e-82f6-59e8c507491c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:48.104037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6d120-5744-4548-b2e3-8636f5562e96 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:48.132046 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:48.142049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b1e9a-9266-4f97-ae61-039adba44802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:48.142867 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b1e9a-9266-4f97-ae61-039adba44802 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:48.143147 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b1e9a-9266-4f97-ae61-039adba44802 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:48.143418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b1e9a-9266-4f97-ae61-039adba44802 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:48.154948 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b1e9a-9266-4f97-ae61-039adba44802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-722b1e9a-9266-4f97-ae61-039adba44802 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:48.161171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:48.162120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:48.162990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:48.162990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:48.162990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:48.162990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:48.162990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:48.162990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:48.162990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:48.162990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:48.162990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:48.162990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:48.162990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:50:48.162990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:48.162990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 415/815] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:50:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:48.163691 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b1e9a-9266-4f97-ae61-039adba44802 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:48.174943 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca51c0-9e47-446e-82f6-59e8c507491c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:48.212989 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a5b4e-4c9b-4429-9000-78389df9b0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:48.213654 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a5b4e-4c9b-4429-9000-78389df9b0e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:48.213930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a5b4e-4c9b-4429-9000-78389df9b0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:48.214261 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a5b4e-4c9b-4429-9000-78389df9b0e6 None admin] PATH_INFO: `/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/d89e8e9616b34203a3fa71611fed1665/roles/05605552a8ef41ce895f7d776aefd260` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:48.230355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a5b4e-4c9b-4429-9000-78389df9b0e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9f64c951f44fd48eedc312b1f33694, user_id=d89e8e9616b34203a3fa71611fed1665, role_id=05605552a8ef41ce895f7d776aefd260)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:48.231795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a5b4e-4c9b-4429-9000-78389df9b0e6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:48.246739 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 401/816] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:50:48 2022] PUT /identity/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/d89e8e9616b34203a3fa71611fed1665/roles/05605552a8ef41ce895f7d776aefd260 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:50:48.248757 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a5b4e-4c9b-4429-9000-78389df9b0e6 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:48.281629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:48.297865 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b1e9a-9266-4f97-ae61-039adba44802 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:48.338518 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3de5b4-546a-4f29-aecc-bbb2e0589ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:48.339147 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3de5b4-546a-4f29-aecc-bbb2e0589ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:48.339511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3de5b4-546a-4f29-aecc-bbb2e0589ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:48.339790 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3de5b4-546a-4f29-aecc-bbb2e0589ed1 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:48.340551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3de5b4-546a-4f29-aecc-bbb2e0589ed1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:48.340857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3de5b4-546a-4f29-aecc-bbb2e0589ed1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:48.342432 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3de5b4-546a-4f29-aecc-bbb2e0589ed1 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:48.363275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 416/817] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:48.364304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3de5b4-546a-4f29-aecc-bbb2e0589ed1 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:48.390627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a5b4e-4c9b-4429-9000-78389df9b0e6 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:48.419245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:48.433281 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c515eef-5fe0-46f5-a7f0-3ee15c435bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:48.434290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c515eef-5fe0-46f5-a7f0-3ee15c435bcd None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:48.434775 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c515eef-5fe0-46f5-a7f0-3ee15c435bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:48.435230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c515eef-5fe0-46f5-a7f0-3ee15c435bcd None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:48.436104 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c515eef-5fe0-46f5-a7f0-3ee15c435bcd None admin] RBAC: Adding query filter params (name=network) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:48.436587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c515eef-5fe0-46f5-a7f0-3ee15c435bcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:48.438132 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c515eef-5fe0-46f5-a7f0-3ee15c435bcd None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:48.445528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 402/818] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Aug 7 00:50:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:48.446438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c515eef-5fe0-46f5-a7f0-3ee15c435bcd None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:48.481079 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3de5b4-546a-4f29-aecc-bbb2e0589ed1 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:48.521153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfefae-af22-4fb1-8b8f-d7bdbf4e8ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:48.521774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfefae-af22-4fb1-8b8f-d7bdbf4e8ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:48.522062 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfefae-af22-4fb1-8b8f-d7bdbf4e8ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:48.522341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfefae-af22-4fb1-8b8f-d7bdbf4e8ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:48.523451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfefae-af22-4fb1-8b8f-d7bdbf4e8ff0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:48.524040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfefae-af22-4fb1-8b8f-d7bdbf4e8ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:48.526257 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfefae-af22-4fb1-8b8f-d7bdbf4e8ff0 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:48.539572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 417/819] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:50:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:48.540602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfefae-af22-4fb1-8b8f-d7bdbf4e8ff0 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:48.568966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:48.580843 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c515eef-5fe0-46f5-a7f0-3ee15c435bcd None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:48.618788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944dac4-cd61-46bf-943c-0ae235ee61de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:48.619378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944dac4-cd61-46bf-943c-0ae235ee61de None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:48.619662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944dac4-cd61-46bf-943c-0ae235ee61de None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:48.619965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944dac4-cd61-46bf-943c-0ae235ee61de None admin] PATH_INFO: `/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/04ad38e3598f4b15b74398dbdb9e69b3/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:48.621966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944dac4-cd61-46bf-943c-0ae235ee61de None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9f64c951f44fd48eedc312b1f33694, user_id=04ad38e3598f4b15b74398dbdb9e69b3, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:48.623418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944dac4-cd61-46bf-943c-0ae235ee61de None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:48.641905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 403/820] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:50:48 2022] PUT /identity/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/04ad38e3598f4b15b74398dbdb9e69b3/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:50:48.643486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944dac4-cd61-46bf-943c-0ae235ee61de None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:48.686196 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfefae-af22-4fb1-8b8f-d7bdbf4e8ff0 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:48.705207 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:48.734250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5169a-44c8-49dc-a9bb-27a1d92d78bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:48.735755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5169a-44c8-49dc-a9bb-27a1d92d78bf None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:48.736586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5169a-44c8-49dc-a9bb-27a1d92d78bf None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:48.737092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5169a-44c8-49dc-a9bb-27a1d92d78bf None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:48.738002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5169a-44c8-49dc-a9bb-27a1d92d78bf None admin] RBAC: Adding query filter params (type=network) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:48.738527 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5169a-44c8-49dc-a9bb-27a1d92d78bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:48.740311 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5169a-44c8-49dc-a9bb-27a1d92d78bf None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:48.746727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 418/821] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Aug 7 00:50:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:48.752938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5169a-44c8-49dc-a9bb-27a1d92d78bf None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:48.800326 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944dac4-cd61-46bf-943c-0ae235ee61de None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:48.872198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5e413-5161-4bd3-bc10-c47681647fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:48.873227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5e413-5161-4bd3-bc10-c47681647fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:48.873743 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5e413-5161-4bd3-bc10-c47681647fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:48.874215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5e413-5161-4bd3-bc10-c47681647fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:48.891051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5e413-5161-4bd3-bc10-c47681647fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:48.894432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5e413-5161-4bd3-bc10-c47681647fa0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-5aa5e413-5161-4bd3-bc10-c47681647fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:48.913523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:48.914530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:48.915435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:48.915435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:48.915435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:48.917825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 404/822] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:48.924102 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5e413-5161-4bd3-bc10-c47681647fa0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:48.928242 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:48.946681 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5169a-44c8-49dc-a9bb-27a1d92d78bf None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:48.984488 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fadbe-89b8-449e-ae97-2b7f79c91c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:48.984912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fadbe-89b8-449e-ae97-2b7f79c91c53 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:48.985292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fadbe-89b8-449e-ae97-2b7f79c91c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:48.985672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fadbe-89b8-449e-ae97-2b7f79c91c53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:48.986581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fadbe-89b8-449e-ae97-2b7f79c91c53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:48.988119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fadbe-89b8-449e-ae97-2b7f79c91c53 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:49.015566 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 419/823] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 00:50:48 2022] POST /identity/v3/endpoints => generated 337 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:50:49.084373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5e413-5161-4bd3-bc10-c47681647fa0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:49.149844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e28eb-fd86-45df-ae27-b6525b660e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:49.150704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e28eb-fd86-45df-ae27-b6525b660e71 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:49.151150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e28eb-fd86-45df-ae27-b6525b660e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:49.151567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e28eb-fd86-45df-ae27-b6525b660e71 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:49.152403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e28eb-fd86-45df-ae27-b6525b660e71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:49.152849 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e28eb-fd86-45df-ae27-b6525b660e71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:49.154426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e28eb-fd86-45df-ae27-b6525b660e71 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:49.172652 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 405/824] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:49.179411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fadbe-89b8-449e-ae97-2b7f79c91c53 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:49.222864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:49.325440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fadbe-89b8-449e-ae97-2b7f79c91c53 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:49.377487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffaf022-3a50-4e66-8eae-f8d2318190b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:49.378408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaf022-3a50-4e66-8eae-f8d2318190b9 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:49.378834 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaf022-3a50-4e66-8eae-f8d2318190b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:49.379248 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaf022-3a50-4e66-8eae-f8d2318190b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:49.387978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffaf022-3a50-4e66-8eae-f8d2318190b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:49.389639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffaf022-3a50-4e66-8eae-f8d2318190b9 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-fffaf022-3a50-4e66-8eae-f8d2318190b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:49.402607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:49.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:49.404926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:49.404926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:49.404926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:49.404926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:49.404926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:49.404926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:49.404926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:49.404926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:49.404926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:50:49.404926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:49.407093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 420/825] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Aug 7 00:50:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:49.413073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e28eb-fd86-45df-ae27-b6525b660e71 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:49.478715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:49.530803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e28eb-fd86-45df-ae27-b6525b660e71 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:49.570511 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce8528-25be-4af6-bca2-40c50cc91527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:49.571139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce8528-25be-4af6-bca2-40c50cc91527 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:49.571418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce8528-25be-4af6-bca2-40c50cc91527 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:49.571691 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce8528-25be-4af6-bca2-40c50cc91527 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:49.572521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce8528-25be-4af6-bca2-40c50cc91527 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:49.572825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce8528-25be-4af6-bca2-40c50cc91527 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:49.574259 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce8528-25be-4af6-bca2-40c50cc91527 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:49.593827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 406/826] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Aug 7 00:50:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:49.599677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffaf022-3a50-4e66-8eae-f8d2318190b9 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:49.678052 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077d97-35ef-41be-91e6-f972e6c902cb None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:49.678361 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077d97-35ef-41be-91e6-f972e6c902cb None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:49.678714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077d97-35ef-41be-91e6-f972e6c902cb None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:49.680832 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 407/827] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:50:49.690452 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038409a-92f7-489b-8ae4-f99559c2cdb5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:49.690675 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038409a-92f7-489b-8ae4-f99559c2cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:49.690885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038409a-92f7-489b-8ae4-f99559c2cdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:49.721733 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0038409a-92f7-489b-8ae4-f99559c2cdb5 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:49.723127 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0038409a-92f7-489b-8ae4-f99559c2cdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:49.733697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:49.754826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffaf022-3a50-4e66-8eae-f8d2318190b9 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:49.806113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 408/828] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:50:49.813699 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0cc91-97ff-4e03-8597-4b446dd927f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:49.815129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0cc91-97ff-4e03-8597-4b446dd927f9 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:49.815585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0cc91-97ff-4e03-8597-4b446dd927f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:49.816111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0cc91-97ff-4e03-8597-4b446dd927f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:49.847504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038409a-92f7-489b-8ae4-f99559c2cdb5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:49.890441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0cc91-97ff-4e03-8597-4b446dd927f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:49.892809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd0cc91-97ff-4e03-8597-4b446dd927f9 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:49.931370 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:49.995295 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038409a-92f7-489b-8ae4-f99559c2cdb5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:50.026172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:50.038191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b728072-8192-4f00-8b8c-94dc6c6aebe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:50.039172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b728072-8192-4f00-8b8c-94dc6c6aebe1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:50.039292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 421/829] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:49 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 00:50:50.039750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b728072-8192-4f00-8b8c-94dc6c6aebe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:50.040229 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b728072-8192-4f00-8b8c-94dc6c6aebe1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:50.040995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b728072-8192-4f00-8b8c-94dc6c6aebe1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:50.042551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b728072-8192-4f00-8b8c-94dc6c6aebe1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:50.044807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0cc91-97ff-4e03-8597-4b446dd927f9 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-3b728072-8192-4f00-8b8c-94dc6c6aebe1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:50.053749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:50.054824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:50.055697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:50.055697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:50.055697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:50.055697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:50.055697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:50.055697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:50.055697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:50.055697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:50.055697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:50.055697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:50.055697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:50:50.055697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:50.055697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:50:50.055697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:50.058764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 409/830] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:50:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:50.067928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b728072-8192-4f00-8b8c-94dc6c6aebe1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:50.170369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0cc91-97ff-4e03-8597-4b446dd927f9 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:50.208838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b728072-8192-4f00-8b8c-94dc6c6aebe1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:50.209083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55002a-c04e-41e4-8074-716cf417613c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:50.209480 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55002a-c04e-41e4-8074-716cf417613c None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:50.209762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55002a-c04e-41e4-8074-716cf417613c None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:50.210033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55002a-c04e-41e4-8074-716cf417613c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:50.222446 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55002a-c04e-41e4-8074-716cf417613c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:50.223128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:50.224030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55002a-c04e-41e4-8074-716cf417613c None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-4d55002a-c04e-41e4-8074-716cf417613c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:50.241794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:50.243087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:50.244219 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:50.244219 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:50.244219 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:50.244219 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 422/831] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:50.248918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55002a-c04e-41e4-8074-716cf417613c None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:50.259046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfce32-3d7b-41a7-955e-bef976e7ec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:50.259862 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfce32-3d7b-41a7-955e-bef976e7ec7f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:50.260239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfce32-3d7b-41a7-955e-bef976e7ec7f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:50.260575 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfce32-3d7b-41a7-955e-bef976e7ec7f None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:50.261344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfce32-3d7b-41a7-955e-bef976e7ec7f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:50.261710 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfce32-3d7b-41a7-955e-bef976e7ec7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:50.263249 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfce32-3d7b-41a7-955e-bef976e7ec7f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:50.270003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 410/832] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:50:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:50.276491 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfce32-3d7b-41a7-955e-bef976e7ec7f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:50.307325 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:50.382490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55002a-c04e-41e4-8074-716cf417613c None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:50.421063 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfce32-3d7b-41a7-955e-bef976e7ec7f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:50.427347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f77c6-9dd6-45de-b291-f158e7104393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:50.428052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f77c6-9dd6-45de-b291-f158e7104393 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:50.428341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f77c6-9dd6-45de-b291-f158e7104393 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:50.428612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f77c6-9dd6-45de-b291-f158e7104393 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:50.429324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f77c6-9dd6-45de-b291-f158e7104393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:50.429630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f77c6-9dd6-45de-b291-f158e7104393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:50.431209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f77c6-9dd6-45de-b291-f158e7104393 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:50.452084 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 423/833] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:50.455781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f77c6-9dd6-45de-b291-f158e7104393 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:50.471307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a1a33-5736-4194-9299-f5ebe03c2e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:50.472048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a1a33-5736-4194-9299-f5ebe03c2e4e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:50.472429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a1a33-5736-4194-9299-f5ebe03c2e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:50.473021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a1a33-5736-4194-9299-f5ebe03c2e4e None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:50.473938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a1a33-5736-4194-9299-f5ebe03c2e4e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:50.474329 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a1a33-5736-4194-9299-f5ebe03c2e4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:50.476252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a1a33-5736-4194-9299-f5ebe03c2e4e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:50.487937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 411/834] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:50:50 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:50.597491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f77c6-9dd6-45de-b291-f158e7104393 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:50.599647 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:50.639101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f597bd-e857-497d-8c1c-02ded8363de8 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:50.643935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f597bd-e857-497d-8c1c-02ded8363de8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:50.643935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f597bd-e857-497d-8c1c-02ded8363de8 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:50.643935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 412/835] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:50:50.651279 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a58c2d-e343-494d-9044-585c96657932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:50.651977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a58c2d-e343-494d-9044-585c96657932 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:50.652263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a58c2d-e343-494d-9044-585c96657932 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:50.652534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a58c2d-e343-494d-9044-585c96657932 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:50.653289 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a7a58-0af2-45ab-80f1-a919aa70c5fa None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:50.653899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a7a58-0af2-45ab-80f1-a919aa70c5fa None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:50.654504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a7a58-0af2-45ab-80f1-a919aa70c5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:50.660854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a58c2d-e343-494d-9044-585c96657932 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:50.662481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a58c2d-e343-494d-9044-585c96657932 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:50.675547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-d0a58c2d-e343-494d-9044-585c96657932 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:50.675547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:50.675547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:50.675547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:50.675547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:50.675547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:50.675547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:50.675547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:50.675547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:50.675547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:50.675547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:50.675547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:50.675547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:50.675547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:50.675547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:50.676706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:50.677747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:50.677747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:50.677747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:50.677747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:50.677747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:50.677747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:50.677747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:50.677747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:50.677747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 424/836] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:50.685051 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a58c2d-e343-494d-9044-585c96657932 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:50.696382 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-194a7a58-0af2-45ab-80f1-a919aa70c5fa None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:50.698876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-194a7a58-0af2-45ab-80f1-a919aa70c5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:50.748239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:50.794223 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 413/837] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:50:50.818822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a7a58-0af2-45ab-80f1-a919aa70c5fa None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:50.844665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a58c2d-e343-494d-9044-585c96657932 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:50.881651 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eb2ab-07cb-4ff6-b6b8-90cb7c72ba45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:50.882268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eb2ab-07cb-4ff6-b6b8-90cb7c72ba45 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:50.882542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eb2ab-07cb-4ff6-b6b8-90cb7c72ba45 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:50.882810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eb2ab-07cb-4ff6-b6b8-90cb7c72ba45 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:50.883512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3eb2ab-07cb-4ff6-b6b8-90cb7c72ba45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:50.883801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3eb2ab-07cb-4ff6-b6b8-90cb7c72ba45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:50.885291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3eb2ab-07cb-4ff6-b6b8-90cb7c72ba45 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:50.899419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 425/838] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:50.910220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eb2ab-07cb-4ff6-b6b8-90cb7c72ba45 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:50.952157 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a7a58-0af2-45ab-80f1-a919aa70c5fa None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:50.962686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:50.996433 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14648feb-ff3f-443d-9fbe-ba1127d4b32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:50.997359 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14648feb-ff3f-443d-9fbe-ba1127d4b32e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:50.997788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14648feb-ff3f-443d-9fbe-ba1127d4b32e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:50.998206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14648feb-ff3f-443d-9fbe-ba1127d4b32e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:51.011043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14648feb-ff3f-443d-9fbe-ba1127d4b32e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-14648feb-ff3f-443d-9fbe-ba1127d4b32e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:51.016527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:51.018151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:51.019237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:51.019237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:51.019237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:51.019237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:51.019237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:51.019237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:51.019237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:51.019237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:51.019237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:51.019237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:51.019237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:50:51.019237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:51.022043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 414/839] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:50:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:51.028555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14648feb-ff3f-443d-9fbe-ba1127d4b32e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:51.056395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eb2ab-07cb-4ff6-b6b8-90cb7c72ba45 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:51.072971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:51.093543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8b906-72c2-4773-b64e-9f01d762cc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:51.094143 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8b906-72c2-4773-b64e-9f01d762cc45 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:51.094417 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8b906-72c2-4773-b64e-9f01d762cc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:51.094686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8b906-72c2-4773-b64e-9f01d762cc45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:51.096002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8b906-72c2-4773-b64e-9f01d762cc45 None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=20b8a995891f46f1ab1672836752cc4e) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:51.096304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8b906-72c2-4773-b64e-9f01d762cc45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:51.097825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8b906-72c2-4773-b64e-9f01d762cc45 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:51.111951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 426/840] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:50 2022] GET /identity/v3/role_assignments?user.id=20b8a995891f46f1ab1672836752cc4e&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=638e1fc82db44124ae615c46408110a7 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:51.111951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab6f75-9596-48c0-a9a8-2fd749c65a04 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:51.111951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab6f75-9596-48c0-a9a8-2fd749c65a04 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:51.111951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab6f75-9596-48c0-a9a8-2fd749c65a04 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:51.111951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 427/841] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:51.113253 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ee41f-196f-4ec2-8dde-97cb0d0d13c7 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:51.113543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ee41f-196f-4ec2-8dde-97cb0d0d13c7 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:51.113822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ee41f-196f-4ec2-8dde-97cb0d0d13c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:51.136870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-d89ee41f-196f-4ec2-8dde-97cb0d0d13c7 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:51.138109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d89ee41f-196f-4ec2-8dde-97cb0d0d13c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:51.168878 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14648feb-ff3f-443d-9fbe-ba1127d4b32e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:51.218823 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81353b-27b4-4fc7-ad9d-4373bce4fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:51.219927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81353b-27b4-4fc7-ad9d-4373bce4fa92 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:51.221161 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81353b-27b4-4fc7-ad9d-4373bce4fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:51.221808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81353b-27b4-4fc7-ad9d-4373bce4fa92 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:51.222699 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81353b-27b4-4fc7-ad9d-4373bce4fa92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:51.223210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81353b-27b4-4fc7-ad9d-4373bce4fa92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:51.225155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81353b-27b4-4fc7-ad9d-4373bce4fa92 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:51.236851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 428/842] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:50:51.243332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 415/843] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:50:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:51.244508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ee41f-196f-4ec2-8dde-97cb0d0d13c7 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:51.257676 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81353b-27b4-4fc7-ad9d-4373bce4fa92 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:51.265591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:51.366745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ee41f-196f-4ec2-8dde-97cb0d0d13c7 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:51.385817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:51.397469 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81353b-27b4-4fc7-ad9d-4373bce4fa92 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:51.407600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411445e9-664e-4a0a-9b69-311a46495ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:51.409247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411445e9-664e-4a0a-9b69-311a46495ecf None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:51.409632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411445e9-664e-4a0a-9b69-311a46495ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:51.410006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411445e9-664e-4a0a-9b69-311a46495ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:51.421154 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411445e9-664e-4a0a-9b69-311a46495ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:51.422750 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411445e9-664e-4a0a-9b69-311a46495ecf None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:51.439957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d0c13-3132-40e9-bae8-b897197432b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:51.440581 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d0c13-3132-40e9-bae8-b897197432b0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:51.440864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d0c13-3132-40e9-bae8-b897197432b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:51.441141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d0c13-3132-40e9-bae8-b897197432b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-411445e9-664e-4a0a-9b69-311a46495ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:51.442316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:51.443463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:51.444644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:51.444644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:51.444644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:51.445960 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 429/844] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:51.451498 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411445e9-664e-4a0a-9b69-311a46495ecf None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:51.453320 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d0c13-3132-40e9-bae8-b897197432b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-dc4d0c13-3132-40e9-bae8-b897197432b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:51.459927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:51.461155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:51.462224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:51.462224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:51.462224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:51.462224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:51.462224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:51.462224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:51.462224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:51.462224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:51.462224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:51.462224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:51.462224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:50:51.462224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:51.463559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 416/845] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:50:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:51.471282 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d0c13-3132-40e9-bae8-b897197432b0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:51.538758 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:51.582526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411445e9-664e-4a0a-9b69-311a46495ecf None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:51.597704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d0c13-3132-40e9-bae8-b897197432b0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:51.626181 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729873b-df26-4f01-97ad-8dd4082de605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:51.627753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729873b-df26-4f01-97ad-8dd4082de605 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:51.628328 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729873b-df26-4f01-97ad-8dd4082de605 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:51.628740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729873b-df26-4f01-97ad-8dd4082de605 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:51.630089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729873b-df26-4f01-97ad-8dd4082de605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:51.630565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729873b-df26-4f01-97ad-8dd4082de605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:51.632558 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729873b-df26-4f01-97ad-8dd4082de605 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:51.637579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fc0a0-f318-468e-b615-160cf6bdb9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:51.638273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fc0a0-f318-468e-b615-160cf6bdb9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:51.638624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fc0a0-f318-468e-b615-160cf6bdb9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:51.638961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fc0a0-f318-468e-b615-160cf6bdb9b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:51.639704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fc0a0-f318-468e-b615-160cf6bdb9b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:51.640166 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fc0a0-f318-468e-b615-160cf6bdb9b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:51.641631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fc0a0-f318-468e-b615-160cf6bdb9b6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:51.650731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 430/846] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:51.657860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 417/847] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:50:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:51.659503 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729873b-df26-4f01-97ad-8dd4082de605 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:51.661403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fc0a0-f318-468e-b615-160cf6bdb9b6 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:51.678270 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:51.792176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fc0a0-f318-468e-b615-160cf6bdb9b6 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:51.794849 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729873b-df26-4f01-97ad-8dd4082de605 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:51.827302 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:51.833544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cb94f-e0e6-4c8a-9542-03cdb6fede96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:51.834192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cb94f-e0e6-4c8a-9542-03cdb6fede96 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:51.834474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cb94f-e0e6-4c8a-9542-03cdb6fede96 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:51.834776 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cb94f-e0e6-4c8a-9542-03cdb6fede96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:51.838360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b2992-1ad3-4f55-a11f-d16741132cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:51.839238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b2992-1ad3-4f55-a11f-d16741132cbe None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:51.839717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b2992-1ad3-4f55-a11f-d16741132cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:51.840232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b2992-1ad3-4f55-a11f-d16741132cbe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:51.847624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cb94f-e0e6-4c8a-9542-03cdb6fede96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:51.849108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cb94f-e0e6-4c8a-9542-03cdb6fede96 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:51.849875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b2992-1ad3-4f55-a11f-d16741132cbe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:51.852110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b2992-1ad3-4f55-a11f-d16741132cbe None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e97cb94f-e0e6-4c8a-9542-03cdb6fede96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:51.864740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:51.865748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:51.866655 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:51.866655 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:51.866655 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-8b0b2992-1ad3-4f55-a11f-d16741132cbe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:51.868080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:51.869002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:51.869940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:51.869940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:51.869940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:51.869940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:51.869940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:51.869940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:51.869940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:51.869940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:51.869940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:50:51.869940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:51.870946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 418/848] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:51.872067 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cb94f-e0e6-4c8a-9542-03cdb6fede96 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:51.877700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 431/849] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Aug 7 00:50:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:51.881136 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b2992-1ad3-4f55-a11f-d16741132cbe None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:51.940186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:51.982599 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cb94f-e0e6-4c8a-9542-03cdb6fede96 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:52.004626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b2992-1ad3-4f55-a11f-d16741132cbe None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:52.020871 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887faf8e-d894-4ca3-a311-80438aa1dc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:52.021342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887faf8e-d894-4ca3-a311-80438aa1dc3c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:52.021623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887faf8e-d894-4ca3-a311-80438aa1dc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:52.021894 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887faf8e-d894-4ca3-a311-80438aa1dc3c None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:52.022713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887faf8e-d894-4ca3-a311-80438aa1dc3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:52.022955 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887faf8e-d894-4ca3-a311-80438aa1dc3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:52.024597 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887faf8e-d894-4ca3-a311-80438aa1dc3c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:52.042423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 419/850] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:52.043404 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887faf8e-d894-4ca3-a311-80438aa1dc3c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:52.044679 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e2603-eea5-4e42-8f76-35a5b271283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:52.045516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e2603-eea5-4e42-8f76-35a5b271283f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:52.046097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e2603-eea5-4e42-8f76-35a5b271283f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:52.046565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e2603-eea5-4e42-8f76-35a5b271283f None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:52.047560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e2603-eea5-4e42-8f76-35a5b271283f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:52.048631 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e2603-eea5-4e42-8f76-35a5b271283f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:52.050709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e2603-eea5-4e42-8f76-35a5b271283f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:52.075225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 432/851] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Aug 7 00:50:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:52.076539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e2603-eea5-4e42-8f76-35a5b271283f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:52.129173 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:52.154424 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887faf8e-d894-4ca3-a311-80438aa1dc3c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:52.180788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:52.191744 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e2603-eea5-4e42-8f76-35a5b271283f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:52.192671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5955cb-7dbe-4a20-ad36-bd4ef462b8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:52.193309 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5955cb-7dbe-4a20-ad36-bd4ef462b8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:52.193647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5955cb-7dbe-4a20-ad36-bd4ef462b8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:52.193927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5955cb-7dbe-4a20-ad36-bd4ef462b8d5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:52.201639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5955cb-7dbe-4a20-ad36-bd4ef462b8d5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:52.203240 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5955cb-7dbe-4a20-ad36-bd4ef462b8d5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-bb5955cb-7dbe-4a20-ad36-bd4ef462b8d5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:52.217292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:52.218339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:52.219305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:52.219305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:52.219305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:52.219305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:52.219305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:52.219305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:52.219305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:52.219305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:52.219305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:50:52.219305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:52.224041 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 420/852] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:50:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:52.224910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5955cb-7dbe-4a20-ad36-bd4ef462b8d5 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:52.236552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542e9e1-a045-42f8-ab14-42e2680a8c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:52.238184 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542e9e1-a045-42f8-ab14-42e2680a8c57 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:52.238911 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542e9e1-a045-42f8-ab14-42e2680a8c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:52.239617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542e9e1-a045-42f8-ab14-42e2680a8c57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:52.315981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542e9e1-a045-42f8-ab14-42e2680a8c57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:52.317812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542e9e1-a045-42f8-ab14-42e2680a8c57 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:52.336489 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5955cb-7dbe-4a20-ad36-bd4ef462b8d5 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:52.369972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:52.377265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3b98b-bdf2-4a80-99e9-08de29339c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:52.377881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3b98b-bdf2-4a80-99e9-08de29339c97 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:52.378159 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3b98b-bdf2-4a80-99e9-08de29339c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:52.378427 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3b98b-bdf2-4a80-99e9-08de29339c97 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:52.379173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3b98b-bdf2-4a80-99e9-08de29339c97 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:52.379934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3b98b-bdf2-4a80-99e9-08de29339c97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:52.381051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3b98b-bdf2-4a80-99e9-08de29339c97 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:52.406663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 421/853] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Aug 7 00:50:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:52.407896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3b98b-bdf2-4a80-99e9-08de29339c97 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:52.439490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 433/854] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:52 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:50:52.441126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542e9e1-a045-42f8-ab14-42e2680a8c57 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:52.455566 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:52.518934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3b98b-bdf2-4a80-99e9-08de29339c97 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:52.557781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec0ad1-4d32-4ba8-baf1-56df7ac40718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:52.558206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542e9e1-a045-42f8-ab14-42e2680a8c57 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:52.558403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec0ad1-4d32-4ba8-baf1-56df7ac40718 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:52.558683 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec0ad1-4d32-4ba8-baf1-56df7ac40718 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:52.558953 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec0ad1-4d32-4ba8-baf1-56df7ac40718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:52.598241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1355565-fa40-4157-b613-6143c64cffaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:52.599228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1355565-fa40-4157-b613-6143c64cffaa None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:52.599720 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1355565-fa40-4157-b613-6143c64cffaa None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:52.600212 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1355565-fa40-4157-b613-6143c64cffaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:52.612178 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1355565-fa40-4157-b613-6143c64cffaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:52.614199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1355565-fa40-4157-b613-6143c64cffaa None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:52.621993 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-c1355565-fa40-4157-b613-6143c64cffaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:52.631919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:52.633039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:52.633952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:52.633952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:52.633952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:52.639271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 434/855] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:52.639860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1355565-fa40-4157-b613-6143c64cffaa None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:52.645138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec0ad1-4d32-4ba8-baf1-56df7ac40718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:52.646892 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec0ad1-4d32-4ba8-baf1-56df7ac40718 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:52.697438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:52.767557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1355565-fa40-4157-b613-6143c64cffaa None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:52.769073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 422/856] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:52 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:50:52.771209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0685c-2d49-4320-bfec-71436841be3c None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:52.771209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0685c-2d49-4320-bfec-71436841be3c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:52.771444 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0685c-2d49-4320-bfec-71436841be3c None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:52.776561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 423/857] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:52.776561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0685c-2d49-4320-bfec-71436841be3c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:52.808114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbe079-3249-407b-a2a9-f5e31975402f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:52.808785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbe079-3249-407b-a2a9-f5e31975402f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:52.809012 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbe079-3249-407b-a2a9-f5e31975402f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:52.809283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbe079-3249-407b-a2a9-f5e31975402f None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:52.809947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbe079-3249-407b-a2a9-f5e31975402f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:52.810247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbe079-3249-407b-a2a9-f5e31975402f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:52.811627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbe079-3249-407b-a2a9-f5e31975402f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:52.829220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 435/858] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:52.829220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aad12-f98a-48f0-aa4a-faa579d05aad None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:52.829220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aad12-f98a-48f0-aa4a-faa579d05aad None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:52.829220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aad12-f98a-48f0-aa4a-faa579d05aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:52.845744 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-7c8aad12-f98a-48f0-aa4a-faa579d05aad None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:52.847102 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7c8aad12-f98a-48f0-aa4a-faa579d05aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:52.895438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0685c-2d49-4320-bfec-71436841be3c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:52.903264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:52.923953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 436/859] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:50:52.923953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aad12-f98a-48f0-aa4a-faa579d05aad None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:52.938583 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2ae64-ad47-467a-83e8-dec03616dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:52.939976 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2ae64-ad47-467a-83e8-dec03616dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:52.940447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2ae64-ad47-467a-83e8-dec03616dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:52.941186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2ae64-ad47-467a-83e8-dec03616dcb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:52.955750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2ae64-ad47-467a-83e8-dec03616dcb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:52.958052 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2ae64-ad47-467a-83e8-dec03616dcb4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:52.960692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c0b2ae64-ad47-467a-83e8-dec03616dcb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:52.975850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:52.976896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:52.977819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:52.977819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:52.977819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:52.977819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 424/860] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:52.977819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2ae64-ad47-467a-83e8-dec03616dcb4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:53.038556 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aad12-f98a-48f0-aa4a-faa579d05aad None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:53.075669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0696d-b584-47b7-8824-1b2d9ea86cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:53.076442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0696d-b584-47b7-8824-1b2d9ea86cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:53.076722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0696d-b584-47b7-8824-1b2d9ea86cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:53.077227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0696d-b584-47b7-8824-1b2d9ea86cb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:53.085280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0696d-b584-47b7-8824-1b2d9ea86cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:53.086244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2ae64-ad47-467a-83e8-dec03616dcb4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:53.086731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0696d-b584-47b7-8824-1b2d9ea86cb3 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:53.099598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-0de0696d-b584-47b7-8824-1b2d9ea86cb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:53.099598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:53.099598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:53.099598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:53.099598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:53.099598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:53.099598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:53.099598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:53.099598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:53.099598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:53.099598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:53.099598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:53.099598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:53.099598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:53.099598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:53.100663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:53.101638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:53.101638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:53.101638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:53.101638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:53.101638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:53.101638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:53.101638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:53.101638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:53.101638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 437/861] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:53.101638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0696d-b584-47b7-8824-1b2d9ea86cb3 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:53.130681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae484091-6335-49ca-b562-a5b300f08d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:53.132236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae484091-6335-49ca-b562-a5b300f08d09 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:53.132822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae484091-6335-49ca-b562-a5b300f08d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:53.133473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae484091-6335-49ca-b562-a5b300f08d09 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:53.134623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae484091-6335-49ca-b562-a5b300f08d09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:53.136457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae484091-6335-49ca-b562-a5b300f08d09 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:53.153517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:53.160047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 425/862] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Aug 7 00:50:52 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:50:53.160047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae484091-6335-49ca-b562-a5b300f08d09 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:53.236925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:53.248698 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0696d-b584-47b7-8824-1b2d9ea86cb3 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:53.306730 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae484091-6335-49ca-b562-a5b300f08d09 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:53.310822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8f844-96f6-45aa-b198-7a18815a35b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:53.316200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8f844-96f6-45aa-b198-7a18815a35b2 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:53.316200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8f844-96f6-45aa-b198-7a18815a35b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:53.316200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8f844-96f6-45aa-b198-7a18815a35b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:53.316200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8f844-96f6-45aa-b198-7a18815a35b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:53.316200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8f844-96f6-45aa-b198-7a18815a35b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:53.316200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8f844-96f6-45aa-b198-7a18815a35b2 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:53.330701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 438/863] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:53.336454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8f844-96f6-45aa-b198-7a18815a35b2 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:53.355780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb8d88-4a0f-4fb5-a0a7-e676b86d1851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:53.356445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb8d88-4a0f-4fb5-a0a7-e676b86d1851 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:53.356722 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb8d88-4a0f-4fb5-a0a7-e676b86d1851 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:53.356986 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb8d88-4a0f-4fb5-a0a7-e676b86d1851 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:53.357681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb8d88-4a0f-4fb5-a0a7-e676b86d1851 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:53.357981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb8d88-4a0f-4fb5-a0a7-e676b86d1851 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:53.359718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb8d88-4a0f-4fb5-a0a7-e676b86d1851 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:53.374133 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 426/864] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:53.381799 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb8d88-4a0f-4fb5-a0a7-e676b86d1851 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:53.479312 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8f844-96f6-45aa-b198-7a18815a35b2 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:53.483391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:53.500632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb8d88-4a0f-4fb5-a0a7-e676b86d1851 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:53.514815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:53.531984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374123a-bfb6-4b3c-82d5-695b95ddd6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:53.534121 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374123a-bfb6-4b3c-82d5-695b95ddd6fb None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:53.534891 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374123a-bfb6-4b3c-82d5-695b95ddd6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:53.535379 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374123a-bfb6-4b3c-82d5-695b95ddd6fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:53.546368 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374123a-bfb6-4b3c-82d5-695b95ddd6fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:53.548756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374123a-bfb6-4b3c-82d5-695b95ddd6fb None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:53.549227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9005a-884c-450c-b1e2-fdc5e21d08ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:53.549850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9005a-884c-450c-b1e2-fdc5e21d08ee None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:53.550135 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9005a-884c-450c-b1e2-fdc5e21d08ee None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:53.550409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9005a-884c-450c-b1e2-fdc5e21d08ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:53.551142 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9005a-884c-450c-b1e2-fdc5e21d08ee None admin] RBAC: Adding query filter params (role.id=05605552a8ef41ce895f7d776aefd260, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=d89e8e9616b34203a3fa71611fed1665) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:53.551448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9005a-884c-450c-b1e2-fdc5e21d08ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:53.552971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9005a-884c-450c-b1e2-fdc5e21d08ee None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:53.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-4374123a-bfb6-4b3c-82d5-695b95ddd6fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:53.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:53.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:53.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:53.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:53.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:53.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:53.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:53.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:53.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:53.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:53.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:53.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:53.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:53.564756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:53.565737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:53.566641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:53.566641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:53.566641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:53.566641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:53.566641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:53.566641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:53.566641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:53.566641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:53.568091 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 427/865] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:53 2022] GET /identity/v3/role_assignments?user.id=d89e8e9616b34203a3fa71611fed1665&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=05605552a8ef41ce895f7d776aefd260 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:53.569543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 439/866] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:53.575226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9005a-884c-450c-b1e2-fdc5e21d08ee None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:53.736869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9005a-884c-450c-b1e2-fdc5e21d08ee None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:53.797965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90376a8-92fe-41f5-8782-ddeb0019fa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:53.798894 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90376a8-92fe-41f5-8782-ddeb0019fa0d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:53.799395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90376a8-92fe-41f5-8782-ddeb0019fa0d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:53.799875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90376a8-92fe-41f5-8782-ddeb0019fa0d None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:53.801228 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90376a8-92fe-41f5-8782-ddeb0019fa0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:53.801777 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90376a8-92fe-41f5-8782-ddeb0019fa0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:53.804413 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90376a8-92fe-41f5-8782-ddeb0019fa0d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:53.827736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 428/867] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:53.834204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374123a-bfb6-4b3c-82d5-695b95ddd6fb None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:53.963127 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374123a-bfb6-4b3c-82d5-695b95ddd6fb None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:54.004551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e388cf-561a-4e86-8570-fb8c557b784b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:54.005087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e388cf-561a-4e86-8570-fb8c557b784b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:54.005362 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e388cf-561a-4e86-8570-fb8c557b784b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:54.005634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e388cf-561a-4e86-8570-fb8c557b784b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:54.006375 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e388cf-561a-4e86-8570-fb8c557b784b None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=04ad38e3598f4b15b74398dbdb9e69b3) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:54.006678 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e388cf-561a-4e86-8570-fb8c557b784b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:54.008140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e388cf-561a-4e86-8570-fb8c557b784b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:54.014945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 440/868] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:53 2022] GET /identity/v3/role_assignments?user.id=04ad38e3598f4b15b74398dbdb9e69b3&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=638e1fc82db44124ae615c46408110a7 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:54.040158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fade45-9280-41da-bc5d-f7519db80e23 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:54.040683 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fade45-9280-41da-bc5d-f7519db80e23 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:54.040683 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fade45-9280-41da-bc5d-f7519db80e23 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:54.042126 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 429/869] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:54.049689 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529f4db-4391-4051-adeb-b9d982374856 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:54.050041 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529f4db-4391-4051-adeb-b9d982374856 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:54.050247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529f4db-4391-4051-adeb-b9d982374856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:54.070630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3529f4db-4391-4051-adeb-b9d982374856 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:54.071893 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3529f4db-4391-4051-adeb-b9d982374856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:54.100087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:54.151546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 441/870] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:54 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:50:54.174978 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fade45-9280-41da-bc5d-f7519db80e23 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:54.213394 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:54.288319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fade45-9280-41da-bc5d-f7519db80e23 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:54.325111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a33691-36d3-4b80-8929-f082a1da815f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:54.325749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a33691-36d3-4b80-8929-f082a1da815f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:54.326026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a33691-36d3-4b80-8929-f082a1da815f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:54.326292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a33691-36d3-4b80-8929-f082a1da815f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:54.326875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a33691-36d3-4b80-8929-f082a1da815f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:54.328278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a33691-36d3-4b80-8929-f082a1da815f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-00a33691-36d3-4b80-8929-f082a1da815f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:54.338239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:54.339278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:54.340251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:54.340251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:54.340251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:54.340251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:54.340251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:54.340251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:54.340251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:54.340251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:54.340251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:54.340251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:54.340251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:50:54.340251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:54.340251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:50:54.340251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:54.340251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 430/871] 10.222.0.20 () {56 vars in 1132 bytes} [Sun Aug 7 00:50:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:54.348072 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529f4db-4391-4051-adeb-b9d982374856 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:54.460500 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529f4db-4391-4051-adeb-b9d982374856 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:54.497282 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302864a-cba2-48bc-8894-c7c28bad7531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:54.497886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302864a-cba2-48bc-8894-c7c28bad7531 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:54.498163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302864a-cba2-48bc-8894-c7c28bad7531 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:54.498431 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302864a-cba2-48bc-8894-c7c28bad7531 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:54.499077 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302864a-cba2-48bc-8894-c7c28bad7531 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:54.499374 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302864a-cba2-48bc-8894-c7c28bad7531 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:54.500846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302864a-cba2-48bc-8894-c7c28bad7531 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:54.506268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 442/872] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Aug 7 00:50:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:54.512608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a33691-36d3-4b80-8929-f082a1da815f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:54.631659 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:54.635626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a33691-36d3-4b80-8929-f082a1da815f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:54.676211 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1317d-326d-4eee-997e-c859b5790951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:54.676884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1317d-326d-4eee-997e-c859b5790951 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:54.677170 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1317d-326d-4eee-997e-c859b5790951 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:54.677506 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1317d-326d-4eee-997e-c859b5790951 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:54.678162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1317d-326d-4eee-997e-c859b5790951 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:54.678466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1317d-326d-4eee-997e-c859b5790951 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:54.679851 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1317d-326d-4eee-997e-c859b5790951 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:54.685570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 431/873] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Aug 7 00:50:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:55.374753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91d10c-cc22-4e22-9d3a-8eb39062c66e None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:55.375365 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91d10c-cc22-4e22-9d3a-8eb39062c66e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:55.375365 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91d10c-cc22-4e22-9d3a-8eb39062c66e None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:55.377768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 443/874] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:55.383416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9c8bb-6ff3-43dc-ac00-80889da7f314 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:55.383872 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9c8bb-6ff3-43dc-ac00-80889da7f314 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:55.383977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9c8bb-6ff3-43dc-ac00-80889da7f314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:55.405833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-53a9c8bb-6ff3-43dc-ac00-80889da7f314 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:55.407035 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-53a9c8bb-6ff3-43dc-ac00-80889da7f314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:55.480293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 432/875] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:55 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:50:55.503407 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91d10c-cc22-4e22-9d3a-8eb39062c66e None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:55.537575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:55.617568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91d10c-cc22-4e22-9d3a-8eb39062c66e None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:55.652796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3264a7-1d46-48da-a7e4-561aad914c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:55.653427 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3264a7-1d46-48da-a7e4-561aad914c78 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:55.653770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3264a7-1d46-48da-a7e4-561aad914c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:55.654040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3264a7-1d46-48da-a7e4-561aad914c78 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:55.654619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3264a7-1d46-48da-a7e4-561aad914c78 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:55.656024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3264a7-1d46-48da-a7e4-561aad914c78 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-0d3264a7-1d46-48da-a7e4-561aad914c78 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:55.667526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:55.668783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:55.669969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:55.669969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:55.669969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:55.669969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:55.669969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:55.669969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:55.669969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:55.669969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:55.669969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:55.669969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:55.669969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:50:55.669969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:55.669969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:50:55.669969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:55.669969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 444/876] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:50:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:55.677611 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9c8bb-6ff3-43dc-ac00-80889da7f314 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:55.777400 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2143d6-f354-4855-86ed-0032787e8828 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:55.777746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2143d6-f354-4855-86ed-0032787e8828 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:55.777950 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2143d6-f354-4855-86ed-0032787e8828 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:55.779544 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 445/877] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:50:55.784914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3124e-c429-48f8-a3e7-ee06cf42da52 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:55.785198 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3124e-c429-48f8-a3e7-ee06cf42da52 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:55.785476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3124e-c429-48f8-a3e7-ee06cf42da52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:55.791570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9c8bb-6ff3-43dc-ac00-80889da7f314 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:55.794979 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:55.811689 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-b0d3124e-c429-48f8-a3e7-ee06cf42da52 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:55.814719 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b0d3124e-c429-48f8-a3e7-ee06cf42da52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:55.837396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98220bb-9e7e-47e3-b7b0-bc1b17c41b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:55.837857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98220bb-9e7e-47e3-b7b0-bc1b17c41b44 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:55.838145 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98220bb-9e7e-47e3-b7b0-bc1b17c41b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:55.838419 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98220bb-9e7e-47e3-b7b0-bc1b17c41b44 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:55.839094 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98220bb-9e7e-47e3-b7b0-bc1b17c41b44 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:55.839402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98220bb-9e7e-47e3-b7b0-bc1b17c41b44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:55.840879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98220bb-9e7e-47e3-b7b0-bc1b17c41b44 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:55.851715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 433/878] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:50:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:55.853139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98220bb-9e7e-47e3-b7b0-bc1b17c41b44 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:55.928010 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 446/879] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:55 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:50:55.945644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3124e-c429-48f8-a3e7-ee06cf42da52 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:55.969101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:56.002167 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98220bb-9e7e-47e3-b7b0-bc1b17c41b44 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:56.050119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0a428-4096-4f6a-8095-df014afb0439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:56.050750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0a428-4096-4f6a-8095-df014afb0439 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:56.051029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0a428-4096-4f6a-8095-df014afb0439 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:56.051301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0a428-4096-4f6a-8095-df014afb0439 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:56.052340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0a428-4096-4f6a-8095-df014afb0439 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:56.052340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0a428-4096-4f6a-8095-df014afb0439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:56.053744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0a428-4096-4f6a-8095-df014afb0439 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:56.063919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 434/880] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:50:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:56.071096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0a428-4096-4f6a-8095-df014afb0439 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:56.103168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:56.115828 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3124e-c429-48f8-a3e7-ee06cf42da52 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:56.161968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8a531-3866-442e-9384-311e9490db27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:56.162619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8a531-3866-442e-9384-311e9490db27 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:56.162899 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8a531-3866-442e-9384-311e9490db27 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:56.163170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8a531-3866-442e-9384-311e9490db27 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:56.177107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8a531-3866-442e-9384-311e9490db27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-91c8a531-3866-442e-9384-311e9490db27 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:50:56.182784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:56.183746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:56.184682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:56.184682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:56.184682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:56.184682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:56.184682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:50:56.184682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:50:56.184682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:50:56.184682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:50:56.184682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:50:56.184682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:50:56.184682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:50:56.184682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:56.187986 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 447/881] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Aug 7 00:50:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:56.190946 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8a531-3866-442e-9384-311e9490db27 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:56.218803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0a428-4096-4f6a-8095-df014afb0439 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:56.270206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fd5ae-f6ef-4013-8940-feb61e4e3109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:56.271227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fd5ae-f6ef-4013-8940-feb61e4e3109 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:56.271983 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fd5ae-f6ef-4013-8940-feb61e4e3109 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:56.272484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fd5ae-f6ef-4013-8940-feb61e4e3109 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:56.273955 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fd5ae-f6ef-4013-8940-feb61e4e3109 None admin] RBAC: Adding query filter params (interface=public, service_id=f5680f42e1294820b0810ddb9c9572d1, region_id=RegionOne) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:56.274725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fd5ae-f6ef-4013-8940-feb61e4e3109 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:56.277515 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fd5ae-f6ef-4013-8940-feb61e4e3109 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:56.284396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:56.287024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 435/882] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Aug 7 00:50:56 2022] GET /identity/v3/endpoints?service_id=f5680f42e1294820b0810ddb9c9572d1&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:56.292255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fd5ae-f6ef-4013-8940-feb61e4e3109 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:56.323731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8a531-3866-442e-9384-311e9490db27 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:56.363994 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f514f0f-cd14-4bd4-af59-602d531147a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:56.365606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f514f0f-cd14-4bd4-af59-602d531147a0 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:56.366090 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f514f0f-cd14-4bd4-af59-602d531147a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:56.366817 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f514f0f-cd14-4bd4-af59-602d531147a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:56.367949 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f514f0f-cd14-4bd4-af59-602d531147a0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:56.368470 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f514f0f-cd14-4bd4-af59-602d531147a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:56.370946 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f514f0f-cd14-4bd4-af59-602d531147a0 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:56.383041 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 448/883] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Aug 7 00:50:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:56.385782 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:56.386375 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719daf7-fed6-49e7-a96c-d397ec9f6737 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:56.387599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719daf7-fed6-49e7-a96c-d397ec9f6737 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:56.388073 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719daf7-fed6-49e7-a96c-d397ec9f6737 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:56.390572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 449/884] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:56.390572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719daf7-fed6-49e7-a96c-d397ec9f6737 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:56.405974 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fd5ae-f6ef-4013-8940-feb61e4e3109 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:56.442604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966aceb5-d7f2-4456-99d4-e672e6da34c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:56.443283 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966aceb5-d7f2-4456-99d4-e672e6da34c6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:56.443662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966aceb5-d7f2-4456-99d4-e672e6da34c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:56.443964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966aceb5-d7f2-4456-99d4-e672e6da34c6 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:56.444573 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966aceb5-d7f2-4456-99d4-e672e6da34c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:56.445939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966aceb5-d7f2-4456-99d4-e672e6da34c6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:56.455948 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 436/885] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Aug 7 00:50:56 2022] GET /identity/v3/services => generated 1011 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:50:56.455948 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149ed8e-4260-41dd-936c-25819d9895b7 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:56.455948 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149ed8e-4260-41dd-936c-25819d9895b7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:56.455948 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149ed8e-4260-41dd-936c-25819d9895b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:56.475834 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-8149ed8e-4260-41dd-936c-25819d9895b7 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:56.478258 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8149ed8e-4260-41dd-936c-25819d9895b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:56.514065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719daf7-fed6-49e7-a96c-d397ec9f6737 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:56.565579 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b944-b180-475e-a75f-3ad80415cc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:56.566559 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b944-b180-475e-a75f-3ad80415cc28 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:56.566846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b944-b180-475e-a75f-3ad80415cc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:56.567123 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b944-b180-475e-a75f-3ad80415cc28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:56.570698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 437/886] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:56 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:50:56.584290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:56.588545 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2b944-b180-475e-a75f-3ad80415cc28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:56.590273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2b944-b180-475e-a75f-3ad80415cc28 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:56.596198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149ed8e-4260-41dd-936c-25819d9895b7 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-9fb2b944-b180-475e-a75f-3ad80415cc28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:56.607430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:56.608571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:56.609514 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:56.609514 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:56.609514 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:56.614296 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 450/887] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:56.615705 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b944-b180-475e-a75f-3ad80415cc28 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:56.700538 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:56.728307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149ed8e-4260-41dd-936c-25819d9895b7 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:56.773579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574bdfb-18c0-4030-a78e-6eec7c8052fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:56.774232 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574bdfb-18c0-4030-a78e-6eec7c8052fb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:56.774544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574bdfb-18c0-4030-a78e-6eec7c8052fb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:56.774819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574bdfb-18c0-4030-a78e-6eec7c8052fb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:56.775052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b944-b180-475e-a75f-3ad80415cc28 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:56.775416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574bdfb-18c0-4030-a78e-6eec7c8052fb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:56.776829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574bdfb-18c0-4030-a78e-6eec7c8052fb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-3574bdfb-18c0-4030-a78e-6eec7c8052fb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:56.787131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:56.788213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:56.789931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:56.789931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:56.789931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:56.789931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:56.789931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:56.789931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:56.789931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:56.789931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:56.789931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:56.789931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:56.789931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:50:56.789931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:56.789931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:50:56.789931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:56.789931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 438/888] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Aug 7 00:50:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:50:56.790742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5b6b3-695f-4af3-b32a-b3e5c8819df7 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:56.790742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5b6b3-695f-4af3-b32a-b3e5c8819df7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:56.790742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5b6b3-695f-4af3-b32a-b3e5c8819df7 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:56.792060 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 439/889] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:56.794738 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5b6b3-695f-4af3-b32a-b3e5c8819df7 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:56.821083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc56de-feab-4c80-b117-b3bde37f83f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:56.822161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc56de-feab-4c80-b117-b3bde37f83f5 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:56.822448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc56de-feab-4c80-b117-b3bde37f83f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:56.822731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc56de-feab-4c80-b117-b3bde37f83f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:56.823684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc56de-feab-4c80-b117-b3bde37f83f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:56.824027 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc56de-feab-4c80-b117-b3bde37f83f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:56.826083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc56de-feab-4c80-b117-b3bde37f83f5 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:56.843390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 451/890] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:56.844708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b4e5e-4788-48c1-a614-530dc5f5195b None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:56.844999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b4e5e-4788-48c1-a614-530dc5f5195b None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:56.845276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b4e5e-4788-48c1-a614-530dc5f5195b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:56.868783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-b14b4e5e-4788-48c1-a614-530dc5f5195b None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:56.870509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b14b4e5e-4788-48c1-a614-530dc5f5195b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:56.916855 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5b6b3-695f-4af3-b32a-b3e5c8819df7 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:56.927198 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:56.953144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 452/891] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:56 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:50:56.953960 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b4e5e-4788-48c1-a614-530dc5f5195b None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:56.971706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab199c9-571a-4474-891e-f63be776271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:56.972907 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab199c9-571a-4474-891e-f63be776271c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:56.973370 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab199c9-571a-4474-891e-f63be776271c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:56.974080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab199c9-571a-4474-891e-f63be776271c None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:56.975371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab199c9-571a-4474-891e-f63be776271c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:56.975884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab199c9-571a-4474-891e-f63be776271c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:56.977304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab199c9-571a-4474-891e-f63be776271c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:56.983003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 440/892] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Aug 7 00:50:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:56.984475 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab199c9-571a-4474-891e-f63be776271c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:56.994542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:57.077109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b4e5e-4788-48c1-a614-530dc5f5195b None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:57.105715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab199c9-571a-4474-891e-f63be776271c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:57.119082 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a47c8-f9ee-45a4-ad2a-0272db9e7a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:57.119727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a47c8-f9ee-45a4-ad2a-0272db9e7a37 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:57.120092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a47c8-f9ee-45a4-ad2a-0272db9e7a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:57.120366 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a47c8-f9ee-45a4-ad2a-0272db9e7a37 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:57.128930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a47c8-f9ee-45a4-ad2a-0272db9e7a37 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:57.130400 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a47c8-f9ee-45a4-ad2a-0272db9e7a37 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-7b5a47c8-f9ee-45a4-ad2a-0272db9e7a37 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:50:57.143653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:57.145205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:57.146213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:57.146213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:57.146213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:50:57.146213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:50:57.146213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:50:57.146213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:50:57.146213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:50:57.146213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:50:57.146213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:50:57.146213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:50:57.146213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 453/893] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Aug 7 00:50:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:57.146213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a47c8-f9ee-45a4-ad2a-0272db9e7a37 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:57.153039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d6754-9442-4473-b415-15c4280d4548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:57.153975 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d6754-9442-4473-b415-15c4280d4548 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:57.154259 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d6754-9442-4473-b415-15c4280d4548 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:57.154587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d6754-9442-4473-b415-15c4280d4548 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:57.155244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d6754-9442-4473-b415-15c4280d4548 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:57.156651 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d6754-9442-4473-b415-15c4280d4548 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:57.183941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 441/894] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Aug 7 00:50:56 2022] POST /identity/v3/services => generated 269 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:50:57.183941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d6754-9442-4473-b415-15c4280d4548 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:57.201570 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:57.281811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a47c8-f9ee-45a4-ad2a-0272db9e7a37 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:57.322811 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:57.341810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43b2f9-51ee-4f19-9098-82377e8b67a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:57.344155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43b2f9-51ee-4f19-9098-82377e8b67a6 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:57.346794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43b2f9-51ee-4f19-9098-82377e8b67a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:57.347475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43b2f9-51ee-4f19-9098-82377e8b67a6 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:57.349434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43b2f9-51ee-4f19-9098-82377e8b67a6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:57.350279 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43b2f9-51ee-4f19-9098-82377e8b67a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:57.354325 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43b2f9-51ee-4f19-9098-82377e8b67a6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:57.372541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 454/895] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Aug 7 00:50:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:57.380259 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d6754-9442-4473-b415-15c4280d4548 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:57.431508 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c81286-9cda-43ab-8939-ee930de4cc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:57.432196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c81286-9cda-43ab-8939-ee930de4cc0f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:57.432487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c81286-9cda-43ab-8939-ee930de4cc0f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:57.432783 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c81286-9cda-43ab-8939-ee930de4cc0f None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:57.433562 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c81286-9cda-43ab-8939-ee930de4cc0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:57.433875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c81286-9cda-43ab-8939-ee930de4cc0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:57.435415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c81286-9cda-43ab-8939-ee930de4cc0f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:57.458900 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 442/896] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Aug 7 00:50:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:57.466917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43b2f9-51ee-4f19-9098-82377e8b67a6 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:57.594265 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:57.601170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43b2f9-51ee-4f19-9098-82377e8b67a6 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:57.649308 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d928d2-b23e-4509-a74a-53b2b30b517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:57.649945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d928d2-b23e-4509-a74a-53b2b30b517b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:57.650276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d928d2-b23e-4509-a74a-53b2b30b517b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:57.650576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d928d2-b23e-4509-a74a-53b2b30b517b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:57.727588 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d928d2-b23e-4509-a74a-53b2b30b517b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:57.729346 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d928d2-b23e-4509-a74a-53b2b30b517b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:57.838453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 455/897] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:50:57 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:50:57.839034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:57.849061 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c81286-9cda-43ab-8939-ee930de4cc0f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:57.965037 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c81286-9cda-43ab-8939-ee930de4cc0f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:57.991601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:58.003612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504a471-7f8e-49ae-96eb-953c2fc69d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:58.004351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504a471-7f8e-49ae-96eb-953c2fc69d26 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:58.004634 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504a471-7f8e-49ae-96eb-953c2fc69d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:58.004907 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504a471-7f8e-49ae-96eb-953c2fc69d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:58.015738 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504a471-7f8e-49ae-96eb-953c2fc69d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:58.018517 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504a471-7f8e-49ae-96eb-953c2fc69d26 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-3504a471-7f8e-49ae-96eb-953c2fc69d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:50:58.034441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:58.035544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:50:58.036521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:50:58.036521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:50:58.036521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:58.036521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 443/898] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:58.041563 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d928d2-b23e-4509-a74a-53b2b30b517b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:58.152789 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d928d2-b23e-4509-a74a-53b2b30b517b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:58.190850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66bfb6-2dfa-49b6-aef5-24821ea9d925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:58.191842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66bfb6-2dfa-49b6-aef5-24821ea9d925 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:58.192376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66bfb6-2dfa-49b6-aef5-24821ea9d925 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:58.192851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66bfb6-2dfa-49b6-aef5-24821ea9d925 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:58.193704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66bfb6-2dfa-49b6-aef5-24821ea9d925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:58.194228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66bfb6-2dfa-49b6-aef5-24821ea9d925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:58.195802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66bfb6-2dfa-49b6-aef5-24821ea9d925 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:58.209496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 456/899] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:58.220299 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504a471-7f8e-49ae-96eb-953c2fc69d26 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:58.330860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504a471-7f8e-49ae-96eb-953c2fc69d26 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:58.367830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2637f18-6f34-47bb-a451-58c6da3f1ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:58.368497 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2637f18-6f34-47bb-a451-58c6da3f1ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:58.368780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2637f18-6f34-47bb-a451-58c6da3f1ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:58.369058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2637f18-6f34-47bb-a451-58c6da3f1ef8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:58.376541 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2637f18-6f34-47bb-a451-58c6da3f1ef8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:58.377611 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2637f18-6f34-47bb-a451-58c6da3f1ef8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:58.389292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-f2637f18-6f34-47bb-a451-58c6da3f1ef8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:58.389292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:58.389292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:58.389292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:58.389292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:58.389292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:58.389292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:58.389292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:58.389292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:58.389292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:58.389292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:58.389292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:58.389292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:50:58.389292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:50:58.389292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:58.390233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:58.391177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:50:58.391177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:50:58.391177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:50:58.391177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:50:58.391177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:50:58.391177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:50:58.391177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:50:58.391177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:58.391177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 444/900] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:50:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:58.398649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66bfb6-2dfa-49b6-aef5-24821ea9d925 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:58.462731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:58.506891 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66bfb6-2dfa-49b6-aef5-24821ea9d925 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:58.549067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb49170-ebb5-4256-afe5-b07048677791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:58.549695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb49170-ebb5-4256-afe5-b07048677791 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:58.549971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb49170-ebb5-4256-afe5-b07048677791 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:58.550240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb49170-ebb5-4256-afe5-b07048677791 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:58.550960 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb49170-ebb5-4256-afe5-b07048677791 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:58.551260 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb49170-ebb5-4256-afe5-b07048677791 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:58.552904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb49170-ebb5-4256-afe5-b07048677791 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:58.571786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 457/901] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:58.577491 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2637f18-6f34-47bb-a451-58c6da3f1ef8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:58.616785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:58.668545 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cc154-d7a3-4dab-a9d5-6a9087fe7c08 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:58.668871 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cc154-d7a3-4dab-a9d5-6a9087fe7c08 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:58.669118 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8cc154-d7a3-4dab-a9d5-6a9087fe7c08 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:58.670899 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 458/902] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:58.679857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d10823-99bc-43de-9811-3b8fc173138d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:58.680309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d10823-99bc-43de-9811-3b8fc173138d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:58.680956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d10823-99bc-43de-9811-3b8fc173138d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:58.701657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2637f18-6f34-47bb-a451-58c6da3f1ef8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:58.703597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-b2d10823-99bc-43de-9811-3b8fc173138d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:58.705804 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b2d10823-99bc-43de-9811-3b8fc173138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:58.738911 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91c95f-2f24-472c-8290-e78fce49b101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:58.739443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91c95f-2f24-472c-8290-e78fce49b101 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:58.739723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91c95f-2f24-472c-8290-e78fce49b101 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:58.740085 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91c95f-2f24-472c-8290-e78fce49b101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:58.740820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91c95f-2f24-472c-8290-e78fce49b101 None admin] RBAC: Adding query filter params (role.id=80c00799fe044866b3fdf89e57748760, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=d89e8e9616b34203a3fa71611fed1665) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:58.741176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91c95f-2f24-472c-8290-e78fce49b101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:58.742629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91c95f-2f24-472c-8290-e78fce49b101 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:58.748857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 445/903] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:50:58 2022] GET /identity/v3/role_assignments?user.id=d89e8e9616b34203a3fa71611fed1665&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=80c00799fe044866b3fdf89e57748760 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:58.799616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 459/904] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:50:58.820239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91c95f-2f24-472c-8290-e78fce49b101 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:58.939392 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:58.942730 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91c95f-2f24-472c-8290-e78fce49b101 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:58.981437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ed494-ecff-4c2a-be84-bd51db2b7169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:58.982089 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ed494-ecff-4c2a-be84-bd51db2b7169 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:58.982374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ed494-ecff-4c2a-be84-bd51db2b7169 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:58.982651 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ed494-ecff-4c2a-be84-bd51db2b7169 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:58.983244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ed494-ecff-4c2a-be84-bd51db2b7169 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:58.984650 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ed494-ecff-4c2a-be84-bd51db2b7169 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-9d8ed494-ecff-4c2a-be84-bd51db2b7169 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:58.994364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:58.995393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:58.996308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:58.996308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:58.996308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:58.996308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:58.996308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:58.996308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:58.996308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:58.996308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:58.996308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:58.996308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:58.996308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:50:58.996308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:58.996308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:50:58.996308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:58.996308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 446/905] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:50:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:59.001612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d10823-99bc-43de-9811-3b8fc173138d None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:59.060304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:59.112925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d10823-99bc-43de-9811-3b8fc173138d None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:59.152801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce150557-430d-4461-859d-ad38c980d6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:59.153560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce150557-430d-4461-859d-ad38c980d6fc None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:59.153851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce150557-430d-4461-859d-ad38c980d6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:59.154128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce150557-430d-4461-859d-ad38c980d6fc None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:59.154781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce150557-430d-4461-859d-ad38c980d6fc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:59.155147 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce150557-430d-4461-859d-ad38c980d6fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:59.156586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce150557-430d-4461-859d-ad38c980d6fc None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:59.167052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 460/906] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:50:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:59.169029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ed494-ecff-4c2a-be84-bd51db2b7169 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:59.284280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ed494-ecff-4c2a-be84-bd51db2b7169 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:59.322193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf12d77-16f1-40a8-b65f-418aa57d1eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:59.322819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf12d77-16f1-40a8-b65f-418aa57d1eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:59.323105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf12d77-16f1-40a8-b65f-418aa57d1eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:59.323380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf12d77-16f1-40a8-b65f-418aa57d1eb4 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:59.324051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf12d77-16f1-40a8-b65f-418aa57d1eb4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:59.324359 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf12d77-16f1-40a8-b65f-418aa57d1eb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:59.325738 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf12d77-16f1-40a8-b65f-418aa57d1eb4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:59.331614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 447/907] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Aug 7 00:50:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:50:59.337286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce150557-430d-4461-859d-ad38c980d6fc None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:59.391218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390bc71-50bf-45b3-9d00-188e7580377b None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:59.391932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390bc71-50bf-45b3-9d00-188e7580377b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:59.392406 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390bc71-50bf-45b3-9d00-188e7580377b None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:59.394201 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 448/908] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:59.399894 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f94321-7175-467c-826c-5e69893c0212 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:59.400525 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f94321-7175-467c-826c-5e69893c0212 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:59.401008 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f94321-7175-467c-826c-5e69893c0212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:59.425564 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-02f94321-7175-467c-826c-5e69893c0212 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:59.427370 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-02f94321-7175-467c-826c-5e69893c0212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:59.448033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce150557-430d-4461-859d-ad38c980d6fc None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:59.459502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:59.466694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:59.496426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242cf2f-1e5e-44df-8c6e-cc9300ef431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:59.497714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242cf2f-1e5e-44df-8c6e-cc9300ef431b None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:59.498219 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242cf2f-1e5e-44df-8c6e-cc9300ef431b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:59.498688 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242cf2f-1e5e-44df-8c6e-cc9300ef431b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:59.499555 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242cf2f-1e5e-44df-8c6e-cc9300ef431b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:59.501731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242cf2f-1e5e-44df-8c6e-cc9300ef431b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:59.531928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 449/909] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:50:59.540338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 461/910] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 00:50:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:50:59.554297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f94321-7175-467c-826c-5e69893c0212 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:59.656331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb70bde-650a-4423-a2c1-aa0793c2fcf1 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:59.656594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb70bde-650a-4423-a2c1-aa0793c2fcf1 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:59.656870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb70bde-650a-4423-a2c1-aa0793c2fcf1 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:59.659714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 462/911] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:50:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:50:59.665877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b461266-d2f0-4c29-9482-c2ee50fde6a9 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:59.666196 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b461266-d2f0-4c29-9482-c2ee50fde6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:59.666426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b461266-d2f0-4c29-9482-c2ee50fde6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:59.681871 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f94321-7175-467c-826c-5e69893c0212 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:59.686976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-9b461266-d2f0-4c29-9482-c2ee50fde6a9 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:50:59.688257 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9b461266-d2f0-4c29-9482-c2ee50fde6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:50:59.729023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e0dfe-8ce4-44fb-82af-dea3acb35cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:59.729661 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0dfe-8ce4-44fb-82af-dea3acb35cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:59.729936 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0dfe-8ce4-44fb-82af-dea3acb35cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:59.730207 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0dfe-8ce4-44fb-82af-dea3acb35cb9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:59.730785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e0dfe-8ce4-44fb-82af-dea3acb35cb9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:59.732194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e0dfe-8ce4-44fb-82af-dea3acb35cb9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-789e0dfe-8ce4-44fb-82af-dea3acb35cb9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:50:59.741816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:50:59.742821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:50:59.744077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:50:59.744077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:50:59.744077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:50:59.744077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:50:59.744077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:50:59.744077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:50:59.744077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:50:59.744077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:50:59.744077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:50:59.744077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:50:59.744077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:50:59.744077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:50:59.744077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:50:59.744077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:50:59.744077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 450/912] 10.222.0.20 () {56 vars in 1132 bytes} [Sun Aug 7 00:50:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:50:59.748812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e0dfe-8ce4-44fb-82af-dea3acb35cb9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:59.775855 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:59.792751 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 463/913] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:50:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:50:59.834219 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b461266-d2f0-4c29-9482-c2ee50fde6a9 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:59.878887 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e0dfe-8ce4-44fb-82af-dea3acb35cb9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:50:59.919797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e51f9-764d-4632-965c-74e3bdf70ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:50:59.920696 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e51f9-764d-4632-965c-74e3bdf70ecf None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:50:59.920996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e51f9-764d-4632-965c-74e3bdf70ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:50:59.921275 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e51f9-764d-4632-965c-74e3bdf70ecf None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:50:59.922046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e51f9-764d-4632-965c-74e3bdf70ecf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:50:59.922461 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e51f9-764d-4632-965c-74e3bdf70ecf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:50:59.924772 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e51f9-764d-4632-965c-74e3bdf70ecf None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:50:59.931006 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 451/914] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Aug 7 00:50:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:50:59.937828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e51f9-764d-4632-965c-74e3bdf70ecf None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:50:59.959262 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:50:59.965229 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b461266-d2f0-4c29-9482-c2ee50fde6a9 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:00.018700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964b049-2b11-420f-8c27-ad0adfbbe261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:00.020106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964b049-2b11-420f-8c27-ad0adfbbe261 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:00.020615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964b049-2b11-420f-8c27-ad0adfbbe261 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:00.021093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964b049-2b11-420f-8c27-ad0adfbbe261 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:00.022003 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964b049-2b11-420f-8c27-ad0adfbbe261 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:00.023684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964b049-2b11-420f-8c27-ad0adfbbe261 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:00.042950 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 464/915] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Aug 7 00:50:59 2022] POST /identity/v3/services => generated 241 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:51:00.054422 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:00.079868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e51f9-764d-4632-965c-74e3bdf70ecf None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:00.129860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993c093-61be-4f2b-8032-a9e58afce55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:00.130831 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993c093-61be-4f2b-8032-a9e58afce55e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:00.131351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993c093-61be-4f2b-8032-a9e58afce55e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:00.131771 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993c093-61be-4f2b-8032-a9e58afce55e None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:00.132796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993c093-61be-4f2b-8032-a9e58afce55e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:00.133257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993c093-61be-4f2b-8032-a9e58afce55e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:00.134901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993c093-61be-4f2b-8032-a9e58afce55e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:00.141472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 452/916] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Aug 7 00:50:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:00.147971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964b049-2b11-420f-8c27-ad0adfbbe261 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:00.274780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964b049-2b11-420f-8c27-ad0adfbbe261 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:00.311448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcc17a-d0f5-48c8-8bbb-f91a8a72feb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:00.312075 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcc17a-d0f5-48c8-8bbb-f91a8a72feb1 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:00.312353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcc17a-d0f5-48c8-8bbb-f91a8a72feb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:00.312622 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcc17a-d0f5-48c8-8bbb-f91a8a72feb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:00.313373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcc17a-d0f5-48c8-8bbb-f91a8a72feb1 None admin] RBAC: Adding query filter params (interface=public, service_id=3737627826c543bbbd7979f135121636, region_id=RegionOne) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:00.313680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcc17a-d0f5-48c8-8bbb-f91a8a72feb1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:00.315076 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcc17a-d0f5-48c8-8bbb-f91a8a72feb1 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:00.321227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 465/917] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Aug 7 00:51:00 2022] GET /identity/v3/endpoints?service_id=3737627826c543bbbd7979f135121636&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:00.326672 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993c093-61be-4f2b-8032-a9e58afce55e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:00.433586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993c093-61be-4f2b-8032-a9e58afce55e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:00.469033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d81bd-70e5-4d70-b646-4eb76e84c331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:00.470218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d81bd-70e5-4d70-b646-4eb76e84c331 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:00.470532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d81bd-70e5-4d70-b646-4eb76e84c331 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:00.470766 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d81bd-70e5-4d70-b646-4eb76e84c331 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:00.471378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d81bd-70e5-4d70-b646-4eb76e84c331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:00.472827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d81bd-70e5-4d70-b646-4eb76e84c331 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:00.479646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 453/918] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Aug 7 00:51:00 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:51:00.915465 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d5091-9273-4a47-9d15-a253e392b13f None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:00.915985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d5091-9273-4a47-9d15-a253e392b13f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:00.915985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d5091-9273-4a47-9d15-a253e392b13f None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:00.917522 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 466/919] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:00.924227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3df5a-3ad1-4c41-b580-7e67f6491456 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:00.924662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3df5a-3ad1-4c41-b580-7e67f6491456 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:00.924836 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3df5a-3ad1-4c41-b580-7e67f6491456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:00.937729 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:00.943943 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-54e3df5a-3ad1-4c41-b580-7e67f6491456 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:00.945774 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-54e3df5a-3ad1-4c41-b580-7e67f6491456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:01.022139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 454/920] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:01.044928 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d5091-9273-4a47-9d15-a253e392b13f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:01.072052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:01.165858 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d5091-9273-4a47-9d15-a253e392b13f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:01.205458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3c0ad-4036-4ef3-a459-929bed86b283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:01.206116 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3c0ad-4036-4ef3-a459-929bed86b283 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:01.206398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3c0ad-4036-4ef3-a459-929bed86b283 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:01.206666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3c0ad-4036-4ef3-a459-929bed86b283 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:01.218887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3c0ad-4036-4ef3-a459-929bed86b283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-7ca3c0ad-4036-4ef3-a459-929bed86b283 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:01.225025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:01.225981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:01.226832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:01.226832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:01.226832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:01.226832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:01.226832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:01.226832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:01.226832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:01.226832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:01.226832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:01.226832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:01.226832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:51:01.226832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:01.226832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 467/921] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Aug 7 00:51:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:01.232738 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3df5a-3ad1-4c41-b580-7e67f6491456 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:01.339545 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3df5a-3ad1-4c41-b580-7e67f6491456 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:01.378553 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09664608-827e-4498-928f-98db5af07140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:01.379171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09664608-827e-4498-928f-98db5af07140 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:01.379453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09664608-827e-4498-928f-98db5af07140 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:01.379731 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09664608-827e-4498-928f-98db5af07140 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:01.380434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09664608-827e-4498-928f-98db5af07140 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:01.380737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09664608-827e-4498-928f-98db5af07140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:01.382174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09664608-827e-4498-928f-98db5af07140 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:01.384570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:01.394214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 455/922] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Aug 7 00:51:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:01.399732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3c0ad-4036-4ef3-a459-929bed86b283 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:01.499846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:01.520337 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3c0ad-4036-4ef3-a459-929bed86b283 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:01.556672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541cd8b-b613-4304-b907-f993d624489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:01.557319 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541cd8b-b613-4304-b907-f993d624489c None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:01.557600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541cd8b-b613-4304-b907-f993d624489c None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:01.557873 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541cd8b-b613-4304-b907-f993d624489c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:01.569707 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541cd8b-b613-4304-b907-f993d624489c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:01.571170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541cd8b-b613-4304-b907-f993d624489c None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-2541cd8b-b613-4304-b907-f993d624489c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:51:01.586477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:01.588715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:51:01.590814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:51:01.590814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:01.590814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:01.590814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 468/923] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:01.596981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09664608-827e-4498-928f-98db5af07140 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:01.715236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09664608-827e-4498-928f-98db5af07140 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:01.752981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba8572-bb73-423a-82c2-faed30d962b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:01.753518 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba8572-bb73-423a-82c2-faed30d962b3 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:01.753803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba8572-bb73-423a-82c2-faed30d962b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:01.754076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba8572-bb73-423a-82c2-faed30d962b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:01.754727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba8572-bb73-423a-82c2-faed30d962b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:01.755029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba8572-bb73-423a-82c2-faed30d962b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:01.756424 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba8572-bb73-423a-82c2-faed30d962b3 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:01.770076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 456/924] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:01.775760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541cd8b-b613-4304-b907-f993d624489c None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:01.881568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ff4f-69e6-48a5-96d5-c396280f6919 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:01.881897 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ff4f-69e6-48a5-96d5-c396280f6919 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:01.882111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ff4f-69e6-48a5-96d5-c396280f6919 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:01.883700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 457/925] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:51:01.888621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28154c1-f4f7-4585-8a23-99d9d6853dc2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:01.888903 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28154c1-f4f7-4585-8a23-99d9d6853dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:01.889176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28154c1-f4f7-4585-8a23-99d9d6853dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:01.894623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541cd8b-b613-4304-b907-f993d624489c None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:01.911834 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d28154c1-f4f7-4585-8a23-99d9d6853dc2 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:01.913398 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d28154c1-f4f7-4585-8a23-99d9d6853dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:01.932358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbf45b-0ba9-4201-ac2f-d29d21177cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:01.933077 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbf45b-0ba9-4201-ac2f-d29d21177cba None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:01.933373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbf45b-0ba9-4201-ac2f-d29d21177cba None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:01.933647 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbf45b-0ba9-4201-ac2f-d29d21177cba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:01.940431 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:01.951939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbf45b-0ba9-4201-ac2f-d29d21177cba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:01.953228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbf45b-0ba9-4201-ac2f-d29d21177cba None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-b5cbf45b-0ba9-4201-ac2f-d29d21177cba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:51:01.967336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:01.968561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:01.970099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:01.970099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:01.970099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:51:01.970099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:51:01.970099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:51:01.970099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:51:01.970099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:51:01.970099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:51:01.970099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:51:01.970099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:01.970099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 469/926] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Aug 7 00:51:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:01.975491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbf45b-0ba9-4201-ac2f-d29d21177cba None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:01.996306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:02.010889 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 458/927] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:51:02.034931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28154c1-f4f7-4585-8a23-99d9d6853dc2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:02.115717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbf45b-0ba9-4201-ac2f-d29d21177cba None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:02.157673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28154c1-f4f7-4585-8a23-99d9d6853dc2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:02.159186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751cae5-d1cf-49a0-bb85-6905c115ed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:02.160313 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751cae5-d1cf-49a0-bb85-6905c115ed82 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:02.160802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751cae5-d1cf-49a0-bb85-6905c115ed82 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:02.161510 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751cae5-d1cf-49a0-bb85-6905c115ed82 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:02.162718 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751cae5-d1cf-49a0-bb85-6905c115ed82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:02.163225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751cae5-d1cf-49a0-bb85-6905c115ed82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:02.164907 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751cae5-d1cf-49a0-bb85-6905c115ed82 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:02.192041 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 470/928] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Aug 7 00:51:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:02.196765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751cae5-d1cf-49a0-bb85-6905c115ed82 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:02.205848 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ab861-08f8-4afd-9afa-9710f4479fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:02.206469 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ab861-08f8-4afd-9afa-9710f4479fce None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:02.206748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ab861-08f8-4afd-9afa-9710f4479fce None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:02.207019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ab861-08f8-4afd-9afa-9710f4479fce None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:02.207696 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ab861-08f8-4afd-9afa-9710f4479fce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:02.209786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ab861-08f8-4afd-9afa-9710f4479fce None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:02.213689 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: WARNING keystone.server.flask.common [None req-bd9ab861-08f8-4afd-9afa-9710f4479fce None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 07 00:51:02.238383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.sql.core [None req-bd9ab861-08f8-4afd-9afa-9710f4479fce None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 00:51:02.238383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 00:51:02.238383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [parameters: {'id': '1934b43e344d400ba5d9b122178f14e3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 00:51:02.238383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80515) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 00:51:02.260612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-bd9ab861-08f8-4afd-9afa-9710f4479fce None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1934b43e344d400ba5d9b122178f14e3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1934b43e344d400ba5d9b122178f14e3. Aug 07 00:51:02.260612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:02.260612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:51:02.260612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:51:02.260612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:51:02.260612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:51:02.260612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:51:02.260612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:51:02.260612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:51:02.260612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:51:02.260612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:51:02.260612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:51:02.260612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application result.read() Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 07 00:51:02.261665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application yield resource Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise self.value Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application session.commit() Aug 07 00:51:02.262720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self.session.flush() Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application compat.raise_( Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 00:51:02.263748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 00:51:02.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 00:51:02.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 00:51:02.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 00:51:02.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 00:51:02.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 00:51:02.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 00:51:02.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 00:51:02.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 00:51:02.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 00:51:02.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 00:51:02.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 00:51:02.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 00:51:02.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 00:51:02.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 00:51:02.265248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application result.read() Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:51:02.268026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:51:02.270354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:51:02.270354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:51:02.270354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:51:02.270354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:51:02.270354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:51:02.270354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:51:02.270354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 00:51:02.270354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 00:51:02.270354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [parameters: {'id': '1934b43e344d400ba5d9b122178f14e3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 00:51:02.270354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 00:51:02.270354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:02.270354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:51:02.270354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:02.270354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:02.270354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:02.272707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:02.282510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:02.282510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 07 00:51:02.282510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 07 00:51:02.282510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:02.282510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:02.282510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 07 00:51:02.282510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 07 00:51:02.282510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1934b43e344d400ba5d9b122178f14e3. Aug 07 00:51:02.282510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:02.283670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:02.284196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 459/929] 10.222.0.20 () {60 vars in 1140 bytes} [Sun Aug 7 00:51:02 2022] POST /identity/v3/projects => generated 262 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:51:02.285860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ab861-08f8-4afd-9afa-9710f4479fce None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:02.349918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:02.350403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751cae5-d1cf-49a0-bb85-6905c115ed82 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:02.398345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972793b7-ec35-489a-9fa5-be49684a0fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:02.399434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972793b7-ec35-489a-9fa5-be49684a0fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:02.399894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972793b7-ec35-489a-9fa5-be49684a0fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:02.400673 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972793b7-ec35-489a-9fa5-be49684a0fa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:02.416365 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972793b7-ec35-489a-9fa5-be49684a0fa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:02.417988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ab861-08f8-4afd-9afa-9710f4479fce None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:02.418389 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972793b7-ec35-489a-9fa5-be49684a0fa6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-972793b7-ec35-489a-9fa5-be49684a0fa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:51:02.438585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:02.439649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:51:02.440955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:51:02.440955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:02.440955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:02.440955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 471/930] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:02.441658 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378a4d6-429f-420c-906d-ac9d4ac876de None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:02.441995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378a4d6-429f-420c-906d-ac9d4ac876de None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:02.442298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378a4d6-429f-420c-906d-ac9d4ac876de None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:02.447259 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 472/931] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:02.447259 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378a4d6-429f-420c-906d-ac9d4ac876de None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:02.467078 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393a987-331a-4661-a3f6-f6fe01568650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:02.467728 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393a987-331a-4661-a3f6-f6fe01568650 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:02.468131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393a987-331a-4661-a3f6-f6fe01568650 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:02.468632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393a987-331a-4661-a3f6-f6fe01568650 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:02.476170 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393a987-331a-4661-a3f6-f6fe01568650 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:02.477823 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393a987-331a-4661-a3f6-f6fe01568650 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:02.489737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-8393a987-331a-4661-a3f6-f6fe01568650 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:51:02.489737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:02.489737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:02.489737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:02.489737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:02.489737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:02.489737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:02.489737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:02.489737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:02.489737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:02.489737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:02.489737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:02.489737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:51:02.489737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:51:02.489737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:02.491665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:02.492616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:51:02.492616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:51:02.492616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:51:02.492616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:51:02.492616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:51:02.492616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:51:02.492616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:51:02.492616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:02.492616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 460/932] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:51:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:51:02.492616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8d1a3-6e2d-4dfb-b5a1-b0da09aba836 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:02.492616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8d1a3-6e2d-4dfb-b5a1-b0da09aba836 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:02.493260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8d1a3-6e2d-4dfb-b5a1-b0da09aba836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:02.514726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e1d8d1a3-6e2d-4dfb-b5a1-b0da09aba836 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:02.516239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e1d8d1a3-6e2d-4dfb-b5a1-b0da09aba836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:02.590496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 461/933] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:02.591419 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8d1a3-6e2d-4dfb-b5a1-b0da09aba836 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:02.591823 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378a4d6-429f-420c-906d-ac9d4ac876de None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:02.607861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:02.637756 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:02.644751 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a69e0-bd75-45ae-b56c-23367fb896e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:02.645374 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a69e0-bd75-45ae-b56c-23367fb896e1 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:02.645670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a69e0-bd75-45ae-b56c-23367fb896e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:02.646416 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a69e0-bd75-45ae-b56c-23367fb896e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:02.646582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a69e0-bd75-45ae-b56c-23367fb896e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:02.646891 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a69e0-bd75-45ae-b56c-23367fb896e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:02.648290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a69e0-bd75-45ae-b56c-23367fb896e1 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:02.660457 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 473/934] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:02.661304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a69e0-bd75-45ae-b56c-23367fb896e1 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:02.710589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8d1a3-6e2d-4dfb-b5a1-b0da09aba836 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:02.747483 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389e3c2-041a-4a9d-8adc-0fb0c45ea29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:02.748240 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e3c2-041a-4a9d-8adc-0fb0c45ea29e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:02.748583 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e3c2-041a-4a9d-8adc-0fb0c45ea29e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:02.748955 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e3c2-041a-4a9d-8adc-0fb0c45ea29e None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:02.749699 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389e3c2-041a-4a9d-8adc-0fb0c45ea29e None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:02.750076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389e3c2-041a-4a9d-8adc-0fb0c45ea29e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:02.752820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389e3c2-041a-4a9d-8adc-0fb0c45ea29e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:02.773447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 462/935] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Aug 7 00:51:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:02.774632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d2dd2-9934-4266-9b9e-1325dffd2c74 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:02.774918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d2dd2-9934-4266-9b9e-1325dffd2c74 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:02.775193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d2dd2-9934-4266-9b9e-1325dffd2c74 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:02.776478 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 463/936] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:02.777207 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d2dd2-9934-4266-9b9e-1325dffd2c74 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:02.788840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a69e0-bd75-45ae-b56c-23367fb896e1 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:02.831323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b877f9-d6cf-4395-a2af-8aa39aba93f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:02.832027 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b877f9-d6cf-4395-a2af-8aa39aba93f1 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:02.832317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b877f9-d6cf-4395-a2af-8aa39aba93f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:02.832592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b877f9-d6cf-4395-a2af-8aa39aba93f1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:02.833212 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b877f9-d6cf-4395-a2af-8aa39aba93f1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:02.834670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b877f9-d6cf-4395-a2af-8aa39aba93f1 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-30b877f9-d6cf-4395-a2af-8aa39aba93f1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:02.845122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:02.846341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:02.847193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:02.847193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:02.847193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:02.847193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:02.847193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:02.847193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:02.847193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:02.847193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:02.847193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:02.847193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:02.847193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:51:02.847193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:02.847193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:51:02.847193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:02.847193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 474/937] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Aug 7 00:51:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:02.848405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc27725-f020-4aef-a84d-d772802b482d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:02.848405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc27725-f020-4aef-a84d-d772802b482d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:02.848405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc27725-f020-4aef-a84d-d772802b482d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:02.869633 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-6bc27725-f020-4aef-a84d-d772802b482d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:02.870886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-6bc27725-f020-4aef-a84d-d772802b482d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:02.903037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:02.919699 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:02.930737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d2dd2-9934-4266-9b9e-1325dffd2c74 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:02.972451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 475/938] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:02.973319 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc27725-f020-4aef-a84d-d772802b482d None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:02.976951 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7cd0d-f6aa-46a0-afd3-5d96394f39c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:02.977715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7cd0d-f6aa-46a0-afd3-5d96394f39c8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:02.977987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7cd0d-f6aa-46a0-afd3-5d96394f39c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:02.978257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7cd0d-f6aa-46a0-afd3-5d96394f39c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:02.986122 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7cd0d-f6aa-46a0-afd3-5d96394f39c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:02.987677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7cd0d-f6aa-46a0-afd3-5d96394f39c8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:02.999312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-d4e7cd0d-f6aa-46a0-afd3-5d96394f39c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:51:02.999312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:02.999312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:02.999312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:02.999312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:02.999312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:02.999312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:02.999312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:02.999312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:02.999312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:02.999312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:02.999312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:02.999312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:51:02.999312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:51:02.999312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:03.000773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:03.001702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:51:03.001702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:51:03.001702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:51:03.001702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:51:03.001702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:51:03.001702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:51:03.001702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:51:03.001702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:03.001702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 464/939] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:51:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:03.002398 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7cd0d-f6aa-46a0-afd3-5d96394f39c8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:03.099047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc27725-f020-4aef-a84d-d772802b482d None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:03.122587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7cd0d-f6aa-46a0-afd3-5d96394f39c8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:03.145883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b24dd4-11f7-44d1-95a7-8ce98ebb6913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:03.146927 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b24dd4-11f7-44d1-95a7-8ce98ebb6913 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:03.147339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b24dd4-11f7-44d1-95a7-8ce98ebb6913 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:03.147617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b24dd4-11f7-44d1-95a7-8ce98ebb6913 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:03.148797 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b24dd4-11f7-44d1-95a7-8ce98ebb6913 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:03.149336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b24dd4-11f7-44d1-95a7-8ce98ebb6913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:03.151724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b24dd4-11f7-44d1-95a7-8ce98ebb6913 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:03.162226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 476/940] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Aug 7 00:51:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:03.162226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b24dd4-11f7-44d1-95a7-8ce98ebb6913 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:03.168814 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d88ad-81f8-48d7-8d75-732c2be763d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:03.169794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d88ad-81f8-48d7-8d75-732c2be763d7 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:03.170054 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d88ad-81f8-48d7-8d75-732c2be763d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:03.170324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d88ad-81f8-48d7-8d75-732c2be763d7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:03.170909 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d88ad-81f8-48d7-8d75-732c2be763d7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:03.172318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d88ad-81f8-48d7-8d75-732c2be763d7 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-fe8d88ad-81f8-48d7-8d75-732c2be763d7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:03.181567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:03.182580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:03.184185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:03.184185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:03.184185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:03.184185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:03.184185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:03.184185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:03.184185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:03.184185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:03.184185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:03.184185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:03.184185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:51:03.184185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:03.184185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:51:03.184185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:03.184185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 465/941] 10.222.0.20 () {56 vars in 1132 bytes} [Sun Aug 7 00:51:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:03.189016 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d88ad-81f8-48d7-8d75-732c2be763d7 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:03.190695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:03.212331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:03.279866 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b24dd4-11f7-44d1-95a7-8ce98ebb6913 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:03.315556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d88ad-81f8-48d7-8d75-732c2be763d7 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:03.317446 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080b9de-f5f8-4395-8a76-93f39c5e18e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:03.318035 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080b9de-f5f8-4395-8a76-93f39c5e18e6 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:03.318350 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080b9de-f5f8-4395-8a76-93f39c5e18e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:03.318591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080b9de-f5f8-4395-8a76-93f39c5e18e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:03.319354 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080b9de-f5f8-4395-8a76-93f39c5e18e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:03.319667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080b9de-f5f8-4395-8a76-93f39c5e18e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:03.321200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080b9de-f5f8-4395-8a76-93f39c5e18e6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:03.335230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 477/942] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:51:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:03.336384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080b9de-f5f8-4395-8a76-93f39c5e18e6 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:03.362272 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e4812-f300-4a0d-a530-3d80af55f6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:03.363163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4812-f300-4a0d-a530-3d80af55f6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:03.363606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4812-f300-4a0d-a530-3d80af55f6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:03.364161 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e4812-f300-4a0d-a530-3d80af55f6b9 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:03.364802 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e4812-f300-4a0d-a530-3d80af55f6b9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:03.365101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e4812-f300-4a0d-a530-3d80af55f6b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:03.366453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e4812-f300-4a0d-a530-3d80af55f6b9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:03.378962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 466/943] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Aug 7 00:51:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:03.378962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e4812-f300-4a0d-a530-3d80af55f6b9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:03.440845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:03.458749 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080b9de-f5f8-4395-8a76-93f39c5e18e6 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:03.486092 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:03.503655 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a08d7b-19b6-41de-a85a-d3712a002eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:03.504331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a08d7b-19b6-41de-a85a-d3712a002eaa None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:03.504611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a08d7b-19b6-41de-a85a-d3712a002eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:03.504884 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a08d7b-19b6-41de-a85a-d3712a002eaa None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:03.505539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a08d7b-19b6-41de-a85a-d3712a002eaa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:03.505855 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a08d7b-19b6-41de-a85a-d3712a002eaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:03.507313 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a08d7b-19b6-41de-a85a-d3712a002eaa None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:03.510616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e4812-f300-4a0d-a530-3d80af55f6b9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:03.514474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 478/944] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Aug 7 00:51:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:03.515351 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a08d7b-19b6-41de-a85a-d3712a002eaa None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:03.556065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233db0d0-b5f5-4c6f-a301-124159446fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:03.556682 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233db0d0-b5f5-4c6f-a301-124159446fd8 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:03.556960 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233db0d0-b5f5-4c6f-a301-124159446fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:03.557233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233db0d0-b5f5-4c6f-a301-124159446fd8 None admin] PATH_INFO: `/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/d89e8e9616b34203a3fa71611fed1665/roles/80c00799fe044866b3fdf89e57748760` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:03.559922 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233db0d0-b5f5-4c6f-a301-124159446fd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9f64c951f44fd48eedc312b1f33694, user_id=d89e8e9616b34203a3fa71611fed1665, role_id=80c00799fe044866b3fdf89e57748760)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:03.561397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233db0d0-b5f5-4c6f-a301-124159446fd8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:03.587944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 467/945] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:51:03 2022] PUT /identity/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/d89e8e9616b34203a3fa71611fed1665/roles/80c00799fe044866b3fdf89e57748760 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:51:03.587944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233db0d0-b5f5-4c6f-a301-124159446fd8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:03.684459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a08d7b-19b6-41de-a85a-d3712a002eaa None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:03.720439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233db0d0-b5f5-4c6f-a301-124159446fd8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:03.727015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8628191-8b7b-4656-b10c-15d36b845ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:03.727760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8628191-8b7b-4656-b10c-15d36b845ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:03.728146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8628191-8b7b-4656-b10c-15d36b845ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:03.728481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8628191-8b7b-4656-b10c-15d36b845ea2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:03.729372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8628191-8b7b-4656-b10c-15d36b845ea2 None admin] RBAC: Adding query filter params (interface=public, service_id=91144a3fbafe4806bf8111164769c34f, region_id=RegionOne) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:03.729755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8628191-8b7b-4656-b10c-15d36b845ea2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:03.731329 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8628191-8b7b-4656-b10c-15d36b845ea2 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:03.738570 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 479/946] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Aug 7 00:51:03 2022] GET /identity/v3/endpoints?service_id=91144a3fbafe4806bf8111164769c34f&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:03.744186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8628191-8b7b-4656-b10c-15d36b845ea2 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:03.760157 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68632891-917f-44c4-8b8f-9a6eebcf37bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:03.760157 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68632891-917f-44c4-8b8f-9a6eebcf37bf None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:03.760480 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68632891-917f-44c4-8b8f-9a6eebcf37bf None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:03.760553 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68632891-917f-44c4-8b8f-9a6eebcf37bf None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:03.761190 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68632891-917f-44c4-8b8f-9a6eebcf37bf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:03.761492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68632891-917f-44c4-8b8f-9a6eebcf37bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:03.762855 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68632891-917f-44c4-8b8f-9a6eebcf37bf None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:03.763266 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:03.770895 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 468/947] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Aug 7 00:51:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:03.780066 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68632891-917f-44c4-8b8f-9a6eebcf37bf None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:03.792616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:03.891290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8628191-8b7b-4656-b10c-15d36b845ea2 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:03.906634 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68632891-917f-44c4-8b8f-9a6eebcf37bf None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:03.930143 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f780d0-7d99-41be-9e76-441813a556e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:03.931053 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f780d0-7d99-41be-9e76-441813a556e5 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:03.931337 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f780d0-7d99-41be-9e76-441813a556e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:03.931607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f780d0-7d99-41be-9e76-441813a556e5 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:03.932269 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f780d0-7d99-41be-9e76-441813a556e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:03.935141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f780d0-7d99-41be-9e76-441813a556e5 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:03.945686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 480/948] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Aug 7 00:51:03 2022] GET /identity/v3/services => generated 1497 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 00:51:03.955443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4924da-4136-446c-865f-2b40f5ece5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:03.956156 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4924da-4136-446c-865f-2b40f5ece5dd None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:03.956437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4924da-4136-446c-865f-2b40f5ece5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:03.956709 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4924da-4136-446c-865f-2b40f5ece5dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:03.957393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4924da-4136-446c-865f-2b40f5ece5dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:03.958885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4924da-4136-446c-865f-2b40f5ece5dd None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:03.988147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 469/949] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 00:51:03 2022] POST /identity/v3/endpoints => generated 347 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:51:04.946814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a73bd3-3b89-4cb8-badc-03ec5d3966a4 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:04.947458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a73bd3-3b89-4cb8-badc-03ec5d3966a4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:04.947458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a73bd3-3b89-4cb8-badc-03ec5d3966a4 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:04.949050 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 481/950] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:04.954902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9518e-a7f5-4ee0-8bb0-956d1f85d140 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:04.955394 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9518e-a7f5-4ee0-8bb0-956d1f85d140 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:04.955552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9518e-a7f5-4ee0-8bb0-956d1f85d140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:04.974687 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-81b9518e-a7f5-4ee0-8bb0-956d1f85d140 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:04.975868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-81b9518e-a7f5-4ee0-8bb0-956d1f85d140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:05.040051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:05.064017 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 470/951] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:05.081511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a73bd3-3b89-4cb8-badc-03ec5d3966a4 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:05.172511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:05.201036 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a73bd3-3b89-4cb8-badc-03ec5d3966a4 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:05.242295 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f283802-2936-49c9-a747-7337882773c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:05.242912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f283802-2936-49c9-a747-7337882773c7 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:05.243190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f283802-2936-49c9-a747-7337882773c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:05.243462 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f283802-2936-49c9-a747-7337882773c7 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:05.244523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f283802-2936-49c9-a747-7337882773c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:05.245970 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f283802-2936-49c9-a747-7337882773c7 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:05.248552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: WARNING keystone.server.flask.common [None req-7f283802-2936-49c9-a747-7337882773c7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 07 00:51:05.264130 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.sql.core [None req-7f283802-2936-49c9-a747-7337882773c7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 00:51:05.264130 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 00:51:05.264130 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [parameters: {'user_id': 'a5b0050ee17e4b0d8254d77465d0aaff', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 00:51:05.264130 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80516) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 00:51:05.272615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-7f283802-2936-49c9-a747-7337882773c7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 00:51:05.272615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:05.272615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:51:05.272615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:51:05.272615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:51:05.272615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:51:05.272615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:51:05.272615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:51:05.272615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:51:05.272615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:51:05.272615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:51:05.272615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:51:05.272615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:51:05.272615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application result.read() Aug 07 00:51:05.272615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:51:05.273670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application yield resource Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise self.value Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application session.commit() Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 00:51:05.274737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self.session.flush() Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application compat.raise_( Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 00:51:05.275664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:51:05.276607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application result.read() Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:51:05.277562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:51:05.278433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:51:05.278433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:51:05.278433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:51:05.278433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:51:05.278433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 00:51:05.278433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 00:51:05.278433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a5b0050ee17e4b0d8254d77465d0aaff', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 00:51:05.278433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 00:51:05.278433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:05.278433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:51:05.278433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:05.278433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:05.278433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:05.278433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:05.278433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 07 00:51:05.279684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 07 00:51:05.280842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 07 00:51:05.280842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 07 00:51:05.280842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 00:51:05.280842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 00:51:05.280842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 00:51:05.280842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:05.280842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 482/952] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Aug 7 00:51:05 2022] POST /identity/v3/users => generated 160 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:51:05.284562 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9518e-a7f5-4ee0-8bb0-956d1f85d140 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:05.386139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9518e-a7f5-4ee0-8bb0-956d1f85d140 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:05.431070 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3399d-e368-4db5-8303-6b1211d4e763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:05.431707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3399d-e368-4db5-8303-6b1211d4e763 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:05.432013 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3399d-e368-4db5-8303-6b1211d4e763 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:05.432280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3399d-e368-4db5-8303-6b1211d4e763 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:05.439816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3399d-e368-4db5-8303-6b1211d4e763 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:05.441297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3399d-e368-4db5-8303-6b1211d4e763 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-faa3399d-e368-4db5-8303-6b1211d4e763 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:51:05.458457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:05.459436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:05.460472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:05.460472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:05.460472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:51:05.460472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:51:05.460472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:51:05.460472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:51:05.460472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:51:05.460472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:51:05.460472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:51:05.460472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:05.467418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 471/953] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:51:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:05.469908 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f283802-2936-49c9-a747-7337882773c7 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:05.588727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f283802-2936-49c9-a747-7337882773c7 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:05.633333 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbc6ac-b055-405f-9799-ec1329507790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:05.633954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbc6ac-b055-405f-9799-ec1329507790 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:05.634236 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbc6ac-b055-405f-9799-ec1329507790 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:05.634508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbc6ac-b055-405f-9799-ec1329507790 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:05.635226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbc6ac-b055-405f-9799-ec1329507790 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:05.635525 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbc6ac-b055-405f-9799-ec1329507790 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:05.637239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbc6ac-b055-405f-9799-ec1329507790 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:05.657411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:05.684017 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 483/954] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Aug 7 00:51:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:05.744378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd598d-3a5e-4412-b1fa-50b6a3ba3983 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:05.744587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd598d-3a5e-4412-b1fa-50b6a3ba3983 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:05.744840 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd598d-3a5e-4412-b1fa-50b6a3ba3983 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:05.746598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 472/955] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:05.752857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f44c4-dd64-4d60-a16d-87a8c7142a2f None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:05.753177 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f44c4-dd64-4d60-a16d-87a8c7142a2f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:05.753416 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f44c4-dd64-4d60-a16d-87a8c7142a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:05.775081 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c16f44c4-dd64-4d60-a16d-87a8c7142a2f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:05.776784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c16f44c4-dd64-4d60-a16d-87a8c7142a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:05.893449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 484/956] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:05.919165 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd598d-3a5e-4412-b1fa-50b6a3ba3983 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:05.987130 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:06.042212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd598d-3a5e-4412-b1fa-50b6a3ba3983 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:06.080376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab21ca6-ca3f-4f51-8032-7944aa272f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:06.081022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab21ca6-ca3f-4f51-8032-7944aa272f9b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:06.081302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab21ca6-ca3f-4f51-8032-7944aa272f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:06.081576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab21ca6-ca3f-4f51-8032-7944aa272f9b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:06.092608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab21ca6-ca3f-4f51-8032-7944aa272f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-9ab21ca6-ca3f-4f51-8032-7944aa272f9b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:06.097468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:06.098704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:06.100530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:06.100530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:06.100530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:06.100530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:06.100530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:06.100530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:06.100530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:06.100530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:06.100530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:06.100530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:06.100530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:51:06.100530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:06.100530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 473/957] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Aug 7 00:51:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:06.105001 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f44c4-dd64-4d60-a16d-87a8c7142a2f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:06.154711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f10b7-e905-4e73-bdff-f7cf538950b9 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:06.155047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f10b7-e905-4e73-bdff-f7cf538950b9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:06.155496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f10b7-e905-4e73-bdff-f7cf538950b9 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:06.157019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 474/958] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:06.163324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48b957-06d8-4084-8118-c9c794ef2def None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:06.163611 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48b957-06d8-4084-8118-c9c794ef2def None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:06.163871 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48b957-06d8-4084-8118-c9c794ef2def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:06.182480 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ab48b957-06d8-4084-8118-c9c794ef2def None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:06.183688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ab48b957-06d8-4084-8118-c9c794ef2def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:06.221057 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f44c4-dd64-4d60-a16d-87a8c7142a2f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:06.255240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:06.262626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 475/959] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:51:06.263890 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef32d1-a724-4129-acb7-f97c58d0b6e7 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:06.264202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef32d1-a724-4129-acb7-f97c58d0b6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:06.264473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef32d1-a724-4129-acb7-f97c58d0b6e7 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:06.265479 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f62b7-bd14-495a-9d34-425859bba66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:06.265708 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 476/960] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:06.266475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f62b7-bd14-495a-9d34-425859bba66c None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:06.266892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f62b7-bd14-495a-9d34-425859bba66c None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:06.267443 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f62b7-bd14-495a-9d34-425859bba66c None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:06.268297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f62b7-bd14-495a-9d34-425859bba66c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:06.268751 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f62b7-bd14-495a-9d34-425859bba66c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:06.270551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f62b7-bd14-495a-9d34-425859bba66c None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:06.271297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027a9c-c983-4738-9d43-2585e06e7e07 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:06.271583 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027a9c-c983-4738-9d43-2585e06e7e07 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:06.271856 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027a9c-c983-4738-9d43-2585e06e7e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:06.286539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 485/961] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Aug 7 00:51:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:06.288860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f62b7-bd14-495a-9d34-425859bba66c None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:06.293601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d1027a9c-c983-4738-9d43-2585e06e7e07 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:06.294742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d1027a9c-c983-4738-9d43-2585e06e7e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:06.327316 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:06.372283 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 477/962] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:51:06.373159 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1027a9c-c983-4738-9d43-2585e06e7e07 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:06.398135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f62b7-bd14-495a-9d34-425859bba66c None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:06.435311 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acc074-6870-468d-886c-0fadc3c40180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:06.435978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acc074-6870-468d-886c-0fadc3c40180 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:06.436612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acc074-6870-468d-886c-0fadc3c40180 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:06.436612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acc074-6870-468d-886c-0fadc3c40180 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:06.437114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acc074-6870-468d-886c-0fadc3c40180 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:06.439088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acc074-6870-468d-886c-0fadc3c40180 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-f2acc074-6870-468d-886c-0fadc3c40180 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:06.448228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:06.449532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:06.450572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:06.450572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:06.450572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:06.450572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:06.450572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:06.450572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:06.450572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:06.450572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:06.450572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:06.450572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:06.450572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:51:06.450572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:06.450572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:51:06.450572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:06.450572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 486/963] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:51:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:06.452575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acc074-6870-468d-886c-0fadc3c40180 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:06.486862 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1027a9c-c983-4738-9d43-2585e06e7e07 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:06.521412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e4273-8726-4cd3-ae1c-ad8829d4929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:06.522052 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e4273-8726-4cd3-ae1c-ad8829d4929d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:06.522328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e4273-8726-4cd3-ae1c-ad8829d4929d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:06.522594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e4273-8726-4cd3-ae1c-ad8829d4929d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:06.526082 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:06.535969 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e4273-8726-4cd3-ae1c-ad8829d4929d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:06.537437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e4273-8726-4cd3-ae1c-ad8829d4929d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-992e4273-8726-4cd3-ae1c-ad8829d4929d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:51:06.553239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:06.559298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:51:06.560630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:51:06.560630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:06.560630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:06.560630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 478/964] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:06.560630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e4273-8726-4cd3-ae1c-ad8829d4929d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:06.581137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acc074-6870-468d-886c-0fadc3c40180 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:06.583140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:06.619388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb1ea8-6207-4d01-a8fb-7e1607dc1f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:06.620068 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb1ea8-6207-4d01-a8fb-7e1607dc1f3f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:06.620346 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb1ea8-6207-4d01-a8fb-7e1607dc1f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:06.620612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb1ea8-6207-4d01-a8fb-7e1607dc1f3f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:06.621205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb1ea8-6207-4d01-a8fb-7e1607dc1f3f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:06.622582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb1ea8-6207-4d01-a8fb-7e1607dc1f3f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-c8fb1ea8-6207-4d01-a8fb-7e1607dc1f3f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:06.631877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:06.633201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:06.634093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:06.634093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:06.634093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:06.634093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:06.634093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:06.634093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:06.634093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:06.634093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:06.634093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:06.634093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:06.634093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:51:06.634093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:06.634093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:51:06.634093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:06.634093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 487/965] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Aug 7 00:51:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:06.634907 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb1ea8-6207-4d01-a8fb-7e1607dc1f3f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:06.677647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e4273-8726-4cd3-ae1c-ad8829d4929d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:06.717095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2325cd-aa95-458a-af2e-a907eea35e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:06.717721 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2325cd-aa95-458a-af2e-a907eea35e16 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:06.717995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2325cd-aa95-458a-af2e-a907eea35e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:06.718263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2325cd-aa95-458a-af2e-a907eea35e16 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:06.718909 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2325cd-aa95-458a-af2e-a907eea35e16 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:06.719736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2325cd-aa95-458a-af2e-a907eea35e16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:06.721149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2325cd-aa95-458a-af2e-a907eea35e16 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:06.727004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 479/966] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Aug 7 00:51:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:06.727837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2325cd-aa95-458a-af2e-a907eea35e16 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:06.753026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb1ea8-6207-4d01-a8fb-7e1607dc1f3f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:06.770652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:06.790556 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03075233-076e-4185-be1f-69ce7262d0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:06.791158 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03075233-076e-4185-be1f-69ce7262d0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:06.791433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03075233-076e-4185-be1f-69ce7262d0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:06.791699 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03075233-076e-4185-be1f-69ce7262d0c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:06.792372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03075233-076e-4185-be1f-69ce7262d0c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:06.792670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03075233-076e-4185-be1f-69ce7262d0c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:06.794037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03075233-076e-4185-be1f-69ce7262d0c6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:06.806637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 488/967] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:06.807299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03075233-076e-4185-be1f-69ce7262d0c6 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:06.821801 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:06.838589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2325cd-aa95-458a-af2e-a907eea35e16 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:06.873238 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57874da-f9de-46e6-bbb5-465cd26f5183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:06.873846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57874da-f9de-46e6-bbb5-465cd26f5183 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:06.874121 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57874da-f9de-46e6-bbb5-465cd26f5183 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:06.874394 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57874da-f9de-46e6-bbb5-465cd26f5183 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:06.875023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57874da-f9de-46e6-bbb5-465cd26f5183 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:06.875325 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57874da-f9de-46e6-bbb5-465cd26f5183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:06.876822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57874da-f9de-46e6-bbb5-465cd26f5183 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:06.881645 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 480/968] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Aug 7 00:51:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:06.882443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57874da-f9de-46e6-bbb5-465cd26f5183 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:06.910026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03075233-076e-4185-be1f-69ce7262d0c6 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:06.945304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe0d5e-bcec-4e75-8552-321eee30824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:06.945918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe0d5e-bcec-4e75-8552-321eee30824d None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:06.946201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe0d5e-bcec-4e75-8552-321eee30824d None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:06.946473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe0d5e-bcec-4e75-8552-321eee30824d None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:06.947149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe0d5e-bcec-4e75-8552-321eee30824d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:06.947451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe0d5e-bcec-4e75-8552-321eee30824d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:06.948844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe0d5e-bcec-4e75-8552-321eee30824d None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:06.953372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 489/969] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Aug 7 00:51:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:06.954436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe0d5e-bcec-4e75-8552-321eee30824d None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:06.993290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57874da-f9de-46e6-bbb5-465cd26f5183 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:07.020600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:07.035653 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9913f0-4586-4a33-a518-a321f4664a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:07.036337 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9913f0-4586-4a33-a518-a321f4664a14 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:07.036618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9913f0-4586-4a33-a518-a321f4664a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:07.036887 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9913f0-4586-4a33-a518-a321f4664a14 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:07.046093 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9913f0-4586-4a33-a518-a321f4664a14 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:07.047608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9913f0-4586-4a33-a518-a321f4664a14 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-0e9913f0-4586-4a33-a518-a321f4664a14 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:51:07.060569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:07.061614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:07.062602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:07.062602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:07.062602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:51:07.062602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:51:07.062602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:51:07.062602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:51:07.062602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:51:07.062602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:51:07.062602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:51:07.062602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:07.062602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 481/970] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Aug 7 00:51:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:07.067861 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9913f0-4586-4a33-a518-a321f4664a14 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:07.081176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:07.093631 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe0d5e-bcec-4e75-8552-321eee30824d None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:07.133214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad093a-1f9b-4b02-8eca-c109df4e71a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:07.133890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad093a-1f9b-4b02-8eca-c109df4e71a9 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:07.134088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad093a-1f9b-4b02-8eca-c109df4e71a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:07.134359 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad093a-1f9b-4b02-8eca-c109df4e71a9 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:07.134998 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad093a-1f9b-4b02-8eca-c109df4e71a9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:07.135292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad093a-1f9b-4b02-8eca-c109df4e71a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:07.136696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad093a-1f9b-4b02-8eca-c109df4e71a9 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:07.143135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 490/971] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Aug 7 00:51:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:07.149349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad093a-1f9b-4b02-8eca-c109df4e71a9 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:07.185924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9913f0-4586-4a33-a518-a321f4664a14 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:07.225296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd91c40-0b42-480e-b92c-baa30ad2a1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:07.225912 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd91c40-0b42-480e-b92c-baa30ad2a1db None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:07.226191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd91c40-0b42-480e-b92c-baa30ad2a1db None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:07.226459 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd91c40-0b42-480e-b92c-baa30ad2a1db None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:07.227194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd91c40-0b42-480e-b92c-baa30ad2a1db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:07.227497 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd91c40-0b42-480e-b92c-baa30ad2a1db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:07.229082 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd91c40-0b42-480e-b92c-baa30ad2a1db None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:07.247413 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 482/972] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Aug 7 00:51:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:07.252718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd91c40-0b42-480e-b92c-baa30ad2a1db None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:07.262161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad093a-1f9b-4b02-8eca-c109df4e71a9 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:07.266685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:07.306373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb84f5-ed66-4559-8659-d95b44728778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:07.306987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb84f5-ed66-4559-8659-d95b44728778 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:07.307268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb84f5-ed66-4559-8659-d95b44728778 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:07.307551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb84f5-ed66-4559-8659-d95b44728778 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:07.308240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb84f5-ed66-4559-8659-d95b44728778 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:07.309632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb84f5-ed66-4559-8659-d95b44728778 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:07.327282 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:07.332157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 491/973] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 00:51:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:51:07.369200 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd91c40-0b42-480e-b92c-baa30ad2a1db None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:07.416183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef2be9-df15-4612-bb71-0a7a807f768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:07.416856 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef2be9-df15-4612-bb71-0a7a807f768d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:07.417079 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef2be9-df15-4612-bb71-0a7a807f768d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:07.417405 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef2be9-df15-4612-bb71-0a7a807f768d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:07.496580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef2be9-df15-4612-bb71-0a7a807f768d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:07.498034 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef2be9-df15-4612-bb71-0a7a807f768d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:07.565003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:07.612047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 483/974] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:07 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 00:51:07.614061 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb84f5-ed66-4559-8659-d95b44728778 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:07.733874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb84f5-ed66-4559-8659-d95b44728778 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:07.769911 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873821f2-97fa-4b21-a49d-092fd1d01d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:07.770548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873821f2-97fa-4b21-a49d-092fd1d01d9c None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:07.770827 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873821f2-97fa-4b21-a49d-092fd1d01d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:07.771102 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873821f2-97fa-4b21-a49d-092fd1d01d9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:07.782135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873821f2-97fa-4b21-a49d-092fd1d01d9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:07.783595 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873821f2-97fa-4b21-a49d-092fd1d01d9c None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-873821f2-97fa-4b21-a49d-092fd1d01d9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:51:07.798434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:07.799564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:51:07.800559 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:51:07.800559 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:07.800559 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:07.800559 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 492/975] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:51:07.805318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef2be9-df15-4612-bb71-0a7a807f768d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:07.913142 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef2be9-df15-4612-bb71-0a7a807f768d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:07.948622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538e126-9955-4fc4-be1f-d7fff6d1f977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:07.949555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538e126-9955-4fc4-be1f-d7fff6d1f977 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:07.950061 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538e126-9955-4fc4-be1f-d7fff6d1f977 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:07.950539 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538e126-9955-4fc4-be1f-d7fff6d1f977 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:07.951399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538e126-9955-4fc4-be1f-d7fff6d1f977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:07.951930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538e126-9955-4fc4-be1f-d7fff6d1f977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:07.953526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538e126-9955-4fc4-be1f-d7fff6d1f977 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:07.965263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 484/976] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:07.971033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873821f2-97fa-4b21-a49d-092fd1d01d9c None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:07.987076 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:08.078364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873821f2-97fa-4b21-a49d-092fd1d01d9c None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:08.115018 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd0f3f-c67c-4666-9b5b-368f5c7989db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:08.115651 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd0f3f-c67c-4666-9b5b-368f5c7989db None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:08.115946 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd0f3f-c67c-4666-9b5b-368f5c7989db None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:08.116221 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd0f3f-c67c-4666-9b5b-368f5c7989db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:08.123357 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd0f3f-c67c-4666-9b5b-368f5c7989db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:08.124839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd0f3f-c67c-4666-9b5b-368f5c7989db None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:08.136235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-abbd0f3f-c67c-4666-9b5b-368f5c7989db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:51:08.136235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:08.136235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:08.136235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:08.136235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:08.136235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:08.136235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:08.136235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:08.136235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:08.136235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:08.136235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:08.136235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:08.136235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:51:08.136235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:51:08.136235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:08.142403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:08.143336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:51:08.143336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:51:08.143336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:51:08.143336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:51:08.143336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:51:08.143336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:51:08.143336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:51:08.143336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:08.143336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 493/977] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:51:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:08.145611 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538e126-9955-4fc4-be1f-d7fff6d1f977 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:08.171230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:08.250932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538e126-9955-4fc4-be1f-d7fff6d1f977 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:08.285095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9c0db-e3d1-4d00-abc6-c07d01b2fba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:08.285924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9c0db-e3d1-4d00-abc6-c07d01b2fba5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:08.286346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9c0db-e3d1-4d00-abc6-c07d01b2fba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:08.286760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9c0db-e3d1-4d00-abc6-c07d01b2fba5 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:08.287616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9c0db-e3d1-4d00-abc6-c07d01b2fba5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:08.288096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9c0db-e3d1-4d00-abc6-c07d01b2fba5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:08.289652 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9c0db-e3d1-4d00-abc6-c07d01b2fba5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:08.307516 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 485/978] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:08.309076 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd0f3f-c67c-4666-9b5b-368f5c7989db None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:08.382128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:08.416354 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd0f3f-c67c-4666-9b5b-368f5c7989db None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:08.450521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352d67e-c6b1-4b77-9691-83323566293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:08.451132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352d67e-c6b1-4b77-9691-83323566293a None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:08.451404 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352d67e-c6b1-4b77-9691-83323566293a None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:08.451668 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352d67e-c6b1-4b77-9691-83323566293a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:08.452426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352d67e-c6b1-4b77-9691-83323566293a None admin] RBAC: Adding query filter params (role.id=80c00799fe044866b3fdf89e57748760, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=d89e8e9616b34203a3fa71611fed1665) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:08.452728 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352d67e-c6b1-4b77-9691-83323566293a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:08.454191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352d67e-c6b1-4b77-9691-83323566293a None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:08.460378 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 494/979] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:51:08 2022] GET /identity/v3/role_assignments?user.id=d89e8e9616b34203a3fa71611fed1665&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=80c00799fe044866b3fdf89e57748760 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:09.008447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ce82d-f0b7-4e68-8c57-544b55beb32b None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:09.008791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ce82d-f0b7-4e68-8c57-544b55beb32b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:09.009016 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ce82d-f0b7-4e68-8c57-544b55beb32b None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:09.010529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 486/980] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:09.015693 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9f6f8-d141-4819-91b7-729f6b640156 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:09.016581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9f6f8-d141-4819-91b7-729f6b640156 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:09.016858 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9f6f8-d141-4819-91b7-729f6b640156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:09.036638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-49c9f6f8-d141-4819-91b7-729f6b640156 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:09.037560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-49c9f6f8-d141-4819-91b7-729f6b640156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:09.115407 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 495/981] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:09.138696 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ce82d-f0b7-4e68-8c57-544b55beb32b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:09.232731 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:09.257314 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ce82d-f0b7-4e68-8c57-544b55beb32b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:09.304390 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6fad5-86bb-48cf-91b5-767b4015556e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:09.304910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6fad5-86bb-48cf-91b5-767b4015556e None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:09.305191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6fad5-86bb-48cf-91b5-767b4015556e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:09.305461 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6fad5-86bb-48cf-91b5-767b4015556e None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:09.306128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6fad5-86bb-48cf-91b5-767b4015556e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:09.307505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6fad5-86bb-48cf-91b5-767b4015556e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:09.331938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 487/982] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Aug 7 00:51:09 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:51:09.401023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf78b7f-457f-4570-9fa1-060d06e3d348 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:09.401606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf78b7f-457f-4570-9fa1-060d06e3d348 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:09.401606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf78b7f-457f-4570-9fa1-060d06e3d348 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:09.403147 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 496/983] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:09.409575 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe9b99-e79d-4597-a495-be2275776eab None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:09.410020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe9b99-e79d-4597-a495-be2275776eab None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:09.410020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe9b99-e79d-4597-a495-be2275776eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:09.429710 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9abe9b99-e79d-4597-a495-be2275776eab None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:09.430937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9abe9b99-e79d-4597-a495-be2275776eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:09.526615 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 488/984] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:51:09.549973 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf78b7f-457f-4570-9fa1-060d06e3d348 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:09.625874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:09.669591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf78b7f-457f-4570-9fa1-060d06e3d348 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:09.709661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d19aee-d4b9-4d9e-9ca5-6ac9fef92b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:09.710287 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d19aee-d4b9-4d9e-9ca5-6ac9fef92b96 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:09.710587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d19aee-d4b9-4d9e-9ca5-6ac9fef92b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:09.710844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d19aee-d4b9-4d9e-9ca5-6ac9fef92b96 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:09.711464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d19aee-d4b9-4d9e-9ca5-6ac9fef92b96 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:09.712877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d19aee-d4b9-4d9e-9ca5-6ac9fef92b96 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-55d19aee-d4b9-4d9e-9ca5-6ac9fef92b96 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:09.723635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:09.730501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:09.731418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:09.731418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:09.731418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:09.731418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:09.731418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:09.731418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:09.731418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:09.731418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:09.731418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:09.731418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:09.731418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:51:09.731418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:09.731418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:51:09.731418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:09.731418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 497/985] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Aug 7 00:51:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:09.734345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe9b99-e79d-4597-a495-be2275776eab None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:09.809275 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:09.847638 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe9b99-e79d-4597-a495-be2275776eab None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:09.883582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5e83d-c053-46a5-ae98-65e4b49450ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:09.884520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5e83d-c053-46a5-ae98-65e4b49450ca None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:09.884967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5e83d-c053-46a5-ae98-65e4b49450ca None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:09.885428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5e83d-c053-46a5-ae98-65e4b49450ca None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:09.886264 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5e83d-c053-46a5-ae98-65e4b49450ca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:09.886736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5e83d-c053-46a5-ae98-65e4b49450ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:09.888304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5e83d-c053-46a5-ae98-65e4b49450ca None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:09.894684 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 489/986] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Aug 7 00:51:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:09.900686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d19aee-d4b9-4d9e-9ca5-6ac9fef92b96 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:10.015035 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d19aee-d4b9-4d9e-9ca5-6ac9fef92b96 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:10.049268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:10.055206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f69d3-0e1a-41b2-bf0d-cdb20d6c47e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:10.055829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f69d3-0e1a-41b2-bf0d-cdb20d6c47e2 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:10.056167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f69d3-0e1a-41b2-bf0d-cdb20d6c47e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:10.056405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f69d3-0e1a-41b2-bf0d-cdb20d6c47e2 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:10.057051 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f69d3-0e1a-41b2-bf0d-cdb20d6c47e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:10.057344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f69d3-0e1a-41b2-bf0d-cdb20d6c47e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:10.058756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f69d3-0e1a-41b2-bf0d-cdb20d6c47e2 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:10.065517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 498/987] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Aug 7 00:51:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:10.071421 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5e83d-c053-46a5-ae98-65e4b49450ca None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:10.187062 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5e83d-c053-46a5-ae98-65e4b49450ca None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:10.218867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:10.224911 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49270e9-a13f-431b-bc79-cc277ead67a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:10.225587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49270e9-a13f-431b-bc79-cc277ead67a9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:10.225869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49270e9-a13f-431b-bc79-cc277ead67a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:10.226140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49270e9-a13f-431b-bc79-cc277ead67a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:10.226846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49270e9-a13f-431b-bc79-cc277ead67a9 None admin] RBAC: Adding query filter params (interface=admin, service_id=91144a3fbafe4806bf8111164769c34f, region_id=RegionOne) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:10.227152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49270e9-a13f-431b-bc79-cc277ead67a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:10.228537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49270e9-a13f-431b-bc79-cc277ead67a9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:10.239259 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 490/988] 10.222.0.20 () {56 vars in 1249 bytes} [Sun Aug 7 00:51:10 2022] GET /identity/v3/endpoints?service_id=91144a3fbafe4806bf8111164769c34f&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:10.241186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f69d3-0e1a-41b2-bf0d-cdb20d6c47e2 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:10.345782 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f69d3-0e1a-41b2-bf0d-cdb20d6c47e2 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:10.379620 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e3099-5900-45fd-ad42-fe016454fb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:10.380258 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e3099-5900-45fd-ad42-fe016454fb1c None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:10.380536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e3099-5900-45fd-ad42-fe016454fb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:10.380802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e3099-5900-45fd-ad42-fe016454fb1c None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:10.381409 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e3099-5900-45fd-ad42-fe016454fb1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:10.382780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e3099-5900-45fd-ad42-fe016454fb1c None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:10.389462 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 499/989] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Aug 7 00:51:10 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:51:10.562426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc3cc4-c541-4f05-80f3-49d60cb8700b None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:10.562792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc3cc4-c541-4f05-80f3-49d60cb8700b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:10.563541 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc3cc4-c541-4f05-80f3-49d60cb8700b None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:10.565114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 491/990] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:10.570468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa658746-2189-4352-8653-db97109afa91 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:10.570912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa658746-2189-4352-8653-db97109afa91 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:10.571014 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa658746-2189-4352-8653-db97109afa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:10.589553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-aa658746-2189-4352-8653-db97109afa91 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:10.590738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-aa658746-2189-4352-8653-db97109afa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:10.650546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:10.666492 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 500/991] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:10.688314 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc3cc4-c541-4f05-80f3-49d60cb8700b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:10.799294 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc3cc4-c541-4f05-80f3-49d60cb8700b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:10.835063 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8297ad9-7ed4-4297-9a99-7f35c46f70b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:10.835999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8297ad9-7ed4-4297-9a99-7f35c46f70b9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:10.836495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8297ad9-7ed4-4297-9a99-7f35c46f70b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:10.836972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8297ad9-7ed4-4297-9a99-7f35c46f70b9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:10.837770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8297ad9-7ed4-4297-9a99-7f35c46f70b9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:10.839297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8297ad9-7ed4-4297-9a99-7f35c46f70b9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e8297ad9-7ed4-4297-9a99-7f35c46f70b9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:10.849004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:10.850181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:10.851056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:10.851056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:10.851056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:10.851056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:10.851056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:10.851056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:10.851056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:10.851056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:10.851056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:10.851056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:10.851056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:51:10.851056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:10.851056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:51:10.851056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:10.858142 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 492/992] 10.222.0.20 () {56 vars in 1105 bytes} [Sun Aug 7 00:51:10 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:10.859764 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa658746-2189-4352-8653-db97109afa91 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:10.963756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa658746-2189-4352-8653-db97109afa91 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:10.998630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687baa54-4209-49d4-b9fc-b3364f7eb62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:10.999238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687baa54-4209-49d4-b9fc-b3364f7eb62e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:10.999515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687baa54-4209-49d4-b9fc-b3364f7eb62e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:10.999783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687baa54-4209-49d4-b9fc-b3364f7eb62e None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:11.000496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687baa54-4209-49d4-b9fc-b3364f7eb62e None admin] RBAC: Adding query filter params (name=image) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:11.000804 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687baa54-4209-49d4-b9fc-b3364f7eb62e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:11.002166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687baa54-4209-49d4-b9fc-b3364f7eb62e None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:11.012185 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 501/993] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:11.013873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8297ad9-7ed4-4297-9a99-7f35c46f70b9 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:11.080873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:11.143376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8297ad9-7ed4-4297-9a99-7f35c46f70b9 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:11.178268 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696a9b8-442d-4b37-b69a-314b80ca1f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:11.178884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696a9b8-442d-4b37-b69a-314b80ca1f6f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:11.179162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696a9b8-442d-4b37-b69a-314b80ca1f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:11.179434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696a9b8-442d-4b37-b69a-314b80ca1f6f None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:11.180096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696a9b8-442d-4b37-b69a-314b80ca1f6f None admin] RBAC: Adding query filter params (type=image) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:11.180399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696a9b8-442d-4b37-b69a-314b80ca1f6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:11.181754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696a9b8-442d-4b37-b69a-314b80ca1f6f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:11.186554 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 493/994] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:11.397286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4822e-8734-43e0-93bb-303952011d3f None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:11.397578 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4822e-8734-43e0-93bb-303952011d3f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:11.397803 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4822e-8734-43e0-93bb-303952011d3f None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:11.399222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 502/995] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:11.404501 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a96d6e-4f9f-4e18-8b17-90425bc1913b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:11.404966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a96d6e-4f9f-4e18-8b17-90425bc1913b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:11.405132 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a96d6e-4f9f-4e18-8b17-90425bc1913b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:11.425158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e4a96d6e-4f9f-4e18-8b17-90425bc1913b None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:11.426414 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e4a96d6e-4f9f-4e18-8b17-90425bc1913b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:11.497050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 494/996] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:11.521349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4822e-8734-43e0-93bb-303952011d3f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:11.582297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:11.634586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4822e-8734-43e0-93bb-303952011d3f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:11.678332 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcced4a5-0f54-4c3f-91c9-6b6126d9a58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:11.678887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcced4a5-0f54-4c3f-91c9-6b6126d9a58e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:11.679166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcced4a5-0f54-4c3f-91c9-6b6126d9a58e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:11.679436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcced4a5-0f54-4c3f-91c9-6b6126d9a58e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:11.680063 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcced4a5-0f54-4c3f-91c9-6b6126d9a58e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:11.681434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcced4a5-0f54-4c3f-91c9-6b6126d9a58e None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-dcced4a5-0f54-4c3f-91c9-6b6126d9a58e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:11.691125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:11.692211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:11.693467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:11.693467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:11.693467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:11.693467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:11.693467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:11.693467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:11.693467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:11.693467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:11.693467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:11.693467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:11.693467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:51:11.693467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:11.693467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:51:11.693467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:11.693467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 503/997] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:51:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:11.698551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a96d6e-4f9f-4e18-8b17-90425bc1913b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:11.755669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:11.802507 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a96d6e-4f9f-4e18-8b17-90425bc1913b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:11.839808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31353ef4-73ae-4e8d-acd0-cee67a78450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:11.840575 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31353ef4-73ae-4e8d-acd0-cee67a78450b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:11.841206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31353ef4-73ae-4e8d-acd0-cee67a78450b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:11.841206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31353ef4-73ae-4e8d-acd0-cee67a78450b None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:11.841674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31353ef4-73ae-4e8d-acd0-cee67a78450b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:11.841975 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31353ef4-73ae-4e8d-acd0-cee67a78450b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:11.843434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31353ef4-73ae-4e8d-acd0-cee67a78450b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:11.854373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 495/998] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Aug 7 00:51:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:11.855980 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcced4a5-0f54-4c3f-91c9-6b6126d9a58e None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:11.961715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcced4a5-0f54-4c3f-91c9-6b6126d9a58e None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:11.979085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:11.998807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d93d51-f7f2-4145-97a0-8eb7f0bf8d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:11.999721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d93d51-f7f2-4145-97a0-8eb7f0bf8d27 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:12.000568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d93d51-f7f2-4145-97a0-8eb7f0bf8d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:12.000936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d93d51-f7f2-4145-97a0-8eb7f0bf8d27 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:12.001546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d93d51-f7f2-4145-97a0-8eb7f0bf8d27 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:12.001845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d93d51-f7f2-4145-97a0-8eb7f0bf8d27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:12.003250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d93d51-f7f2-4145-97a0-8eb7f0bf8d27 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:12.013180 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 504/999] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Aug 7 00:51:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:12.014433 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31353ef4-73ae-4e8d-acd0-cee67a78450b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:12.128011 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31353ef4-73ae-4e8d-acd0-cee67a78450b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:12.150665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:12.168806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0e338-1b94-4241-991e-9c47c122eaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:12.169420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0e338-1b94-4241-991e-9c47c122eaf3 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:12.169695 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0e338-1b94-4241-991e-9c47c122eaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:12.169960 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0e338-1b94-4241-991e-9c47c122eaf3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:12.170718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0e338-1b94-4241-991e-9c47c122eaf3 None admin] RBAC: Adding query filter params (interface=public, service_id=04d8921a316b49d78788df5c02d54f4f, region_id=RegionOne) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:12.171023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0e338-1b94-4241-991e-9c47c122eaf3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:12.172601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0e338-1b94-4241-991e-9c47c122eaf3 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:12.180286 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 496/1000] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Aug 7 00:51:12 2022] GET /identity/v3/endpoints?service_id=04d8921a316b49d78788df5c02d54f4f&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:12.183370 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d93d51-f7f2-4145-97a0-8eb7f0bf8d27 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:12.296369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d93d51-f7f2-4145-97a0-8eb7f0bf8d27 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:12.343397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93180690-c8b8-418d-be63-30449616805f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:12.344606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93180690-c8b8-418d-be63-30449616805f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:12.344923 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93180690-c8b8-418d-be63-30449616805f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:12.345361 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93180690-c8b8-418d-be63-30449616805f None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:12.346130 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93180690-c8b8-418d-be63-30449616805f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:12.347689 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93180690-c8b8-418d-be63-30449616805f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:12.354963 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 505/1001] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Aug 7 00:51:12 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:51:12.454675 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f595-a09c-48f5-9373-0d6071d04ae2 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:12.455208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f595-a09c-48f5-9373-0d6071d04ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:12.455208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f595-a09c-48f5-9373-0d6071d04ae2 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:12.456864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 497/1002] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:12.462397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c325c-6104-4b67-a5fa-a897ca719431 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:12.462682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c325c-6104-4b67-a5fa-a897ca719431 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:12.462957 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c325c-6104-4b67-a5fa-a897ca719431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:12.482560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-229c325c-6104-4b67-a5fa-a897ca719431 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:12.483813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-229c325c-6104-4b67-a5fa-a897ca719431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:12.536411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:12.571581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 506/1003] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:12.594569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1f595-a09c-48f5-9373-0d6071d04ae2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:12.711480 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1f595-a09c-48f5-9373-0d6071d04ae2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:12.748189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3cec8-9680-4430-b38b-cbfc7944519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:12.748826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3cec8-9680-4430-b38b-cbfc7944519e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:12.749107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3cec8-9680-4430-b38b-cbfc7944519e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:12.749379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3cec8-9680-4430-b38b-cbfc7944519e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:12.750044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3cec8-9680-4430-b38b-cbfc7944519e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:12.751456 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3cec8-9680-4430-b38b-cbfc7944519e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-35d3cec8-9680-4430-b38b-cbfc7944519e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:12.760466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:12.762388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:12.765073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:12.765073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:12.765073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:12.765073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:12.765073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:12.765073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:12.765073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:12.765073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:12.765073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:12.765073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:12.765073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:51:12.765073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:12.765073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:51:12.765073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:12.767145 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 498/1004] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Aug 7 00:51:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:12.768254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c325c-6104-4b67-a5fa-a897ca719431 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:12.877330 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c325c-6104-4b67-a5fa-a897ca719431 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:12.917208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b87a25-5c9c-4ed4-8f4f-c1bef29b4af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:12.917915 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b87a25-5c9c-4ed4-8f4f-c1bef29b4af0 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:12.918258 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b87a25-5c9c-4ed4-8f4f-c1bef29b4af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:12.918533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b87a25-5c9c-4ed4-8f4f-c1bef29b4af0 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:12.919227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b87a25-5c9c-4ed4-8f4f-c1bef29b4af0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:12.919601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b87a25-5c9c-4ed4-8f4f-c1bef29b4af0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:12.921166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b87a25-5c9c-4ed4-8f4f-c1bef29b4af0 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:12.928584 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 507/1005] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Aug 7 00:51:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:12.933675 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3cec8-9680-4430-b38b-cbfc7944519e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:12.988249 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:13.051564 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3cec8-9680-4430-b38b-cbfc7944519e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:13.089143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5a4e3-098e-48b4-aa6c-1dc9b6ad50e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:13.089766 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5a4e3-098e-48b4-aa6c-1dc9b6ad50e9 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:13.090050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5a4e3-098e-48b4-aa6c-1dc9b6ad50e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:13.090315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5a4e3-098e-48b4-aa6c-1dc9b6ad50e9 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:13.090955 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5a4e3-098e-48b4-aa6c-1dc9b6ad50e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:13.091260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5a4e3-098e-48b4-aa6c-1dc9b6ad50e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:13.092668 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5a4e3-098e-48b4-aa6c-1dc9b6ad50e9 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:13.103344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 499/1006] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Aug 7 00:51:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:13.112300 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b87a25-5c9c-4ed4-8f4f-c1bef29b4af0 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:13.153889 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:13.220067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b87a25-5c9c-4ed4-8f4f-c1bef29b4af0 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:13.254938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b99689-d866-4c26-bbfb-a061a63697c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:13.255552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b99689-d866-4c26-bbfb-a061a63697c6 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:13.255837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b99689-d866-4c26-bbfb-a061a63697c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:13.256124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b99689-d866-4c26-bbfb-a061a63697c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:13.256799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b99689-d866-4c26-bbfb-a061a63697c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:13.258154 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b99689-d866-4c26-bbfb-a061a63697c6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:13.275778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 508/1007] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 00:51:13 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:51:13.309828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a4fed-0b04-4214-a6e1-d3be6d623ce9 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:13.310168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a4fed-0b04-4214-a6e1-d3be6d623ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:13.310383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a4fed-0b04-4214-a6e1-d3be6d623ce9 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:13.311943 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 500/1008] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:13.318532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb2848-d300-457b-8875-37878a33cc30 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:13.318834 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb2848-d300-457b-8875-37878a33cc30 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:13.319089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb2848-d300-457b-8875-37878a33cc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:13.349473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-f5fb2848-d300-457b-8875-37878a33cc30 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:13.350786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f5fb2848-d300-457b-8875-37878a33cc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:13.436351 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 509/1009] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:13 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:13.460210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a4fed-0b04-4214-a6e1-d3be6d623ce9 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:13.570894 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a4fed-0b04-4214-a6e1-d3be6d623ce9 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:13.583058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:13.612812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416b538-4c18-4c41-b2e5-2ec124073ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:13.613444 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416b538-4c18-4c41-b2e5-2ec124073ce0 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:13.613732 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416b538-4c18-4c41-b2e5-2ec124073ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:13.613995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416b538-4c18-4c41-b2e5-2ec124073ce0 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:13.614666 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416b538-4c18-4c41-b2e5-2ec124073ce0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:13.616100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416b538-4c18-4c41-b2e5-2ec124073ce0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:13.633207 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 501/1010] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Aug 7 00:51:13 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:51:14.532071 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712e0c7-717a-4e47-896c-586bf8793aa8 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:14.532071 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712e0c7-717a-4e47-896c-586bf8793aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:14.532071 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712e0c7-717a-4e47-896c-586bf8793aa8 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:14.534102 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 510/1011] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:14.539751 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edd1c7-51c5-41ef-9f72-2f8f2797c374 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:14.540221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edd1c7-51c5-41ef-9f72-2f8f2797c374 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:14.540398 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edd1c7-51c5-41ef-9f72-2f8f2797c374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:14.559029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-55edd1c7-51c5-41ef-9f72-2f8f2797c374 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:14.560567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-55edd1c7-51c5-41ef-9f72-2f8f2797c374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:14.637199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 502/1012] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:14 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:51:14.659865 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712e0c7-717a-4e47-896c-586bf8793aa8 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:14.686750 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:14.773732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712e0c7-717a-4e47-896c-586bf8793aa8 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:14.811969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c425c-aa82-49f8-a8f7-b4c46eab75b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:14.812619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c425c-aa82-49f8-a8f7-b4c46eab75b2 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:14.812976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c425c-aa82-49f8-a8f7-b4c46eab75b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:14.813273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c425c-aa82-49f8-a8f7-b4c46eab75b2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:14.813887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c425c-aa82-49f8-a8f7-b4c46eab75b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:14.815278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c425c-aa82-49f8-a8f7-b4c46eab75b2 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-943c425c-aa82-49f8-a8f7-b4c46eab75b2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:14.824672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:14.825778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:14.826672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:14.826672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:14.826672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:14.826672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:14.826672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:14.826672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:14.826672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:14.826672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:14.826672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:14.826672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:14.826672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:51:14.826672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:14.826672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:51:14.826672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:14.831548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 511/1013] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:51:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:14.832826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edd1c7-51c5-41ef-9f72-2f8f2797c374 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:14.928515 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:14.936364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edd1c7-51c5-41ef-9f72-2f8f2797c374 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:14.975104 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f5e0d-f673-4cad-b7f2-b2a081e7ce90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:14.975716 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f5e0d-f673-4cad-b7f2-b2a081e7ce90 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:14.976020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f5e0d-f673-4cad-b7f2-b2a081e7ce90 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:14.976290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f5e0d-f673-4cad-b7f2-b2a081e7ce90 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:14.976928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f5e0d-f673-4cad-b7f2-b2a081e7ce90 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:14.977222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f5e0d-f673-4cad-b7f2-b2a081e7ce90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:14.978591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f5e0d-f673-4cad-b7f2-b2a081e7ce90 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:14.984228 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 503/1014] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Aug 7 00:51:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:14.990093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c425c-aa82-49f8-a8f7-b4c46eab75b2 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:15.091594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:15.105992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c425c-aa82-49f8-a8f7-b4c46eab75b2 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:15.145706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54910df-4f62-47bc-8ad9-52b2c5a541b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:15.146318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54910df-4f62-47bc-8ad9-52b2c5a541b7 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:15.146596 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54910df-4f62-47bc-8ad9-52b2c5a541b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:15.146864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54910df-4f62-47bc-8ad9-52b2c5a541b7 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:15.147495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54910df-4f62-47bc-8ad9-52b2c5a541b7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:15.147793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54910df-4f62-47bc-8ad9-52b2c5a541b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:15.149206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54910df-4f62-47bc-8ad9-52b2c5a541b7 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:15.155321 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 512/1015] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Aug 7 00:51:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:15.161058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f5e0d-f673-4cad-b7f2-b2a081e7ce90 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:15.274674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f5e0d-f673-4cad-b7f2-b2a081e7ce90 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:15.316576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b87409-5f46-422d-86bd-82dba279986d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:15.317199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b87409-5f46-422d-86bd-82dba279986d None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:15.317480 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b87409-5f46-422d-86bd-82dba279986d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:15.317753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b87409-5f46-422d-86bd-82dba279986d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:15.318428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b87409-5f46-422d-86bd-82dba279986d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:15.319806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b87409-5f46-422d-86bd-82dba279986d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:15.343198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 504/1016] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 00:51:15 2022] POST /identity/v3/endpoints => generated 334 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:51:15.362888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb464bf7-91f6-4dec-b1b8-53e612e79582 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:15.363181 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb464bf7-91f6-4dec-b1b8-53e612e79582 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:15.363680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb464bf7-91f6-4dec-b1b8-53e612e79582 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:15.365639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 513/1017] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:51:15.371646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46204175-ead1-4309-9324-693cc2448280 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:15.371993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46204175-ead1-4309-9324-693cc2448280 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:15.372276 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46204175-ead1-4309-9324-693cc2448280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:15.393187 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-46204175-ead1-4309-9324-693cc2448280 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:15.394697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-46204175-ead1-4309-9324-693cc2448280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:15.408339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:15.493493 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 505/1018] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:15.518655 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb464bf7-91f6-4dec-b1b8-53e612e79582 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:15.631244 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb464bf7-91f6-4dec-b1b8-53e612e79582 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:15.670302 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33aa94-39bf-4279-a429-32a7ba6c3a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:15.670969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33aa94-39bf-4279-a429-32a7ba6c3a1c None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:15.671248 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33aa94-39bf-4279-a429-32a7ba6c3a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:15.671520 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33aa94-39bf-4279-a429-32a7ba6c3a1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:15.673544 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33aa94-39bf-4279-a429-32a7ba6c3a1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:15.674911 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33aa94-39bf-4279-a429-32a7ba6c3a1c None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:15.677858 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 514/1019] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:15.682535 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46204175-ead1-4309-9324-693cc2448280 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:15.761731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445f30-cdcc-4198-a5f7-5736d06b4227 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:15.762041 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445f30-cdcc-4198-a5f7-5736d06b4227 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:15.762290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445f30-cdcc-4198-a5f7-5736d06b4227 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:15.763652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 515/1020] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:51:15.769884 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf36b7a-4572-465a-9be7-c567e3299d4f None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:15.770166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf36b7a-4572-465a-9be7-c567e3299d4f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:15.770442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf36b7a-4572-465a-9be7-c567e3299d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:15.789284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-cbf36b7a-4572-465a-9be7-c567e3299d4f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:15.790497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-cbf36b7a-4572-465a-9be7-c567e3299d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:15.796982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46204175-ead1-4309-9324-693cc2448280 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:15.805753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:15.836687 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ccb2c-d54d-4b14-8f33-d6f45e467e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:15.837663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ccb2c-d54d-4b14-8f33-d6f45e467e61 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:15.838112 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ccb2c-d54d-4b14-8f33-d6f45e467e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:15.838520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ccb2c-d54d-4b14-8f33-d6f45e467e61 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:15.839362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ccb2c-d54d-4b14-8f33-d6f45e467e61 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:15.840946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ccb2c-d54d-4b14-8f33-d6f45e467e61 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:15.856852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:15.867962 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 516/1021] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:51:15.884070 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 506/1022] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Aug 7 00:51:15 2022] POST /identity/v3/projects => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:51:15.887965 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf36b7a-4572-465a-9be7-c567e3299d4f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:16.004464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf36b7a-4572-465a-9be7-c567e3299d4f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:16.045854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d1959-84c9-4a02-a249-61940531aa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:16.047442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d1959-84c9-4a02-a249-61940531aa30 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:16.047729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d1959-84c9-4a02-a249-61940531aa30 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:16.048054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d1959-84c9-4a02-a249-61940531aa30 None admin] PATH_INFO: `/v3/services/image` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:16.048779 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d1959-84c9-4a02-a249-61940531aa30 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:16.050304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d1959-84c9-4a02-a249-61940531aa30 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-3f5d1959-84c9-4a02-a249-61940531aa30 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:16.059487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:16.060590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:16.061943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:16.061943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:16.061943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:16.061943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:16.061943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:16.061943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:16.061943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:16.061943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:16.061943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:16.061943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:16.061943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:51:16.061943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:16.061943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:51:16.061943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:16.061943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 517/1023] 10.222.0.20 () {56 vars in 1105 bytes} [Sun Aug 7 00:51:15 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:16.067752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ccb2c-d54d-4b14-8f33-d6f45e467e61 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:16.175715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ccb2c-d54d-4b14-8f33-d6f45e467e61 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:16.212146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00e41f-f3b4-4d41-84f3-1d27e791eb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:16.212763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e41f-f3b4-4d41-84f3-1d27e791eb2b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:16.213039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e41f-f3b4-4d41-84f3-1d27e791eb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:16.213307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e41f-f3b4-4d41-84f3-1d27e791eb2b None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:16.213939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00e41f-f3b4-4d41-84f3-1d27e791eb2b None admin] RBAC: Adding query filter params (name=image) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:16.214239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00e41f-f3b4-4d41-84f3-1d27e791eb2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:16.215583 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00e41f-f3b4-4d41-84f3-1d27e791eb2b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:16.221211 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 507/1024] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:16.227095 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d1959-84c9-4a02-a249-61940531aa30 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:16.244442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:16.337740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d1959-84c9-4a02-a249-61940531aa30 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:16.371336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ffa62-b65b-4f23-9c5b-6207b88517f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:16.371988 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ffa62-b65b-4f23-9c5b-6207b88517f6 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:16.372270 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ffa62-b65b-4f23-9c5b-6207b88517f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:16.372543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ffa62-b65b-4f23-9c5b-6207b88517f6 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:16.373283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ffa62-b65b-4f23-9c5b-6207b88517f6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:16.373584 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ffa62-b65b-4f23-9c5b-6207b88517f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:16.375706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ffa62-b65b-4f23-9c5b-6207b88517f6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:16.380845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 518/1025] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:16.386533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00e41f-f3b4-4d41-84f3-1d27e791eb2b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:16.457474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:16.503799 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00e41f-f3b4-4d41-84f3-1d27e791eb2b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:16.540630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260c766-a5b9-4392-bb9e-9dbd044c1423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:16.541397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260c766-a5b9-4392-bb9e-9dbd044c1423 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:16.541774 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260c766-a5b9-4392-bb9e-9dbd044c1423 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:16.542139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260c766-a5b9-4392-bb9e-9dbd044c1423 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:16.542935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260c766-a5b9-4392-bb9e-9dbd044c1423 None admin] RBAC: Adding query filter params (interface=public, service_id=e1c099ea26c44f1faf2dcbc36fecbc3c, region_id=RegionOne) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:16.543338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260c766-a5b9-4392-bb9e-9dbd044c1423 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:16.544860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0260c766-a5b9-4392-bb9e-9dbd044c1423 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:16.555024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 508/1026] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Aug 7 00:51:16 2022] GET /identity/v3/endpoints?service_id=e1c099ea26c44f1faf2dcbc36fecbc3c&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:16.556294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ffa62-b65b-4f23-9c5b-6207b88517f6 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:16.645931 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:16.670396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ffa62-b65b-4f23-9c5b-6207b88517f6 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:16.709729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbfac4-6cb7-4f01-a501-cf68044bdc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:16.710311 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbfac4-6cb7-4f01-a501-cf68044bdc52 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:16.710595 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbfac4-6cb7-4f01-a501-cf68044bdc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:16.710867 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbfac4-6cb7-4f01-a501-cf68044bdc52 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:16.711479 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbfac4-6cb7-4f01-a501-cf68044bdc52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:16.712888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbfac4-6cb7-4f01-a501-cf68044bdc52 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:16.720195 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 519/1027] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Aug 7 00:51:16 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:51:17.570075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea40350-ee13-4aa7-a035-c8dee10cd459 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:17.570605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea40350-ee13-4aa7-a035-c8dee10cd459 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:17.570605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea40350-ee13-4aa7-a035-c8dee10cd459 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:17.572118 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 509/1028] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:17.579837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdff18c-fc60-433a-9d0a-68e1a9a31bfb None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:17.580161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdff18c-fc60-433a-9d0a-68e1a9a31bfb None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:17.580504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdff18c-fc60-433a-9d0a-68e1a9a31bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:17.603085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-bcdff18c-fc60-433a-9d0a-68e1a9a31bfb None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:17.604318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-bcdff18c-fc60-433a-9d0a-68e1a9a31bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:17.683177 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 520/1029] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:17.708742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea40350-ee13-4aa7-a035-c8dee10cd459 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:17.824903 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea40350-ee13-4aa7-a035-c8dee10cd459 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:17.853900 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:17.868297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49318b79-acc9-4b19-9ee1-f5c77110cc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:17.868994 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49318b79-acc9-4b19-9ee1-f5c77110cc74 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:17.869366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49318b79-acc9-4b19-9ee1-f5c77110cc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:17.869683 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49318b79-acc9-4b19-9ee1-f5c77110cc74 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:17.882735 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49318b79-acc9-4b19-9ee1-f5c77110cc74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-49318b79-acc9-4b19-9ee1-f5c77110cc74 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:17.887879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:17.888977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:17.895754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:17.895754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:17.895754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:17.895754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:17.895754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:17.895754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:17.895754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:17.895754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:17.895754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:17.895754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:17.895754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:51:17.895754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:17.895754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 510/1030] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Aug 7 00:51:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:17.898564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdff18c-fc60-433a-9d0a-68e1a9a31bfb None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:17.979220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:17.994284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0e7c2-59c0-45dd-bf38-9e95ab98d8d4 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:17.994573 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0e7c2-59c0-45dd-bf38-9e95ab98d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:17.994852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0e7c2-59c0-45dd-bf38-9e95ab98d8d4 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:17.996416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 511/1031] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:51:18.002635 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecde330-de6b-4826-9816-94c7e5827413 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:18.002919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecde330-de6b-4826-9816-94c7e5827413 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:18.003197 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecde330-de6b-4826-9816-94c7e5827413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:18.017306 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdff18c-fc60-433a-9d0a-68e1a9a31bfb None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:18.023924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9ecde330-de6b-4826-9816-94c7e5827413 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:18.025174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9ecde330-de6b-4826-9816-94c7e5827413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:18.064855 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f1710-0c1a-436a-9b8f-67fd87deed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:18.065606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f1710-0c1a-436a-9b8f-67fd87deed3e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:18.065891 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f1710-0c1a-436a-9b8f-67fd87deed3e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:18.066202 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f1710-0c1a-436a-9b8f-67fd87deed3e None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:18.066963 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f1710-0c1a-436a-9b8f-67fd87deed3e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:18.067267 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f1710-0c1a-436a-9b8f-67fd87deed3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:18.068699 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f1710-0c1a-436a-9b8f-67fd87deed3e None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:18.080038 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 521/1032] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Aug 7 00:51:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:18.084650 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f1710-0c1a-436a-9b8f-67fd87deed3e None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:18.119866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 512/1033] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:51:18.147236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecde330-de6b-4826-9816-94c7e5827413 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:18.238945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f1710-0c1a-436a-9b8f-67fd87deed3e None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:18.268619 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecde330-de6b-4826-9816-94c7e5827413 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:18.276397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99574b-f997-47de-ba8d-a783bf103f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:18.277591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99574b-f997-47de-ba8d-a783bf103f18 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:18.277866 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99574b-f997-47de-ba8d-a783bf103f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:18.278151 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99574b-f997-47de-ba8d-a783bf103f18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:18.280715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:18.286986 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:18.296973 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99574b-f997-47de-ba8d-a783bf103f18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:18.300715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99574b-f997-47de-ba8d-a783bf103f18 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:18.317051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75672ba9-0c35-4369-b0a1-ec5fea5dde0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:18.317697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75672ba9-0c35-4369-b0a1-ec5fea5dde0d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:18.317976 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75672ba9-0c35-4369-b0a1-ec5fea5dde0d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:18.318246 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75672ba9-0c35-4369-b0a1-ec5fea5dde0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:18.319373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75672ba9-0c35-4369-b0a1-ec5fea5dde0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-6e99574b-f997-47de-ba8d-a783bf103f18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:51:18.320532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:18.321515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:51:18.322857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:51:18.322857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:18.322857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:18.328482 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75672ba9-0c35-4369-b0a1-ec5fea5dde0d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:18.328625 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 522/1034] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:51:18.328764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 513/1035] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:18.328902 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99574b-f997-47de-ba8d-a783bf103f18 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:18.330871 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75672ba9-0c35-4369-b0a1-ec5fea5dde0d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:18.460968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99574b-f997-47de-ba8d-a783bf103f18 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:18.472684 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75672ba9-0c35-4369-b0a1-ec5fea5dde0d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:18.513609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5ed97-19d1-4c3d-bee1-8dcce32b2d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:18.514226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5ed97-19d1-4c3d-bee1-8dcce32b2d04 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:18.514506 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5ed97-19d1-4c3d-bee1-8dcce32b2d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:18.514772 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5ed97-19d1-4c3d-bee1-8dcce32b2d04 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:18.516154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5ed97-19d1-4c3d-bee1-8dcce32b2d04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:18.517436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87825573-42c7-4a54-913a-2fb4e48156d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:18.517681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5ed97-19d1-4c3d-bee1-8dcce32b2d04 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:18.518058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87825573-42c7-4a54-913a-2fb4e48156d7 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:18.518344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87825573-42c7-4a54-913a-2fb4e48156d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:18.518344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87825573-42c7-4a54-913a-2fb4e48156d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:18.518344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87825573-42c7-4a54-913a-2fb4e48156d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:18.518344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87825573-42c7-4a54-913a-2fb4e48156d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:18.518344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87825573-42c7-4a54-913a-2fb4e48156d7 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:18.538672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 523/1036] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:18.544269 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87825573-42c7-4a54-913a-2fb4e48156d7 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:18.560122 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 514/1037] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:51:18 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:51:18.599594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:18.666712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87825573-42c7-4a54-913a-2fb4e48156d7 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:18.708497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570eb199-22af-4f6b-86bc-6d4b0782952e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:18.709119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570eb199-22af-4f6b-86bc-6d4b0782952e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:18.709402 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570eb199-22af-4f6b-86bc-6d4b0782952e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:18.710333 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570eb199-22af-4f6b-86bc-6d4b0782952e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:18.718936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570eb199-22af-4f6b-86bc-6d4b0782952e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:18.720424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570eb199-22af-4f6b-86bc-6d4b0782952e None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-570eb199-22af-4f6b-86bc-6d4b0782952e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:51:18.732597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:18.733599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:18.734587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:18.734587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:18.734587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:51:18.734587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:51:18.734587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:51:18.734587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:51:18.734587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:51:18.734587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:51:18.734587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:51:18.734587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:18.734587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 524/1038] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Aug 7 00:51:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:51:18.739685 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5ed97-19d1-4c3d-bee1-8dcce32b2d04 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:18.779144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6a737-b31a-4f84-ad25-de2267313ce2 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:18.779424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6a737-b31a-4f84-ad25-de2267313ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:18.779707 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6a737-b31a-4f84-ad25-de2267313ce2 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:18.781456 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 525/1039] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:18.782929 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:18.787768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4bf99-1b84-4db1-8e92-83d9c45eb75e None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:18.788113 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4bf99-1b84-4db1-8e92-83d9c45eb75e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:18.788392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4bf99-1b84-4db1-8e92-83d9c45eb75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:18.807049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5cc4bf99-1b84-4db1-8e92-83d9c45eb75e None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:18.808503 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5cc4bf99-1b84-4db1-8e92-83d9c45eb75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:18.855570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5ed97-19d1-4c3d-bee1-8dcce32b2d04 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:18.891938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 526/1040] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:18.896860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fe357-50e4-488d-8a63-137c3ace9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:18.897625 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fe357-50e4-488d-8a63-137c3ace9a07 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:18.897904 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fe357-50e4-488d-8a63-137c3ace9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:18.898174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fe357-50e4-488d-8a63-137c3ace9a07 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:18.899001 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fe357-50e4-488d-8a63-137c3ace9a07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:18.899305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fe357-50e4-488d-8a63-137c3ace9a07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:18.900855 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fe357-50e4-488d-8a63-137c3ace9a07 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:18.912594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4bf99-1b84-4db1-8e92-83d9c45eb75e None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:18.920541 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 515/1041] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Aug 7 00:51:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:18.927048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fe357-50e4-488d-8a63-137c3ace9a07 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:18.949975 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:19.026516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4bf99-1b84-4db1-8e92-83d9c45eb75e None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:19.031530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:19.040968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fe357-50e4-488d-8a63-137c3ace9a07 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:19.065142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d03a3e-e816-4fab-83dc-5e04e8e16880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:19.065776 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d03a3e-e816-4fab-83dc-5e04e8e16880 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:19.066064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d03a3e-e816-4fab-83dc-5e04e8e16880 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:19.066311 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d03a3e-e816-4fab-83dc-5e04e8e16880 None admin] PATH_INFO: `/v3/services/image` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:19.066897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d03a3e-e816-4fab-83dc-5e04e8e16880 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:19.068294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d03a3e-e816-4fab-83dc-5e04e8e16880 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-83d03a3e-e816-4fab-83dc-5e04e8e16880 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:19.078294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:19.079582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:19.080672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:19.080672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:19.080672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:19.080672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:19.080672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:19.080672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:19.080672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:19.080672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:19.080672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:19.080672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:19.080672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:51:19.080672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:51:19.080672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:51:19.080672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:19.082293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d7e32-7b02-452c-ac76-189e100fe9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:19.082920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d7e32-7b02-452c-ac76-189e100fe9fa None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:19.083199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d7e32-7b02-452c-ac76-189e100fe9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:19.083468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d7e32-7b02-452c-ac76-189e100fe9fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:19.084504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 527/1042] 10.222.0.20 () {56 vars in 1105 bytes} [Sun Aug 7 00:51:18 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:51:19.085341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d03a3e-e816-4fab-83dc-5e04e8e16880 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:19.154946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d7e32-7b02-452c-ac76-189e100fe9fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:19.157003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d7e32-7b02-452c-ac76-189e100fe9fa None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:19.194194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:19.198125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d03a3e-e816-4fab-83dc-5e04e8e16880 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:19.238857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89353c53-be7f-4486-b639-f5bbca09633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:19.239467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89353c53-be7f-4486-b639-f5bbca09633d None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:19.239748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89353c53-be7f-4486-b639-f5bbca09633d None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:19.240048 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89353c53-be7f-4486-b639-f5bbca09633d None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:19.240672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89353c53-be7f-4486-b639-f5bbca09633d None admin] RBAC: Adding query filter params (name=image) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:19.240969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89353c53-be7f-4486-b639-f5bbca09633d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:19.242330 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89353c53-be7f-4486-b639-f5bbca09633d None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:19.248427 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 528/1043] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:19.253850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89353c53-be7f-4486-b639-f5bbca09633d None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:19.264075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:19.274196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 516/1044] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:18 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 00:51:19.279561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d7e32-7b02-452c-ac76-189e100fe9fa None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:19.363771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89353c53-be7f-4486-b639-f5bbca09633d None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:19.387225 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d7e32-7b02-452c-ac76-189e100fe9fa None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:19.400418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decf0d6-6520-4cc7-aa95-658ed1f88bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:19.401028 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decf0d6-6520-4cc7-aa95-658ed1f88bce None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:19.401305 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decf0d6-6520-4cc7-aa95-658ed1f88bce None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:19.401616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decf0d6-6520-4cc7-aa95-658ed1f88bce None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:19.402197 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decf0d6-6520-4cc7-aa95-658ed1f88bce None admin] RBAC: Adding query filter params (type=image) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:19.402497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decf0d6-6520-4cc7-aa95-658ed1f88bce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:19.403851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decf0d6-6520-4cc7-aa95-658ed1f88bce None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:19.409740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 529/1045] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:19.414956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decf0d6-6520-4cc7-aa95-658ed1f88bce None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:19.428991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602d01b-f7be-46cd-9b92-5435a76fa39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:19.429617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602d01b-f7be-46cd-9b92-5435a76fa39b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:19.429894 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602d01b-f7be-46cd-9b92-5435a76fa39b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:19.430165 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602d01b-f7be-46cd-9b92-5435a76fa39b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:19.440752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602d01b-f7be-46cd-9b92-5435a76fa39b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:19.442179 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602d01b-f7be-46cd-9b92-5435a76fa39b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:19.455268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-0602d01b-f7be-46cd-9b92-5435a76fa39b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:51:19.457213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:19.458181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:51:19.459107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:51:19.459107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:19.459107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:19.459107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 517/1046] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:51:19.464050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602d01b-f7be-46cd-9b92-5435a76fa39b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:19.520353 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:19.539463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decf0d6-6520-4cc7-aa95-658ed1f88bce None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:19.577305 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c8042-bd93-441b-8d84-2e28a2f1948c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:19.577947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c8042-bd93-441b-8d84-2e28a2f1948c None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:19.578233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c8042-bd93-441b-8d84-2e28a2f1948c None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:19.578479 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c8042-bd93-441b-8d84-2e28a2f1948c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:19.579141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c8042-bd93-441b-8d84-2e28a2f1948c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:19.580546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c8042-bd93-441b-8d84-2e28a2f1948c None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:19.586585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602d01b-f7be-46cd-9b92-5435a76fa39b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:19.602783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 530/1047] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 00:51:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:51:19.639279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e922d50-6829-44af-bb3f-721a871b2e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:19.639279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e922d50-6829-44af-bb3f-721a871b2e59 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:19.639279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e922d50-6829-44af-bb3f-721a871b2e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:19.639279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e922d50-6829-44af-bb3f-721a871b2e59 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:19.639736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e922d50-6829-44af-bb3f-721a871b2e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:19.639736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e922d50-6829-44af-bb3f-721a871b2e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:19.641040 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e922d50-6829-44af-bb3f-721a871b2e59 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:19.655498 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 518/1048] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:19.663175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c8042-bd93-441b-8d84-2e28a2f1948c None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:19.772718 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:19.793291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c8042-bd93-441b-8d84-2e28a2f1948c None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:19.831808 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdbe8f-54a8-4771-8ea9-f211097bcfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:19.832490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdbe8f-54a8-4771-8ea9-f211097bcfbd None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:19.832832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdbe8f-54a8-4771-8ea9-f211097bcfbd None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:19.833191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdbe8f-54a8-4771-8ea9-f211097bcfbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:19.840583 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdbe8f-54a8-4771-8ea9-f211097bcfbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:19.842022 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdbe8f-54a8-4771-8ea9-f211097bcfbd None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:19.854475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-a4cdbe8f-54a8-4771-8ea9-f211097bcfbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:51:19.854475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:19.854475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:19.854475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:19.854475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:19.854475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:19.854475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:19.854475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:19.854475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:19.854475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:19.854475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:19.854475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:19.854475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:51:19.854475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:51:19.854475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:19.855406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:19.856398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:51:19.856398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:51:19.856398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:51:19.856398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:51:19.856398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:51:19.856398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:51:19.856398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:51:19.856398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:19.856398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 531/1049] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:51:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:19.863409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e922d50-6829-44af-bb3f-721a871b2e59 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:19.970993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e922d50-6829-44af-bb3f-721a871b2e59 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:19.972607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:20.011482 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eea3e3-d9f1-4974-a8c2-180ecc7b7a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:20.012126 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eea3e3-d9f1-4974-a8c2-180ecc7b7a20 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:20.012404 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eea3e3-d9f1-4974-a8c2-180ecc7b7a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:20.012671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eea3e3-d9f1-4974-a8c2-180ecc7b7a20 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:20.013377 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eea3e3-d9f1-4974-a8c2-180ecc7b7a20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:20.013675 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eea3e3-d9f1-4974-a8c2-180ecc7b7a20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:20.015102 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eea3e3-d9f1-4974-a8c2-180ecc7b7a20 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:20.034326 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 519/1050] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:51:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:20.035625 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdbe8f-54a8-4771-8ea9-f211097bcfbd None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:20.146657 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdbe8f-54a8-4771-8ea9-f211097bcfbd None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:20.184398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912c8ca-0e79-4654-95b3-1b761757bab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:20.185005 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912c8ca-0e79-4654-95b3-1b761757bab4 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:20.185273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912c8ca-0e79-4654-95b3-1b761757bab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:20.185553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912c8ca-0e79-4654-95b3-1b761757bab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:20.186293 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912c8ca-0e79-4654-95b3-1b761757bab4 None admin] RBAC: Adding query filter params (role.id=80c00799fe044866b3fdf89e57748760, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=20b8a995891f46f1ab1672836752cc4e) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:20.186587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912c8ca-0e79-4654-95b3-1b761757bab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:20.188683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912c8ca-0e79-4654-95b3-1b761757bab4 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:20.200264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 532/1051] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:51:20 2022] GET /identity/v3/role_assignments?user.id=20b8a995891f46f1ab1672836752cc4e&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=80c00799fe044866b3fdf89e57748760 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:20.692002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0dcb9-83e0-4e10-8667-6b905090a0bf None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:20.692658 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0dcb9-83e0-4e10-8667-6b905090a0bf None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:20.692933 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0dcb9-83e0-4e10-8667-6b905090a0bf None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:20.694326 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 520/1052] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:20.700051 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ad0b0-166f-475d-910d-8d7b163f25f0 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:20.700338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ad0b0-166f-475d-910d-8d7b163f25f0 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:20.700612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ad0b0-166f-475d-910d-8d7b163f25f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:20.720597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-6f6ad0b0-166f-475d-910d-8d7b163f25f0 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:20.721809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-6f6ad0b0-166f-475d-910d-8d7b163f25f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:20.724183 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:20.797986 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 533/1053] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:51:20.821090 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0dcb9-83e0-4e10-8667-6b905090a0bf None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:20.929602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0dcb9-83e0-4e10-8667-6b905090a0bf None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:20.964002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbee39-0b3f-40a5-8433-93988bba50a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:20.964637 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbee39-0b3f-40a5-8433-93988bba50a3 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:20.964915 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbee39-0b3f-40a5-8433-93988bba50a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:20.965184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbee39-0b3f-40a5-8433-93988bba50a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:20.976050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbee39-0b3f-40a5-8433-93988bba50a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-73bbee39-0b3f-40a5-8433-93988bba50a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:20.980706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:20.981734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:20.983182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:20.983182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:20.983182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:20.983182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:20.983182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:20.983182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:20.983182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:20.983182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:20.983182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:20.983182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:20.983182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:20.983182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:20.983182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 521/1054] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:51:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:20.988704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ad0b0-166f-475d-910d-8d7b163f25f0 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:21.088703 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ad0b0-166f-475d-910d-8d7b163f25f0 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:21.124292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb253b06-e854-4972-8792-6579966391e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:21.125126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb253b06-e854-4972-8792-6579966391e2 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:21.125645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb253b06-e854-4972-8792-6579966391e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:21.125934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb253b06-e854-4972-8792-6579966391e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:21.126619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb253b06-e854-4972-8792-6579966391e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:21.126928 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb253b06-e854-4972-8792-6579966391e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:21.128352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb253b06-e854-4972-8792-6579966391e2 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:21.134372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:21.139512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 534/1055] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:51:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:21.145727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbee39-0b3f-40a5-8433-93988bba50a3 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:21.172306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:21.252950 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbee39-0b3f-40a5-8433-93988bba50a3 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:21.289859 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde98b5b-be2c-4e2b-98fb-4183ef5ff544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:21.290505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde98b5b-be2c-4e2b-98fb-4183ef5ff544 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:21.290787 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde98b5b-be2c-4e2b-98fb-4183ef5ff544 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:21.291060 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde98b5b-be2c-4e2b-98fb-4183ef5ff544 None admin] PATH_INFO: `/v3/users/6d9f80891931464dbab93553a18ce985` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:21.305000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde98b5b-be2c-4e2b-98fb-4183ef5ff544 None admin] RBAC: Authorizing `identity:get_user(user_id=6d9f80891931464dbab93553a18ce985)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:21.306444 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde98b5b-be2c-4e2b-98fb-4183ef5ff544 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:21.308154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 522/1056] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:21 2022] GET /identity/v3/users/6d9f80891931464dbab93553a18ce985 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:21.314497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb253b06-e854-4972-8792-6579966391e2 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:21.423050 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb253b06-e854-4972-8792-6579966391e2 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:21.458103 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64962fd8-91f3-41a9-b739-c6a405e7b47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:21.458717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64962fd8-91f3-41a9-b739-c6a405e7b47e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:21.458997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64962fd8-91f3-41a9-b739-c6a405e7b47e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:21.459271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64962fd8-91f3-41a9-b739-c6a405e7b47e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:21.532276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:21.535528 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64962fd8-91f3-41a9-b739-c6a405e7b47e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:21.537635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64962fd8-91f3-41a9-b739-c6a405e7b47e None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:21.642220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 535/1057] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:51:21.648378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde98b5b-be2c-4e2b-98fb-4183ef5ff544 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:21.711656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ed018-98d8-4c6d-866d-b77b9e54c79f None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:21.712018 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ed018-98d8-4c6d-866d-b77b9e54c79f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:21.712245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ed018-98d8-4c6d-866d-b77b9e54c79f None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:21.713735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 536/1058] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:51:21.718940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e0500-ddf2-494c-9b97-df3ea7ccea28 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:21.719214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e0500-ddf2-494c-9b97-df3ea7ccea28 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:21.719490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e0500-ddf2-494c-9b97-df3ea7ccea28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:21.739111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:21.739307 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-aa0e0500-ddf2-494c-9b97-df3ea7ccea28 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:21.740398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-aa0e0500-ddf2-494c-9b97-df3ea7ccea28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:21.761629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde98b5b-be2c-4e2b-98fb-4183ef5ff544 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:21.798577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133950bf-157b-4a24-83f3-5d59929688fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:21.799126 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133950bf-157b-4a24-83f3-5d59929688fb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:21.799403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133950bf-157b-4a24-83f3-5d59929688fb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:21.799674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133950bf-157b-4a24-83f3-5d59929688fb None admin] PATH_INFO: `/v3/projects/6e79921ffc1f4369962c1af8173307c0` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:21.800844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133950bf-157b-4a24-83f3-5d59929688fb None admin] RBAC: Authorizing `identity:get_project(project_id=6e79921ffc1f4369962c1af8173307c0)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:21.802271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133950bf-157b-4a24-83f3-5d59929688fb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:21.808933 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 523/1059] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:51:21 2022] GET /identity/v3/projects/6e79921ffc1f4369962c1af8173307c0 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:21.810480 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133950bf-157b-4a24-83f3-5d59929688fb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:21.819031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 537/1060] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:51:21.841701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e0500-ddf2-494c-9b97-df3ea7ccea28 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:21.877762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:21.925969 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133950bf-157b-4a24-83f3-5d59929688fb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:21.959989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e0500-ddf2-494c-9b97-df3ea7ccea28 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:21.961842 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217d621-b604-4d1b-a001-5bf5a87d8647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:21.962462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217d621-b604-4d1b-a001-5bf5a87d8647 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:21.962742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217d621-b604-4d1b-a001-5bf5a87d8647 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:21.963016 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217d621-b604-4d1b-a001-5bf5a87d8647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:21.963751 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217d621-b604-4d1b-a001-5bf5a87d8647 None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=6e79921ffc1f4369962c1af8173307c0, user.id=6d9f80891931464dbab93553a18ce985) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:21.964091 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217d621-b604-4d1b-a001-5bf5a87d8647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:21.965537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217d621-b604-4d1b-a001-5bf5a87d8647 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:21.979948 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 524/1061] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:51:21 2022] GET /identity/v3/role_assignments?user.id=6d9f80891931464dbab93553a18ce985&scope.project.id=6e79921ffc1f4369962c1af8173307c0&role.id=638e1fc82db44124ae615c46408110a7 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:22.000864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c980562-7c80-41c3-a4ac-170cea84f5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:22.001495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c980562-7c80-41c3-a4ac-170cea84f5ba None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:22.001776 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c980562-7c80-41c3-a4ac-170cea84f5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:22.002048 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c980562-7c80-41c3-a4ac-170cea84f5ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:22.079946 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c980562-7c80-41c3-a4ac-170cea84f5ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:22.081356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c980562-7c80-41c3-a4ac-170cea84f5ba None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:22.114839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:22.193883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 538/1062] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 00:51:22.199966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217d621-b604-4d1b-a001-5bf5a87d8647 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:22.217000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:22.269901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc20055-48f1-41e5-8c8e-aeea2caaffc3 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:22.270183 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc20055-48f1-41e5-8c8e-aeea2caaffc3 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:22.270452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc20055-48f1-41e5-8c8e-aeea2caaffc3 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:22.271995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 539/1063] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:51:22.276680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ba942-1a6a-4fd0-9080-4ed94e43cffc None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:22.276968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ba942-1a6a-4fd0-9080-4ed94e43cffc None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:22.277244 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ba942-1a6a-4fd0-9080-4ed94e43cffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:22.296767 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3d3ba942-1a6a-4fd0-9080-4ed94e43cffc None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:22.298081 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3d3ba942-1a6a-4fd0-9080-4ed94e43cffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:22.315514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217d621-b604-4d1b-a001-5bf5a87d8647 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:22.356836 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bccbc-2f70-43e6-b0b6-fe6c8cb55ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:22.357445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bccbc-2f70-43e6-b0b6-fe6c8cb55ead None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:22.357763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bccbc-2f70-43e6-b0b6-fe6c8cb55ead None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:22.358079 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bccbc-2f70-43e6-b0b6-fe6c8cb55ead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:22.370554 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 540/1064] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:51:22.372080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bccbc-2f70-43e6-b0b6-fe6c8cb55ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:22.373660 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bccbc-2f70-43e6-b0b6-fe6c8cb55ead None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c99bccbc-2f70-43e6-b0b6-fe6c8cb55ead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:51:22.389183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:22.390837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:51:22.391860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:51:22.391860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:22.391860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:22.394148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ba942-1a6a-4fd0-9080-4ed94e43cffc None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:22.396115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 525/1065] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:22.397484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bccbc-2f70-43e6-b0b6-fe6c8cb55ead None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:22.458702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:22.472397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:22.509980 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ba942-1a6a-4fd0-9080-4ed94e43cffc None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:22.525182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bccbc-2f70-43e6-b0b6-fe6c8cb55ead None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:22.555944 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3a375-91e8-4e0f-9515-f216dd70bc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:22.556590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3a375-91e8-4e0f-9515-f216dd70bc79 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:22.556864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3a375-91e8-4e0f-9515-f216dd70bc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:22.557132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3a375-91e8-4e0f-9515-f216dd70bc79 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:22.565966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7c966-23f9-4c94-9227-ec0e37df036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:22.566572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7c966-23f9-4c94-9227-ec0e37df036c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:22.566857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7c966-23f9-4c94-9227-ec0e37df036c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:22.567125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7c966-23f9-4c94-9227-ec0e37df036c None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:22.567771 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7c966-23f9-4c94-9227-ec0e37df036c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:22.568099 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7c966-23f9-4c94-9227-ec0e37df036c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:22.568260 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3a375-91e8-4e0f-9515-f216dd70bc79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:22.569452 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7c966-23f9-4c94-9227-ec0e37df036c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-dcf3a375-91e8-4e0f-9515-f216dd70bc79 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:22.572930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:22.573972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:22.574872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:22.574872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:22.574872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:22.574872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:22.574872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:22.574872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:22.574872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:22.574872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:22.574872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:22.574872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:22.574872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:51:22.574872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:22.574872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 541/1066] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Aug 7 00:51:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:22.580748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3a375-91e8-4e0f-9515-f216dd70bc79 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:22.596195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 526/1067] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:22.733468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3a375-91e8-4e0f-9515-f216dd70bc79 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:22.758637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:22.777748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d058457-0895-41c0-8b0d-ecb361f0afca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:22.778367 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058457-0895-41c0-8b0d-ecb361f0afca None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:22.778643 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058457-0895-41c0-8b0d-ecb361f0afca None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:22.778911 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058457-0895-41c0-8b0d-ecb361f0afca None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:22.779703 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d058457-0895-41c0-8b0d-ecb361f0afca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:22.780040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d058457-0895-41c0-8b0d-ecb361f0afca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:22.782208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d058457-0895-41c0-8b0d-ecb361f0afca None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:22.791060 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 542/1068] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Aug 7 00:51:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:22.797063 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7c966-23f9-4c94-9227-ec0e37df036c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:22.922202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7c966-23f9-4c94-9227-ec0e37df036c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:22.946111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:22.957806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1cb0f-2713-4855-962e-90f36ac943d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:22.958439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1cb0f-2713-4855-962e-90f36ac943d0 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:22.958714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1cb0f-2713-4855-962e-90f36ac943d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:22.958982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1cb0f-2713-4855-962e-90f36ac943d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:22.969879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1cb0f-2713-4855-962e-90f36ac943d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:22.971302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1cb0f-2713-4855-962e-90f36ac943d0 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-1fe1cb0f-2713-4855-962e-90f36ac943d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:51:22.985885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:22.987043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:51:22.987999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:51:22.987999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:22.987999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:22.987999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 527/1069] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:22.993022 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d058457-0895-41c0-8b0d-ecb361f0afca None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:23.097590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d058457-0895-41c0-8b0d-ecb361f0afca None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:23.143135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f4892-7377-4fd4-a3b0-3bf609485715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:23.144210 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f4892-7377-4fd4-a3b0-3bf609485715 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:23.144558 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f4892-7377-4fd4-a3b0-3bf609485715 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:23.144892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f4892-7377-4fd4-a3b0-3bf609485715 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:23.145658 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f4892-7377-4fd4-a3b0-3bf609485715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:23.146068 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f4892-7377-4fd4-a3b0-3bf609485715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:23.147600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f4892-7377-4fd4-a3b0-3bf609485715 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:23.160857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 543/1070] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:23.167118 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1cb0f-2713-4855-962e-90f36ac943d0 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:23.272758 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1cb0f-2713-4855-962e-90f36ac943d0 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:23.310397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3292c88-65f4-48b5-910f-60c19ae8463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:23.311069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3292c88-65f4-48b5-910f-60c19ae8463d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:23.311390 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3292c88-65f4-48b5-910f-60c19ae8463d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:23.311743 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3292c88-65f4-48b5-910f-60c19ae8463d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:23.320621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3292c88-65f4-48b5-910f-60c19ae8463d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:23.322045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3292c88-65f4-48b5-910f-60c19ae8463d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-d3292c88-65f4-48b5-910f-60c19ae8463d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:51:23.334184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:23.336143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:23.338076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:23.338076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:23.338076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:51:23.338076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:51:23.338076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:51:23.338076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:51:23.338076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:51:23.338076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:51:23.338076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:51:23.338076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:23.338076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 528/1071] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Aug 7 00:51:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:23.341263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f4892-7377-4fd4-a3b0-3bf609485715 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:23.386123 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:23.448255 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f4892-7377-4fd4-a3b0-3bf609485715 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:23.495492 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1938ea-1e91-426c-a4b8-df84a2413f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:23.496157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1938ea-1e91-426c-a4b8-df84a2413f06 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:23.496416 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1938ea-1e91-426c-a4b8-df84a2413f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:23.496685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1938ea-1e91-426c-a4b8-df84a2413f06 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:23.497421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1938ea-1e91-426c-a4b8-df84a2413f06 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:23.497724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1938ea-1e91-426c-a4b8-df84a2413f06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:23.499159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1938ea-1e91-426c-a4b8-df84a2413f06 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:23.518269 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 544/1072] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Aug 7 00:51:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:23.524337 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3292c88-65f4-48b5-910f-60c19ae8463d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:23.561841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:23.630125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3292c88-65f4-48b5-910f-60c19ae8463d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:23.666921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48901e8-b6e4-4fd7-a0a2-91a97804140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:23.667548 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48901e8-b6e4-4fd7-a0a2-91a97804140f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:23.667823 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48901e8-b6e4-4fd7-a0a2-91a97804140f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:23.668115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48901e8-b6e4-4fd7-a0a2-91a97804140f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:23.679854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48901e8-b6e4-4fd7-a0a2-91a97804140f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:23.681340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48901e8-b6e4-4fd7-a0a2-91a97804140f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-a48901e8-b6e4-4fd7-a0a2-91a97804140f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:51:23.697727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:23.704193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:51:23.705640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:51:23.705640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:23.705640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:23.705640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 529/1073] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:23.705953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1938ea-1e91-426c-a4b8-df84a2413f06 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:23.813097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:23.816295 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1938ea-1e91-426c-a4b8-df84a2413f06 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:23.854713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9212cf-533c-4394-8826-5e605128b122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:23.855339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9212cf-533c-4394-8826-5e605128b122 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:23.855613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9212cf-533c-4394-8826-5e605128b122 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:23.855922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9212cf-533c-4394-8826-5e605128b122 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:23.856585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9212cf-533c-4394-8826-5e605128b122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:23.856884 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9212cf-533c-4394-8826-5e605128b122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:23.858264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9212cf-533c-4394-8826-5e605128b122 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:23.871285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 545/1074] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:23.877239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48901e8-b6e4-4fd7-a0a2-91a97804140f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:23.973265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:23.987492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48901e8-b6e4-4fd7-a0a2-91a97804140f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:24.024371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc9678-0333-436b-90f7-61d77dda9ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:24.025005 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc9678-0333-436b-90f7-61d77dda9ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:24.026012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc9678-0333-436b-90f7-61d77dda9ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:24.026012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc9678-0333-436b-90f7-61d77dda9ea3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:24.033523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc9678-0333-436b-90f7-61d77dda9ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:24.034972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc9678-0333-436b-90f7-61d77dda9ea3 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:24.046790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-65cc9678-0333-436b-90f7-61d77dda9ea3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:51:24.046790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:24.046790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:24.046790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:24.046790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:24.046790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:24.046790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:24.046790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:24.046790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:24.046790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:24.046790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:24.046790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:24.046790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:51:24.046790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:51:24.046790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:24.047869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:24.048837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:51:24.048837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:51:24.048837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:51:24.048837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:51:24.048837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:51:24.048837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:51:24.048837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:51:24.048837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:24.048837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 530/1075] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:24.053876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9212cf-533c-4394-8826-5e605128b122 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:24.078964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477ee1b-f797-4bec-9850-469ea0a6ad6d None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:24.079169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477ee1b-f797-4bec-9850-469ea0a6ad6d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:24.079451 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477ee1b-f797-4bec-9850-469ea0a6ad6d None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:24.080831 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 531/1076] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:24.085964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f973f-bfbd-4360-8277-5bcc5dd94f2a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:24.086248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f973f-bfbd-4360-8277-5bcc5dd94f2a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:24.086528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f973f-bfbd-4360-8277-5bcc5dd94f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:24.105103 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c78f973f-bfbd-4360-8277-5bcc5dd94f2a None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:24.106340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c78f973f-bfbd-4360-8277-5bcc5dd94f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:24.156388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9212cf-533c-4394-8826-5e605128b122 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:24.177475 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 532/1077] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:51:24.191035 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547ed77-868a-40cf-bb47-4919b7f6d487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:24.191639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547ed77-868a-40cf-bb47-4919b7f6d487 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:24.191925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547ed77-868a-40cf-bb47-4919b7f6d487 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:24.192209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547ed77-868a-40cf-bb47-4919b7f6d487 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:24.192899 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547ed77-868a-40cf-bb47-4919b7f6d487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:24.193200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547ed77-868a-40cf-bb47-4919b7f6d487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:24.194624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547ed77-868a-40cf-bb47-4919b7f6d487 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:24.200493 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f973f-bfbd-4360-8277-5bcc5dd94f2a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:24.206977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 546/1078] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:51:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:24.212989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547ed77-868a-40cf-bb47-4919b7f6d487 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:24.235395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:24.281738 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:24.303317 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f973f-bfbd-4360-8277-5bcc5dd94f2a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:24.314992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547ed77-868a-40cf-bb47-4919b7f6d487 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:24.338376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4d2ec-d252-4121-9549-a24c86f67014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:24.338929 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4d2ec-d252-4121-9549-a24c86f67014 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:24.339207 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4d2ec-d252-4121-9549-a24c86f67014 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:24.339482 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4d2ec-d252-4121-9549-a24c86f67014 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:24.350415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4d2ec-d252-4121-9549-a24c86f67014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:24.350558 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d6c6e-3a6a-468f-9501-facb8175a6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:24.351180 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6c6e-3a6a-468f-9501-facb8175a6be None admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:24.351454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6c6e-3a6a-468f-9501-facb8175a6be None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:24.351724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6c6e-3a6a-468f-9501-facb8175a6be None admin] PATH_INFO: `/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/20b8a995891f46f1ab1672836752cc4e/roles/80c00799fe044866b3fdf89e57748760` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:24.353883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d6c6e-3a6a-468f-9501-facb8175a6be None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9f64c951f44fd48eedc312b1f33694, user_id=20b8a995891f46f1ab1672836752cc4e, role_id=80c00799fe044866b3fdf89e57748760)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-cce4d2ec-d252-4121-9549-a24c86f67014 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:24.355056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:24.356230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:24.357115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:24.357115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:24.357115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:24.357115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:24.357115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:24.357115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:24.357115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:24.357115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:24.357115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:24.357115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:24.357115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:24.357115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:24.357787 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d6c6e-3a6a-468f-9501-facb8175a6be None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:24.357868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 533/1079] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:51:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:51:24.362528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4d2ec-d252-4121-9549-a24c86f67014 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:24.373130 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 547/1080] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:51:24 2022] PUT /identity/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/20b8a995891f46f1ab1672836752cc4e/roles/80c00799fe044866b3fdf89e57748760 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:51:24.473092 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4d2ec-d252-4121-9549-a24c86f67014 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:24.509195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73117be-a3dd-42b4-bbb8-4b33ad8cb2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:24.509824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73117be-a3dd-42b4-bbb8-4b33ad8cb2eb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:24.510104 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73117be-a3dd-42b4-bbb8-4b33ad8cb2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:24.510374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73117be-a3dd-42b4-bbb8-4b33ad8cb2eb None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:24.511055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73117be-a3dd-42b4-bbb8-4b33ad8cb2eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:24.511354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73117be-a3dd-42b4-bbb8-4b33ad8cb2eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:24.512780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73117be-a3dd-42b4-bbb8-4b33ad8cb2eb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:24.519835 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:24.524330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 534/1081] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:51:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:24.530242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d6c6e-3a6a-468f-9501-facb8175a6be None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:24.619755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:24.642303 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d6c6e-3a6a-468f-9501-facb8175a6be None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:24.676211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0a147-3abf-491d-9a5e-75bb50a07ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:24.676840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0a147-3abf-491d-9a5e-75bb50a07ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:24.677114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0a147-3abf-491d-9a5e-75bb50a07ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:24.677382 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0a147-3abf-491d-9a5e-75bb50a07ff6 None admin] PATH_INFO: `/v3/users/6d9f80891931464dbab93553a18ce985` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:24.678505 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0a147-3abf-491d-9a5e-75bb50a07ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=6d9f80891931464dbab93553a18ce985)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:24.679945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0a147-3abf-491d-9a5e-75bb50a07ff6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:24.681528 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 548/1082] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:24 2022] GET /identity/v3/users/6d9f80891931464dbab93553a18ce985 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:24.687809 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73117be-a3dd-42b4-bbb8-4b33ad8cb2eb None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:24.787553 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73117be-a3dd-42b4-bbb8-4b33ad8cb2eb None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:24.821270 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73249293-2e7b-4965-b519-8fa87ab131ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:24.821904 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73249293-2e7b-4965-b519-8fa87ab131ea None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:24.822184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73249293-2e7b-4965-b519-8fa87ab131ea None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:24.822459 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73249293-2e7b-4965-b519-8fa87ab131ea None admin] PATH_INFO: `/v3/projects/6e79921ffc1f4369962c1af8173307c0` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:24.823580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73249293-2e7b-4965-b519-8fa87ab131ea None admin] RBAC: Authorizing `identity:get_project(project_id=6e79921ffc1f4369962c1af8173307c0)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:24.825038 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73249293-2e7b-4965-b519-8fa87ab131ea None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:24.826833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 535/1083] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:51:24 2022] GET /identity/v3/projects/6e79921ffc1f4369962c1af8173307c0 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:24.832689 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0a147-3abf-491d-9a5e-75bb50a07ff6 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:24.931223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0a147-3abf-491d-9a5e-75bb50a07ff6 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:24.966048 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6160e-9384-4e3a-85f9-7866737d2889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:24.966711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6160e-9384-4e3a-85f9-7866737d2889 None admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:24.966993 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6160e-9384-4e3a-85f9-7866737d2889 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:24.967271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6160e-9384-4e3a-85f9-7866737d2889 None admin] PATH_INFO: `/v3/projects/6e79921ffc1f4369962c1af8173307c0/users/6d9f80891931464dbab93553a18ce985/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:24.969315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6160e-9384-4e3a-85f9-7866737d2889 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e79921ffc1f4369962c1af8173307c0, user_id=6d9f80891931464dbab93553a18ce985, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:24.970752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6160e-9384-4e3a-85f9-7866737d2889 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:24.986208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 549/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:51:24 2022] PUT /identity/v3/projects/6e79921ffc1f4369962c1af8173307c0/users/6d9f80891931464dbab93553a18ce985/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:51:26.398871 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788702e-9a44-48aa-b31b-9e77a4c2c22f None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:26.399435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788702e-9a44-48aa-b31b-9e77a4c2c22f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:26.399435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788702e-9a44-48aa-b31b-9e77a4c2c22f None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:26.401170 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 536/1085] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:26.408109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca9ac8-779a-4e6f-b1cb-e372a5916948 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:26.408686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca9ac8-779a-4e6f-b1cb-e372a5916948 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:26.408686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca9ac8-779a-4e6f-b1cb-e372a5916948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:26.428261 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-9eca9ac8-779a-4e6f-b1cb-e372a5916948 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:26.429510 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9eca9ac8-779a-4e6f-b1cb-e372a5916948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:26.431701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:26.498299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 550/1086] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:26.523120 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788702e-9a44-48aa-b31b-9e77a4c2c22f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:26.605333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:26.642107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788702e-9a44-48aa-b31b-9e77a4c2c22f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:26.678463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27218b9-c00e-4276-9943-a062fe780852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:26.679013 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27218b9-c00e-4276-9943-a062fe780852 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:26.679294 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27218b9-c00e-4276-9943-a062fe780852 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:26.679762 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27218b9-c00e-4276-9943-a062fe780852 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:26.691488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27218b9-c00e-4276-9943-a062fe780852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-e27218b9-c00e-4276-9943-a062fe780852 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:26.696437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:26.697576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:26.698893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:26.698893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:26.698893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:26.698893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:26.698893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:26.698893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:26.698893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:26.698893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:26.698893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:26.698893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:26.698893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:51:26.698893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:26.698893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 537/1087] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Aug 7 00:51:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:26.704664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca9ac8-779a-4e6f-b1cb-e372a5916948 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:26.807419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca9ac8-779a-4e6f-b1cb-e372a5916948 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:26.842504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55ad2d-4aea-47cf-a562-1db540c23a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:26.843716 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55ad2d-4aea-47cf-a562-1db540c23a36 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:26.844010 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55ad2d-4aea-47cf-a562-1db540c23a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:26.844283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55ad2d-4aea-47cf-a562-1db540c23a36 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:26.844957 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55ad2d-4aea-47cf-a562-1db540c23a36 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:26.845253 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55ad2d-4aea-47cf-a562-1db540c23a36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:26.846632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55ad2d-4aea-47cf-a562-1db540c23a36 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:26.851936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:26.858390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 551/1088] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Aug 7 00:51:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:26.861017 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27218b9-c00e-4276-9943-a062fe780852 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:26.969988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27218b9-c00e-4276-9943-a062fe780852 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:27.000255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:27.009217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b21cc-6153-49a0-bdca-57ef51949146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:27.009862 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b21cc-6153-49a0-bdca-57ef51949146 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:27.010141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b21cc-6153-49a0-bdca-57ef51949146 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:27.010415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b21cc-6153-49a0-bdca-57ef51949146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:27.013001 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d31c16-635a-4f2d-a215-35284adf604e None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:27.013285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d31c16-635a-4f2d-a215-35284adf604e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:27.013564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d31c16-635a-4f2d-a215-35284adf604e None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:27.015603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 552/1089] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:51:27.021809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fd9fe-2b07-405c-ab35-aa5e675eb2ba None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:27.022094 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fd9fe-2b07-405c-ab35-aa5e675eb2ba None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:27.022372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fd9fe-2b07-405c-ab35-aa5e675eb2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:27.022788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b21cc-6153-49a0-bdca-57ef51949146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:27.024264 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b21cc-6153-49a0-bdca-57ef51949146 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:27.041205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-356fd9fe-2b07-405c-ab35-aa5e675eb2ba None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-c93b21cc-6153-49a0-bdca-57ef51949146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:51:27.041786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:27.042826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:51:27.044171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:51:27.044171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:27.044171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:27.044389 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-356fd9fe-2b07-405c-ab35-aa5e675eb2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:27.044497 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 538/1090] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:27.049350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b21cc-6153-49a0-bdca-57ef51949146 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:27.116535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 553/1091] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:51:27.141512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fd9fe-2b07-405c-ab35-aa5e675eb2ba None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:27.152843 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b21cc-6153-49a0-bdca-57ef51949146 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:27.187774 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c72848-9bfb-422b-a774-53c0b5b8a39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:27.188501 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c72848-9bfb-422b-a774-53c0b5b8a39c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:27.188785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c72848-9bfb-422b-a774-53c0b5b8a39c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:27.189057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c72848-9bfb-422b-a774-53c0b5b8a39c None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:27.189705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c72848-9bfb-422b-a774-53c0b5b8a39c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:27.190010 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c72848-9bfb-422b-a774-53c0b5b8a39c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:27.191375 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c72848-9bfb-422b-a774-53c0b5b8a39c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:27.203826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 539/1092] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:27.209387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c72848-9bfb-422b-a774-53c0b5b8a39c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:27.253797 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fd9fe-2b07-405c-ab35-aa5e675eb2ba None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:27.257030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:27.283311 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:27.289577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7e8d5-2698-4942-bbe4-eed9d9af96f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:27.290214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e8d5-2698-4942-bbe4-eed9d9af96f5 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:27.290496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e8d5-2698-4942-bbe4-eed9d9af96f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:27.290779 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e8d5-2698-4942-bbe4-eed9d9af96f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:27.302134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7e8d5-2698-4942-bbe4-eed9d9af96f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-29d7e8d5-2698-4942-bbe4-eed9d9af96f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:27.306824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:27.307868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:27.309128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:27.309128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:27.309128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:27.309128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:27.309128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:27.309128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:27.309128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:27.309128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:27.309128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:27.309128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:27.309128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:27.309128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:27.309128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 554/1093] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:51:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:51:27.314429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7e8d5-2698-4942-bbe4-eed9d9af96f5 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:27.316703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c72848-9bfb-422b-a774-53c0b5b8a39c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:27.353735 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efc28d-46c0-407f-b2a2-4be42a9b6060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:27.354365 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efc28d-46c0-407f-b2a2-4be42a9b6060 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:27.354643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efc28d-46c0-407f-b2a2-4be42a9b6060 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:27.354910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efc28d-46c0-407f-b2a2-4be42a9b6060 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:27.362636 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efc28d-46c0-407f-b2a2-4be42a9b6060 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:27.364111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efc28d-46c0-407f-b2a2-4be42a9b6060 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-f1efc28d-46c0-407f-b2a2-4be42a9b6060 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:51:27.375980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:27.377208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:27.378792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:27.378792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:27.378792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:51:27.378792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:51:27.378792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:51:27.378792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:51:27.378792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:51:27.378792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:51:27.378792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:51:27.378792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:27.378792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 540/1094] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Aug 7 00:51:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:51:27.382785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efc28d-46c0-407f-b2a2-4be42a9b6060 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:27.418631 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7e8d5-2698-4942-bbe4-eed9d9af96f5 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:27.453532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24a224-e53f-4b56-93f7-88a0967ea86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:27.454140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24a224-e53f-4b56-93f7-88a0967ea86b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:27.454420 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24a224-e53f-4b56-93f7-88a0967ea86b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:27.454694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24a224-e53f-4b56-93f7-88a0967ea86b None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:27.455365 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24a224-e53f-4b56-93f7-88a0967ea86b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:27.455668 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24a224-e53f-4b56-93f7-88a0967ea86b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:27.457103 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24a224-e53f-4b56-93f7-88a0967ea86b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:27.465403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 555/1095] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:51:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:27.472100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24a224-e53f-4b56-93f7-88a0967ea86b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:27.486147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:27.489475 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efc28d-46c0-407f-b2a2-4be42a9b6060 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:27.526263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:27.532846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ffed2-dcb4-43dd-b068-837fae66f05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:27.533477 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ffed2-dcb4-43dd-b068-837fae66f05a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:27.533766 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ffed2-dcb4-43dd-b068-837fae66f05a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:27.534040 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ffed2-dcb4-43dd-b068-837fae66f05a None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:27.534802 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ffed2-dcb4-43dd-b068-837fae66f05a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:27.535108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ffed2-dcb4-43dd-b068-837fae66f05a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:27.536594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ffed2-dcb4-43dd-b068-837fae66f05a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:27.554733 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 541/1096] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Aug 7 00:51:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:27.560446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ffed2-dcb4-43dd-b068-837fae66f05a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:27.576420 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24a224-e53f-4b56-93f7-88a0967ea86b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:27.610796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe418b98-c4f3-4cc2-9178-0747d288bcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:27.611532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe418b98-c4f3-4cc2-9178-0747d288bcce None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:27.611818 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe418b98-c4f3-4cc2-9178-0747d288bcce None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:27.612125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe418b98-c4f3-4cc2-9178-0747d288bcce None admin] PATH_INFO: `/v3/users/6d9f80891931464dbab93553a18ce985` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:27.613307 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe418b98-c4f3-4cc2-9178-0747d288bcce None admin] RBAC: Authorizing `identity:get_user(user_id=6d9f80891931464dbab93553a18ce985)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:27.614785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe418b98-c4f3-4cc2-9178-0747d288bcce None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:27.616441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 556/1097] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:27 2022] GET /identity/v3/users/6d9f80891931464dbab93553a18ce985 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:27.622153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe418b98-c4f3-4cc2-9178-0747d288bcce None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:27.664615 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ffed2-dcb4-43dd-b068-837fae66f05a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:27.704058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb42d41-32fc-4bdd-b9d5-0c6863c1bd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:27.704671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb42d41-32fc-4bdd-b9d5-0c6863c1bd8b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:27.704952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb42d41-32fc-4bdd-b9d5-0c6863c1bd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:27.705222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb42d41-32fc-4bdd-b9d5-0c6863c1bd8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:27.726497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe418b98-c4f3-4cc2-9178-0747d288bcce None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:27.733124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:27.747088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:27.762392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896d50a-6953-413a-934b-ea0df386a298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:27.762999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896d50a-6953-413a-934b-ea0df386a298 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:27.763288 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896d50a-6953-413a-934b-ea0df386a298 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:27.763559 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896d50a-6953-413a-934b-ea0df386a298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:27.778446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb42d41-32fc-4bdd-b9d5-0c6863c1bd8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:27.779834 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb42d41-32fc-4bdd-b9d5-0c6863c1bd8b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:27.832301 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896d50a-6953-413a-934b-ea0df386a298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:27.833755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896d50a-6953-413a-934b-ea0df386a298 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:27.879000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 542/1098] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 00:51:27.885611 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb42d41-32fc-4bdd-b9d5-0c6863c1bd8b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:27.933690 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 557/1099] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:51:27.940043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896d50a-6953-413a-934b-ea0df386a298 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:27.947548 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:27.961569 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:27.993921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb42d41-32fc-4bdd-b9d5-0c6863c1bd8b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:28.031041 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e854bc-0d8b-41a8-bfe7-f89a60fc97c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:28.031596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e854bc-0d8b-41a8-bfe7-f89a60fc97c4 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:28.031870 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e854bc-0d8b-41a8-bfe7-f89a60fc97c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:28.032168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e854bc-0d8b-41a8-bfe7-f89a60fc97c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:28.041431 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896d50a-6953-413a-934b-ea0df386a298 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:28.043221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e854bc-0d8b-41a8-bfe7-f89a60fc97c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:28.044751 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e854bc-0d8b-41a8-bfe7-f89a60fc97c4 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-f5e854bc-0d8b-41a8-bfe7-f89a60fc97c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:51:28.060791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:28.062492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:51:28.063470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:51:28.063470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:28.063470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:28.063470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 543/1100] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:51:28.068567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e854bc-0d8b-41a8-bfe7-f89a60fc97c4 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:28.081891 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360213cf-fea1-4c76-a44f-fadbff510442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:28.082524 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360213cf-fea1-4c76-a44f-fadbff510442 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:28.082806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360213cf-fea1-4c76-a44f-fadbff510442 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:28.083081 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360213cf-fea1-4c76-a44f-fadbff510442 None admin] PATH_INFO: `/v3/projects/6e79921ffc1f4369962c1af8173307c0` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:28.084243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360213cf-fea1-4c76-a44f-fadbff510442 None admin] RBAC: Authorizing `identity:get_project(project_id=6e79921ffc1f4369962c1af8173307c0)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:28.085706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360213cf-fea1-4c76-a44f-fadbff510442 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:28.087648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 558/1101] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:51:27 2022] GET /identity/v3/projects/6e79921ffc1f4369962c1af8173307c0 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:28.093691 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360213cf-fea1-4c76-a44f-fadbff510442 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:28.170463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e854bc-0d8b-41a8-bfe7-f89a60fc97c4 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:28.182132 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:28.184122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:28.197826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360213cf-fea1-4c76-a44f-fadbff510442 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:28.206007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b9120-c28d-4e2f-8e2f-fb6d2dbb1d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:28.206621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b9120-c28d-4e2f-8e2f-fb6d2dbb1d26 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:28.206900 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b9120-c28d-4e2f-8e2f-fb6d2dbb1d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:28.207174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b9120-c28d-4e2f-8e2f-fb6d2dbb1d26 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:28.207816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b9120-c28d-4e2f-8e2f-fb6d2dbb1d26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:28.208147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b9120-c28d-4e2f-8e2f-fb6d2dbb1d26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:28.209508 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b9120-c28d-4e2f-8e2f-fb6d2dbb1d26 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:28.221369 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 544/1102] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:28.227192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b9120-c28d-4e2f-8e2f-fb6d2dbb1d26 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:28.231766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f696e-7867-416a-a88d-8768ded6f6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:28.232407 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f696e-7867-416a-a88d-8768ded6f6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:28.232694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f696e-7867-416a-a88d-8768ded6f6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:28.232987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f696e-7867-416a-a88d-8768ded6f6c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:28.234246 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f696e-7867-416a-a88d-8768ded6f6c7 None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=6e79921ffc1f4369962c1af8173307c0, user.id=6d9f80891931464dbab93553a18ce985) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:28.234719 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f696e-7867-416a-a88d-8768ded6f6c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:28.236524 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f696e-7867-416a-a88d-8768ded6f6c7 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:28.242318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 559/1103] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:51:28 2022] GET /identity/v3/role_assignments?user.id=6d9f80891931464dbab93553a18ce985&scope.project.id=6e79921ffc1f4369962c1af8173307c0&role.id=638e1fc82db44124ae615c46408110a7 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:28.338419 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b9120-c28d-4e2f-8e2f-fb6d2dbb1d26 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:28.375371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622b5b7-0b63-468f-9e69-bb7a9a13ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:28.376051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622b5b7-0b63-468f-9e69-bb7a9a13ad06 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:28.376341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622b5b7-0b63-468f-9e69-bb7a9a13ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:28.376608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622b5b7-0b63-468f-9e69-bb7a9a13ad06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:28.384033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622b5b7-0b63-468f-9e69-bb7a9a13ad06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:28.385513 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622b5b7-0b63-468f-9e69-bb7a9a13ad06 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:28.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-7622b5b7-0b63-468f-9e69-bb7a9a13ad06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:51:28.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:28.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:28.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:28.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:28.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:28.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:28.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:28.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:28.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:28.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:28.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:28.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:51:28.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:51:28.398110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:28.399106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:28.400448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:51:28.400448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:51:28.400448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:51:28.400448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:51:28.400448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:51:28.400448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:51:28.400448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:51:28.400448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:28.400448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 545/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:28.405180 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f696e-7867-416a-a88d-8768ded6f6c7 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:28.512588 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f696e-7867-416a-a88d-8768ded6f6c7 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:28.548814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13e78e-1e73-4e53-b9b8-3451f7734ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:28.549424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13e78e-1e73-4e53-b9b8-3451f7734ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:28.549699 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13e78e-1e73-4e53-b9b8-3451f7734ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:28.549964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13e78e-1e73-4e53-b9b8-3451f7734ef7 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:28.550654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13e78e-1e73-4e53-b9b8-3451f7734ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:28.550954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13e78e-1e73-4e53-b9b8-3451f7734ef7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:28.552418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13e78e-1e73-4e53-b9b8-3451f7734ef7 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:28.566696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 560/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:51:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:28.573078 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622b5b7-0b63-468f-9e69-bb7a9a13ad06 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:28.605911 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:28.680462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622b5b7-0b63-468f-9e69-bb7a9a13ad06 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:28.714377 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc279eaf-2734-4531-adb0-c29286e7cd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:28.714987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc279eaf-2734-4531-adb0-c29286e7cd39 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:28.715265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc279eaf-2734-4531-adb0-c29286e7cd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:28.715539 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc279eaf-2734-4531-adb0-c29286e7cd39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:28.716297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc279eaf-2734-4531-adb0-c29286e7cd39 None admin] RBAC: Adding query filter params (role.id=80c00799fe044866b3fdf89e57748760, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=20b8a995891f46f1ab1672836752cc4e) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:28.716607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc279eaf-2734-4531-adb0-c29286e7cd39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:28.718698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc279eaf-2734-4531-adb0-c29286e7cd39 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:28.725061 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 546/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:51:28 2022] GET /identity/v3/role_assignments?user.id=20b8a995891f46f1ab1672836752cc4e&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=80c00799fe044866b3fdf89e57748760 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:30.355098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df49ba2-45a5-4189-9dc0-258496af9cef None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:30.355687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df49ba2-45a5-4189-9dc0-258496af9cef None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:30.355687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df49ba2-45a5-4189-9dc0-258496af9cef None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:30.357043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 561/1107] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:30.362561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abe407-1381-4a56-811f-47f3e8bb8c0e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:30.363039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abe407-1381-4a56-811f-47f3e8bb8c0e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:30.363158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abe407-1381-4a56-811f-47f3e8bb8c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:30.381074 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-88abe407-1381-4a56-811f-47f3e8bb8c0e None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:30.382284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-88abe407-1381-4a56-811f-47f3e8bb8c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:30.450442 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 547/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:30.479005 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df49ba2-45a5-4189-9dc0-258496af9cef None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:30.494412 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:30.587050 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df49ba2-45a5-4189-9dc0-258496af9cef None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:30.625664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e917a-5cbb-478c-8caf-25d129dddfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:30.626210 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e917a-5cbb-478c-8caf-25d129dddfba None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:30.626484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e917a-5cbb-478c-8caf-25d129dddfba None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:30.626749 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e917a-5cbb-478c-8caf-25d129dddfba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:30.627858 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e917a-5cbb-478c-8caf-25d129dddfba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:30.629318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e917a-5cbb-478c-8caf-25d129dddfba None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:30.630896 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 562/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:30.636960 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abe407-1381-4a56-811f-47f3e8bb8c0e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:30.670860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:30.752237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abe407-1381-4a56-811f-47f3e8bb8c0e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:30.790222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89312c0c-84d1-4f3c-b137-5ea6fb38af58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:30.790828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89312c0c-84d1-4f3c-b137-5ea6fb38af58 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:30.791107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89312c0c-84d1-4f3c-b137-5ea6fb38af58 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:30.791378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89312c0c-84d1-4f3c-b137-5ea6fb38af58 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:30.792050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89312c0c-84d1-4f3c-b137-5ea6fb38af58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:30.793525 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89312c0c-84d1-4f3c-b137-5ea6fb38af58 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:30.815840 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 548/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:51:30 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:51:32.977233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdde8cb-8295-4e91-8ec8-045631b6f370 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:32.977825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdde8cb-8295-4e91-8ec8-045631b6f370 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:32.977825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdde8cb-8295-4e91-8ec8-045631b6f370 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:32.979118 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 563/1111] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:32.987240 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb3e18-d2f0-45ca-824a-f51834e23cb8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:32.987924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb3e18-d2f0-45ca-824a-f51834e23cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:32.987924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb3e18-d2f0-45ca-824a-f51834e23cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:33.006532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1ffb3e18-d2f0-45ca-824a-f51834e23cb8 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:33.007721 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1ffb3e18-d2f0-45ca-824a-f51834e23cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:33.084179 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 549/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:33.112163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdde8cb-8295-4e91-8ec8-045631b6f370 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:33.221382 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:33.244462 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdde8cb-8295-4e91-8ec8-045631b6f370 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:33.282101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798e8fc-2354-4105-b8e3-02c464ab27b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:33.282801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798e8fc-2354-4105-b8e3-02c464ab27b5 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:33.283075 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798e8fc-2354-4105-b8e3-02c464ab27b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:33.283342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798e8fc-2354-4105-b8e3-02c464ab27b5 None admin] PATH_INFO: `/v3/roles/b94b02b271d44f1195f1093a6202a947` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:33.284836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798e8fc-2354-4105-b8e3-02c464ab27b5 None admin] RBAC: Authorizing `identity:get_role(role_id=b94b02b271d44f1195f1093a6202a947)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:33.286368 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798e8fc-2354-4105-b8e3-02c464ab27b5 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:33.287787 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 564/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:33 2022] GET /identity/v3/roles/b94b02b271d44f1195f1093a6202a947 => generated 223 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:33.294032 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb3e18-d2f0-45ca-824a-f51834e23cb8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:33.307305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:33.404750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb3e18-d2f0-45ca-824a-f51834e23cb8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:33.442935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc4d0f-41cb-4092-8ed0-4f3374285bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:33.443574 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc4d0f-41cb-4092-8ed0-4f3374285bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:33.443869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc4d0f-41cb-4092-8ed0-4f3374285bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:33.444207 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc4d0f-41cb-4092-8ed0-4f3374285bf8 None admin] PATH_INFO: `/v3/users/ccdd1f288a3e4218bbf7cc134c514292` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:33.460165 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc4d0f-41cb-4092-8ed0-4f3374285bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=ccdd1f288a3e4218bbf7cc134c514292)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:33.461684 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc4d0f-41cb-4092-8ed0-4f3374285bf8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:33.463503 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 550/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:33 2022] GET /identity/v3/users/ccdd1f288a3e4218bbf7cc134c514292 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:33.470506 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798e8fc-2354-4105-b8e3-02c464ab27b5 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:33.580978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798e8fc-2354-4105-b8e3-02c464ab27b5 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:33.619464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb777bb3-c481-412d-ae4d-7eb22c507100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:33.620100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb777bb3-c481-412d-ae4d-7eb22c507100 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:33.620375 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb777bb3-c481-412d-ae4d-7eb22c507100 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:33.620640 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb777bb3-c481-412d-ae4d-7eb22c507100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:33.641573 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:33.698488 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb777bb3-c481-412d-ae4d-7eb22c507100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:33.699952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb777bb3-c481-412d-ae4d-7eb22c507100 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:33.808099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 565/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:51:33.814470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc4d0f-41cb-4092-8ed0-4f3374285bf8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:33.887631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:33.925136 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc4d0f-41cb-4092-8ed0-4f3374285bf8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:33.963210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33712597-2e11-42a9-9c23-87d502fc847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:33.963876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33712597-2e11-42a9-9c23-87d502fc847a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:33.964242 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33712597-2e11-42a9-9c23-87d502fc847a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:33.964537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33712597-2e11-42a9-9c23-87d502fc847a None admin] PATH_INFO: `/v3/projects/6e79921ffc1f4369962c1af8173307c0` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:33.965860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33712597-2e11-42a9-9c23-87d502fc847a None admin] RBAC: Authorizing `identity:get_project(project_id=6e79921ffc1f4369962c1af8173307c0)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:33.968691 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33712597-2e11-42a9-9c23-87d502fc847a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:33.970579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 551/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:51:33 2022] GET /identity/v3/projects/6e79921ffc1f4369962c1af8173307c0 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:33.978954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb777bb3-c481-412d-ae4d-7eb22c507100 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:34.033026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:34.101415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb777bb3-c481-412d-ae4d-7eb22c507100 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:34.149065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad68a42-5343-49c8-8ae6-476a80d9bdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:34.149735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad68a42-5343-49c8-8ae6-476a80d9bdec None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:34.150038 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad68a42-5343-49c8-8ae6-476a80d9bdec None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:34.150311 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad68a42-5343-49c8-8ae6-476a80d9bdec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:34.151076 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad68a42-5343-49c8-8ae6-476a80d9bdec None admin] RBAC: Adding query filter params (role.id=b94b02b271d44f1195f1093a6202a947, scope.project.id=6e79921ffc1f4369962c1af8173307c0, user.id=ccdd1f288a3e4218bbf7cc134c514292) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:34.151529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad68a42-5343-49c8-8ae6-476a80d9bdec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:34.153412 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad68a42-5343-49c8-8ae6-476a80d9bdec None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:34.161893 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 566/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:51:33 2022] GET /identity/v3/role_assignments?user.id=ccdd1f288a3e4218bbf7cc134c514292&scope.project.id=6e79921ffc1f4369962c1af8173307c0&role.id=b94b02b271d44f1195f1093a6202a947 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:36.365661 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d0f8d-c84c-4ee5-9934-82bbfb1ae657 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:36.366312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d0f8d-c84c-4ee5-9934-82bbfb1ae657 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:36.366312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d0f8d-c84c-4ee5-9934-82bbfb1ae657 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:36.367541 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 552/1118] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:36.372784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c2d5b-b4ed-4565-a5ee-61391625b512 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:36.373199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c2d5b-b4ed-4565-a5ee-61391625b512 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:36.373338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c2d5b-b4ed-4565-a5ee-61391625b512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:36.391810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-575c2d5b-b4ed-4565-a5ee-61391625b512 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:36.393038 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-575c2d5b-b4ed-4565-a5ee-61391625b512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:36.460098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 567/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:36.483934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d0f8d-c84c-4ee5-9934-82bbfb1ae657 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:36.586224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d0f8d-c84c-4ee5-9934-82bbfb1ae657 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:36.620395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe282780-ab29-4b59-bef4-b6c4ecad64f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:36.620946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe282780-ab29-4b59-bef4-b6c4ecad64f2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:36.621225 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe282780-ab29-4b59-bef4-b6c4ecad64f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:36.621495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe282780-ab29-4b59-bef4-b6c4ecad64f2 None admin] PATH_INFO: `/v3/roles/b94b02b271d44f1195f1093a6202a947` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:36.622899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe282780-ab29-4b59-bef4-b6c4ecad64f2 None admin] RBAC: Authorizing `identity:get_role(role_id=b94b02b271d44f1195f1093a6202a947)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:36.624335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe282780-ab29-4b59-bef4-b6c4ecad64f2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:36.625692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 553/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:36 2022] GET /identity/v3/roles/b94b02b271d44f1195f1093a6202a947 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:36.631621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c2d5b-b4ed-4565-a5ee-61391625b512 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:36.678917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:36.738805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c2d5b-b4ed-4565-a5ee-61391625b512 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:36.776955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a31ba3-6db6-4212-9f53-78997c914426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:36.777605 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a31ba3-6db6-4212-9f53-78997c914426 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:36.777886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a31ba3-6db6-4212-9f53-78997c914426 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:36.778158 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a31ba3-6db6-4212-9f53-78997c914426 None admin] PATH_INFO: `/v3/users/ccdd1f288a3e4218bbf7cc134c514292` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:36.779344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a31ba3-6db6-4212-9f53-78997c914426 None admin] RBAC: Authorizing `identity:get_user(user_id=ccdd1f288a3e4218bbf7cc134c514292)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:36.781653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a31ba3-6db6-4212-9f53-78997c914426 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:36.783304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 568/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:36 2022] GET /identity/v3/users/ccdd1f288a3e4218bbf7cc134c514292 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:36.789192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe282780-ab29-4b59-bef4-b6c4ecad64f2 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:36.793026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:36.891666 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe282780-ab29-4b59-bef4-b6c4ecad64f2 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:36.925094 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966c660-0bf9-4153-9326-9fc4c7384b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:36.925723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966c660-0bf9-4153-9326-9fc4c7384b26 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:36.926000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966c660-0bf9-4153-9326-9fc4c7384b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:36.926271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966c660-0bf9-4153-9326-9fc4c7384b26 None admin] PATH_INFO: `/v3/projects/6e79921ffc1f4369962c1af8173307c0` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:36.927375 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966c660-0bf9-4153-9326-9fc4c7384b26 None admin] RBAC: Authorizing `identity:get_project(project_id=6e79921ffc1f4369962c1af8173307c0)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:36.928824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966c660-0bf9-4153-9326-9fc4c7384b26 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:36.930454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 554/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:51:36 2022] GET /identity/v3/projects/6e79921ffc1f4369962c1af8173307c0 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:36.937329 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a31ba3-6db6-4212-9f53-78997c914426 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:37.036669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a31ba3-6db6-4212-9f53-78997c914426 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:37.048285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:37.072355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f3c46-1073-464b-a214-562522a487c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:37.073015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f3c46-1073-464b-a214-562522a487c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:37.073291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f3c46-1073-464b-a214-562522a487c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:37.073563 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f3c46-1073-464b-a214-562522a487c6 None admin] PATH_INFO: `/v3/projects/6e79921ffc1f4369962c1af8173307c0/users/ccdd1f288a3e4218bbf7cc134c514292/roles/b94b02b271d44f1195f1093a6202a947` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:37.075707 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f3c46-1073-464b-a214-562522a487c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e79921ffc1f4369962c1af8173307c0, user_id=ccdd1f288a3e4218bbf7cc134c514292, role_id=b94b02b271d44f1195f1093a6202a947)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:37.077239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f3c46-1073-464b-a214-562522a487c6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:37.089858 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 569/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:51:36 2022] PUT /identity/v3/projects/6e79921ffc1f4369962c1af8173307c0/users/ccdd1f288a3e4218bbf7cc134c514292/roles/b94b02b271d44f1195f1093a6202a947 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:51:39.170570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345db1f-63e6-402b-8e7b-fdf1f4fec8ad None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:39.171126 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345db1f-63e6-402b-8e7b-fdf1f4fec8ad None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:39.171126 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345db1f-63e6-402b-8e7b-fdf1f4fec8ad None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:39.173210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 555/1124] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:39.179423 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a3602-0905-46a6-a055-fa47c09b4763 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:39.180099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a3602-0905-46a6-a055-fa47c09b4763 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:39.180099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a3602-0905-46a6-a055-fa47c09b4763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:39.199971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-365a3602-0905-46a6-a055-fa47c09b4763 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:39.201329 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-365a3602-0905-46a6-a055-fa47c09b4763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:39.279695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 570/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:39.308589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345db1f-63e6-402b-8e7b-fdf1f4fec8ad None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:39.425514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:39.459161 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345db1f-63e6-402b-8e7b-fdf1f4fec8ad None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:39.495665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3693fa9-e2e1-4364-b1c7-eb4daf78044a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:39.496334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3693fa9-e2e1-4364-b1c7-eb4daf78044a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:39.496620 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3693fa9-e2e1-4364-b1c7-eb4daf78044a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:39.496891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3693fa9-e2e1-4364-b1c7-eb4daf78044a None admin] PATH_INFO: `/v3/roles/b94b02b271d44f1195f1093a6202a947` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:39.498286 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3693fa9-e2e1-4364-b1c7-eb4daf78044a None admin] RBAC: Authorizing `identity:get_role(role_id=b94b02b271d44f1195f1093a6202a947)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:39.500300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3693fa9-e2e1-4364-b1c7-eb4daf78044a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:39.501638 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 556/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:39 2022] GET /identity/v3/roles/b94b02b271d44f1195f1093a6202a947 => generated 223 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:39.507866 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a3602-0905-46a6-a055-fa47c09b4763 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:39.610672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:39.613701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a3602-0905-46a6-a055-fa47c09b4763 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:39.651821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cafab1-269e-40a1-bfb7-ac932fc45bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:39.652578 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cafab1-269e-40a1-bfb7-ac932fc45bcc None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:39.652946 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cafab1-269e-40a1-bfb7-ac932fc45bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:39.653268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cafab1-269e-40a1-bfb7-ac932fc45bcc None admin] PATH_INFO: `/v3/users/ccdd1f288a3e4218bbf7cc134c514292` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:39.654447 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cafab1-269e-40a1-bfb7-ac932fc45bcc None admin] RBAC: Authorizing `identity:get_user(user_id=ccdd1f288a3e4218bbf7cc134c514292)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:39.656630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cafab1-269e-40a1-bfb7-ac932fc45bcc None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:39.658230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 571/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:39 2022] GET /identity/v3/users/ccdd1f288a3e4218bbf7cc134c514292 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:39.664990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3693fa9-e2e1-4364-b1c7-eb4daf78044a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:39.776552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3693fa9-e2e1-4364-b1c7-eb4daf78044a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:39.816450 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b727e-4ec2-48a0-8187-51645471a922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:39.817479 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b727e-4ec2-48a0-8187-51645471a922 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:39.817871 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b727e-4ec2-48a0-8187-51645471a922 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:39.818344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b727e-4ec2-48a0-8187-51645471a922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:39.831181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:39.894701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b727e-4ec2-48a0-8187-51645471a922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:39.896206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b727e-4ec2-48a0-8187-51645471a922 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:40.012668 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 557/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:51:40.020438 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cafab1-269e-40a1-bfb7-ac932fc45bcc None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:40.147821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cafab1-269e-40a1-bfb7-ac932fc45bcc None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:40.187698 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edc88a-1c0f-41c4-8e2d-81185206cd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:40.188625 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edc88a-1c0f-41c4-8e2d-81185206cd0d None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:40.188746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edc88a-1c0f-41c4-8e2d-81185206cd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:40.190492 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edc88a-1c0f-41c4-8e2d-81185206cd0d None admin] PATH_INFO: `/v3/projects/6e79921ffc1f4369962c1af8173307c0` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:40.197104 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edc88a-1c0f-41c4-8e2d-81185206cd0d None admin] RBAC: Authorizing `identity:get_project(project_id=6e79921ffc1f4369962c1af8173307c0)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:40.198603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edc88a-1c0f-41c4-8e2d-81185206cd0d None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:40.200545 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 572/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:51:40 2022] GET /identity/v3/projects/6e79921ffc1f4369962c1af8173307c0 => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:40.210304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b727e-4ec2-48a0-8187-51645471a922 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:40.265924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:40.338128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b727e-4ec2-48a0-8187-51645471a922 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:40.377316 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7dd03-4742-4f1c-825f-5d654072eda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:40.378033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7dd03-4742-4f1c-825f-5d654072eda6 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:40.378354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7dd03-4742-4f1c-825f-5d654072eda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:40.378667 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7dd03-4742-4f1c-825f-5d654072eda6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:40.379607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7dd03-4742-4f1c-825f-5d654072eda6 None admin] RBAC: Adding query filter params (role.id=b94b02b271d44f1195f1093a6202a947, scope.project.id=6e79921ffc1f4369962c1af8173307c0, user.id=ccdd1f288a3e4218bbf7cc134c514292) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:40.379945 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7dd03-4742-4f1c-825f-5d654072eda6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:40.381871 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7dd03-4742-4f1c-825f-5d654072eda6 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:40.390648 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 558/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:51:40 2022] GET /identity/v3/role_assignments?user.id=ccdd1f288a3e4218bbf7cc134c514292&scope.project.id=6e79921ffc1f4369962c1af8173307c0&role.id=b94b02b271d44f1195f1093a6202a947 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:42.519268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ecf30-fc4d-4125-a4fb-57007f8ba8b7 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:42.519843 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ecf30-fc4d-4125-a4fb-57007f8ba8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:42.519843 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ecf30-fc4d-4125-a4fb-57007f8ba8b7 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:42.521189 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 573/1131] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:42.526654 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76cc86-4379-4c4a-a2b8-c74dd48e108d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:42.527108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76cc86-4379-4c4a-a2b8-c74dd48e108d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:42.527222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76cc86-4379-4c4a-a2b8-c74dd48e108d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:42.545879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2c76cc86-4379-4c4a-a2b8-c74dd48e108d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:42.547042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2c76cc86-4379-4c4a-a2b8-c74dd48e108d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:42.612060 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 559/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:42.635767 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ecf30-fc4d-4125-a4fb-57007f8ba8b7 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:42.672239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:42.737586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ecf30-fc4d-4125-a4fb-57007f8ba8b7 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:42.770942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883fb8d-7741-4547-9bbc-c56acb491b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:42.771498 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883fb8d-7741-4547-9bbc-c56acb491b56 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:42.771777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883fb8d-7741-4547-9bbc-c56acb491b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:42.772079 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883fb8d-7741-4547-9bbc-c56acb491b56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:42.773194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883fb8d-7741-4547-9bbc-c56acb491b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:42.774624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883fb8d-7741-4547-9bbc-c56acb491b56 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:42.776306 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 574/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:42.783599 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76cc86-4379-4c4a-a2b8-c74dd48e108d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:42.817968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:42.883101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76cc86-4379-4c4a-a2b8-c74dd48e108d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:42.918306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192f180-baef-480b-a1a1-ee99f5e31aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:42.918947 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f180-baef-480b-a1a1-ee99f5e31aa3 None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:42.919304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f180-baef-480b-a1a1-ee99f5e31aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:42.919577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f180-baef-480b-a1a1-ee99f5e31aa3 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:42.920935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192f180-baef-480b-a1a1-ee99f5e31aa3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:42.922525 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192f180-baef-480b-a1a1-ee99f5e31aa3 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:42.948205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 560/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Aug 7 00:51:42 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:51:45.039198 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406e232-86ef-4cc8-9379-e83c914523a2 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:45.039755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406e232-86ef-4cc8-9379-e83c914523a2 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:45.039755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406e232-86ef-4cc8-9379-e83c914523a2 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:45.041100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 575/1135] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:45.047081 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e143d-9d0b-45ed-b1a9-5070da6e1b2d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:45.047496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e143d-9d0b-45ed-b1a9-5070da6e1b2d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:45.047628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e143d-9d0b-45ed-b1a9-5070da6e1b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:45.065588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a51e143d-9d0b-45ed-b1a9-5070da6e1b2d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:45.066770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a51e143d-9d0b-45ed-b1a9-5070da6e1b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:45.135028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 561/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:45.165576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406e232-86ef-4cc8-9379-e83c914523a2 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:45.270619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406e232-86ef-4cc8-9379-e83c914523a2 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:45.272957 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:45.305463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106cfcb-c974-4ba7-b6e9-815966b159bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:45.306003 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106cfcb-c974-4ba7-b6e9-815966b159bf None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:45.306281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106cfcb-c974-4ba7-b6e9-815966b159bf None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:45.306550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106cfcb-c974-4ba7-b6e9-815966b159bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:45.307673 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106cfcb-c974-4ba7-b6e9-815966b159bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:45.309137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106cfcb-c974-4ba7-b6e9-815966b159bf None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:45.310901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 576/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:45.316597 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e143d-9d0b-45ed-b1a9-5070da6e1b2d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:45.334311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:45.417224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e143d-9d0b-45ed-b1a9-5070da6e1b2d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:45.449950 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1d6f8-f3e0-49c3-bc40-5661ef5657ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:45.450557 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1d6f8-f3e0-49c3-bc40-5661ef5657ce None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:45.450837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1d6f8-f3e0-49c3-bc40-5661ef5657ce None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:45.451593 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1d6f8-f3e0-49c3-bc40-5661ef5657ce None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:45.452269 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1d6f8-f3e0-49c3-bc40-5661ef5657ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:45.453688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1d6f8-f3e0-49c3-bc40-5661ef5657ce None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:45.475558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 562/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:51:45 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:51:47.578243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd231-b7ba-4a8d-8b92-1ed4c8b106fe None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:47.578813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd231-b7ba-4a8d-8b92-1ed4c8b106fe None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:47.578813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd231-b7ba-4a8d-8b92-1ed4c8b106fe None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:47.580165 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 577/1139] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:47.585389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b92b8-9512-4447-9cbd-926f0281671c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:47.585805 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b92b8-9512-4447-9cbd-926f0281671c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:47.585945 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b92b8-9512-4447-9cbd-926f0281671c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:47.603624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-768b92b8-9512-4447-9cbd-926f0281671c None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:47.604852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-768b92b8-9512-4447-9cbd-926f0281671c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:47.673825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 563/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:47.697829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdd231-b7ba-4a8d-8b92-1ed4c8b106fe None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:47.799603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdd231-b7ba-4a8d-8b92-1ed4c8b106fe None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:47.834257 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d030b5-fc57-42f7-9d50-b218d7908cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:47.834807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d030b5-fc57-42f7-9d50-b218d7908cdb None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:47.835087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d030b5-fc57-42f7-9d50-b218d7908cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:47.835358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d030b5-fc57-42f7-9d50-b218d7908cdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:47.846039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d030b5-fc57-42f7-9d50-b218d7908cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-75d030b5-fc57-42f7-9d50-b218d7908cdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:47.850636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:47.851816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:47.853156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:47.853156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:47.853156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:47.853156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:47.853156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:47.853156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:47.853156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:47.853156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:47.853156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:47.853156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:47.853156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:47.853156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:47.853156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 578/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:51:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:47.858273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b92b8-9512-4447-9cbd-926f0281671c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:47.860500 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:47.960459 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b92b8-9512-4447-9cbd-926f0281671c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:47.994048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e27008-7103-436f-a83d-d070ec990f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:47.994652 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e27008-7103-436f-a83d-d070ec990f7c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:47.994929 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e27008-7103-436f-a83d-d070ec990f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:47.995196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e27008-7103-436f-a83d-d070ec990f7c None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:47.995854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e27008-7103-436f-a83d-d070ec990f7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:47.996180 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e27008-7103-436f-a83d-d070ec990f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:47.997534 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e27008-7103-436f-a83d-d070ec990f7c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:48.006424 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 564/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:51:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:48.012316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d030b5-fc57-42f7-9d50-b218d7908cdb None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:48.046235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:48.119270 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d030b5-fc57-42f7-9d50-b218d7908cdb None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:48.152669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1aa5d9-fafe-43d6-9501-f6cbd9a5751a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:48.153286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1aa5d9-fafe-43d6-9501-f6cbd9a5751a None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:48.153559 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1aa5d9-fafe-43d6-9501-f6cbd9a5751a None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:48.153827 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1aa5d9-fafe-43d6-9501-f6cbd9a5751a None admin] PATH_INFO: `/v3/users/912cfb1d695c40d389009eed119c085a` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:48.168311 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1aa5d9-fafe-43d6-9501-f6cbd9a5751a None admin] RBAC: Authorizing `identity:get_user(user_id=912cfb1d695c40d389009eed119c085a)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:48.170076 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1aa5d9-fafe-43d6-9501-f6cbd9a5751a None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:48.172081 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 579/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:48 2022] GET /identity/v3/users/912cfb1d695c40d389009eed119c085a => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:48.177765 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e27008-7103-436f-a83d-d070ec990f7c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:48.242458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:48.280984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e27008-7103-436f-a83d-d070ec990f7c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:48.314013 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24729c7-a069-4a46-afe3-51a6c4fd7ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:48.314618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24729c7-a069-4a46-afe3-51a6c4fd7ecc None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:48.314901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24729c7-a069-4a46-afe3-51a6c4fd7ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:48.315173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24729c7-a069-4a46-afe3-51a6c4fd7ecc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:48.382899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24729c7-a069-4a46-afe3-51a6c4fd7ecc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:48.384289 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24729c7-a069-4a46-afe3-51a6c4fd7ecc None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:48.444690 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:48.483660 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 565/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:51:48.489656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1aa5d9-fafe-43d6-9501-f6cbd9a5751a None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:48.582274 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:48.593654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1aa5d9-fafe-43d6-9501-f6cbd9a5751a None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:48.627320 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5304460-9a09-4424-9ffc-883df6dee3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:48.627964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5304460-9a09-4424-9ffc-883df6dee3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:48.628361 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5304460-9a09-4424-9ffc-883df6dee3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:48.628634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5304460-9a09-4424-9ffc-883df6dee3b0 None admin] PATH_INFO: `/v3/projects/05267a69f37c4a2c84385f8942a9112b` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:48.629740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5304460-9a09-4424-9ffc-883df6dee3b0 None admin] RBAC: Authorizing `identity:get_project(project_id=05267a69f37c4a2c84385f8942a9112b)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:48.631172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5304460-9a09-4424-9ffc-883df6dee3b0 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:48.632824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 580/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:51:48 2022] GET /identity/v3/projects/05267a69f37c4a2c84385f8942a9112b => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:48.639181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24729c7-a069-4a46-afe3-51a6c4fd7ecc None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:48.741217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24729c7-a069-4a46-afe3-51a6c4fd7ecc None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:48.777250 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc712711-fcbe-4e1e-a6fc-f562b9354546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:48.777860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc712711-fcbe-4e1e-a6fc-f562b9354546 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:48.778140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc712711-fcbe-4e1e-a6fc-f562b9354546 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:48.778411 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc712711-fcbe-4e1e-a6fc-f562b9354546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:48.779630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc712711-fcbe-4e1e-a6fc-f562b9354546 None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=05267a69f37c4a2c84385f8942a9112b, user.id=912cfb1d695c40d389009eed119c085a) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:48.780487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc712711-fcbe-4e1e-a6fc-f562b9354546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:48.781928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc712711-fcbe-4e1e-a6fc-f562b9354546 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:48.787286 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 566/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:51:48 2022] GET /identity/v3/role_assignments?user.id=912cfb1d695c40d389009eed119c085a&scope.project.id=05267a69f37c4a2c84385f8942a9112b&role.id=638e1fc82db44124ae615c46408110a7 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:50.773903 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef0d55-ec21-45aa-8956-d8f8a9cbca5d None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:50.774449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef0d55-ec21-45aa-8956-d8f8a9cbca5d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:50.774449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef0d55-ec21-45aa-8956-d8f8a9cbca5d None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:50.775774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 581/1147] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:50.781518 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67d0c8-bdc1-47d7-9981-7a0fd7368bf5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:50.781920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67d0c8-bdc1-47d7-9981-7a0fd7368bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:50.782071 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67d0c8-bdc1-47d7-9981-7a0fd7368bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:50.800168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2f67d0c8-bdc1-47d7-9981-7a0fd7368bf5 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:50.801358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2f67d0c8-bdc1-47d7-9981-7a0fd7368bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:50.824551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:50.868695 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 567/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:50.891422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef0d55-ec21-45aa-8956-d8f8a9cbca5d None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:50.990617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef0d55-ec21-45aa-8956-d8f8a9cbca5d None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:51.025063 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82145ce-fef8-40ad-8a25-6e2401f344fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:51.025682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82145ce-fef8-40ad-8a25-6e2401f344fc None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:51.025962 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82145ce-fef8-40ad-8a25-6e2401f344fc None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:51.026229 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82145ce-fef8-40ad-8a25-6e2401f344fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:51.036088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82145ce-fef8-40ad-8a25-6e2401f344fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-a82145ce-fef8-40ad-8a25-6e2401f344fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:51.040874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:51.041812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:51.042770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:51.042770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:51.042770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:51.042770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:51.042770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:51.042770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:51.042770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:51.042770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:51.042770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:51.042770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:51.042770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:51.042770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:51.042770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 582/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:51:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:51.048396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67d0c8-bdc1-47d7-9981-7a0fd7368bf5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:51.145997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67d0c8-bdc1-47d7-9981-7a0fd7368bf5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:51.179953 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a46d8-ba1a-4f33-a937-6ae349377af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:51.180555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a46d8-ba1a-4f33-a937-6ae349377af1 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:51.180829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a46d8-ba1a-4f33-a937-6ae349377af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:51.181096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a46d8-ba1a-4f33-a937-6ae349377af1 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:51.181754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a46d8-ba1a-4f33-a937-6ae349377af1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:51.182050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a46d8-ba1a-4f33-a937-6ae349377af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:51.183395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a46d8-ba1a-4f33-a937-6ae349377af1 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:51.191503 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 568/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:51.197457 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82145ce-fef8-40ad-8a25-6e2401f344fc None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:51.218390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:51.301626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82145ce-fef8-40ad-8a25-6e2401f344fc None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:51.334137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee10f8-8d55-421b-b7d8-94563691f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:51.334757 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee10f8-8d55-421b-b7d8-94563691f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:51.335029 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee10f8-8d55-421b-b7d8-94563691f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:51.335294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee10f8-8d55-421b-b7d8-94563691f6f0 None admin] PATH_INFO: `/v3/users/912cfb1d695c40d389009eed119c085a` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:51.336424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee10f8-8d55-421b-b7d8-94563691f6f0 None admin] RBAC: Authorizing `identity:get_user(user_id=912cfb1d695c40d389009eed119c085a)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:51.337853 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee10f8-8d55-421b-b7d8-94563691f6f0 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:51.339427 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 583/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:51 2022] GET /identity/v3/users/912cfb1d695c40d389009eed119c085a => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:51.346081 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a46d8-ba1a-4f33-a937-6ae349377af1 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:51.367911 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:51.444697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a46d8-ba1a-4f33-a937-6ae349377af1 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:51.477835 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35337f3f-aea8-4e4f-a034-00a6dc862dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:51.478468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35337f3f-aea8-4e4f-a034-00a6dc862dbb None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:51.478750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35337f3f-aea8-4e4f-a034-00a6dc862dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:51.479022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35337f3f-aea8-4e4f-a034-00a6dc862dbb None admin] PATH_INFO: `/v3/projects/05267a69f37c4a2c84385f8942a9112b` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:51.480153 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35337f3f-aea8-4e4f-a034-00a6dc862dbb None admin] RBAC: Authorizing `identity:get_project(project_id=05267a69f37c4a2c84385f8942a9112b)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:51.481571 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35337f3f-aea8-4e4f-a034-00a6dc862dbb None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:51.483248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 569/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:51:51 2022] GET /identity/v3/projects/05267a69f37c4a2c84385f8942a9112b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:51.489283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee10f8-8d55-421b-b7d8-94563691f6f0 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:51.573808 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:51.589199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee10f8-8d55-421b-b7d8-94563691f6f0 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:51.622290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f98076-0e8a-4b07-91fc-c5c51d60ccaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:51.623486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f98076-0e8a-4b07-91fc-c5c51d60ccaf None admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:51.623756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f98076-0e8a-4b07-91fc-c5c51d60ccaf None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:51.624047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f98076-0e8a-4b07-91fc-c5c51d60ccaf None admin] PATH_INFO: `/v3/projects/05267a69f37c4a2c84385f8942a9112b/users/912cfb1d695c40d389009eed119c085a/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:51.625939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f98076-0e8a-4b07-91fc-c5c51d60ccaf None admin] RBAC: Authorizing `identity:create_grant(project_id=05267a69f37c4a2c84385f8942a9112b, user_id=912cfb1d695c40d389009eed119c085a, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:51.627363 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f98076-0e8a-4b07-91fc-c5c51d60ccaf None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:51.640947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 584/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:51:51 2022] PUT /identity/v3/projects/05267a69f37c4a2c84385f8942a9112b/users/912cfb1d695c40d389009eed119c085a/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:51:53.682204 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a2f04-7398-49a6-b2e2-d24c93dd595a None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:53.682740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a2f04-7398-49a6-b2e2-d24c93dd595a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:53.682828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a2f04-7398-49a6-b2e2-d24c93dd595a None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:53.684170 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 570/1154] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:53.689925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3313ee-90ea-4fd5-87ca-a9bebbadc82a None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:53.690448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3313ee-90ea-4fd5-87ca-a9bebbadc82a None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:53.690448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3313ee-90ea-4fd5-87ca-a9bebbadc82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:53.709576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-2c3313ee-90ea-4fd5-87ca-a9bebbadc82a None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:53.710787 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2c3313ee-90ea-4fd5-87ca-a9bebbadc82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:53.782437 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 585/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:53.805485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a2f04-7398-49a6-b2e2-d24c93dd595a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:53.896665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:53.909817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a2f04-7398-49a6-b2e2-d24c93dd595a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:53.943604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89976c17-6604-49e1-8c86-7b8dd4dc4d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:53.944267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89976c17-6604-49e1-8c86-7b8dd4dc4d88 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:53.944548 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89976c17-6604-49e1-8c86-7b8dd4dc4d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:53.944818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89976c17-6604-49e1-8c86-7b8dd4dc4d88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:53.955499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89976c17-6604-49e1-8c86-7b8dd4dc4d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-89976c17-6604-49e1-8c86-7b8dd4dc4d88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:53.960198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:53.961328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:53.962530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:53.962530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:53.962530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:53.962530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:53.962530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:53.962530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:53.962530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:53.962530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:53.962530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:53.962530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:53.962530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:53.962530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:51:53.962530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 571/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:51:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:53.967757 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3313ee-90ea-4fd5-87ca-a9bebbadc82a None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:54.042568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:54.066448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3313ee-90ea-4fd5-87ca-a9bebbadc82a None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:54.100012 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d51d-a9bf-412c-b374-fdea0d108c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:54.100616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d51d-a9bf-412c-b374-fdea0d108c74 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:54.100890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d51d-a9bf-412c-b374-fdea0d108c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:54.101157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d51d-a9bf-412c-b374-fdea0d108c74 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:54.101816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178d51d-a9bf-412c-b374-fdea0d108c74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:54.102114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178d51d-a9bf-412c-b374-fdea0d108c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:54.103478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178d51d-a9bf-412c-b374-fdea0d108c74 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:54.111801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 586/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:51:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:54.117772 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89976c17-6604-49e1-8c86-7b8dd4dc4d88 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:54.219461 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89976c17-6604-49e1-8c86-7b8dd4dc4d88 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:54.254481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542cf5f-566b-43a8-8bb5-9013a0b84277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:54.255118 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542cf5f-566b-43a8-8bb5-9013a0b84277 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:54.255400 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542cf5f-566b-43a8-8bb5-9013a0b84277 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:54.255676 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542cf5f-566b-43a8-8bb5-9013a0b84277 None admin] PATH_INFO: `/v3/users/912cfb1d695c40d389009eed119c085a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:54.256833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542cf5f-566b-43a8-8bb5-9013a0b84277 None admin] RBAC: Authorizing `identity:get_user(user_id=912cfb1d695c40d389009eed119c085a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:54.258260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542cf5f-566b-43a8-8bb5-9013a0b84277 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:54.259846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 572/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:54 2022] GET /identity/v3/users/912cfb1d695c40d389009eed119c085a => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:54.265744 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d51d-a9bf-412c-b374-fdea0d108c74 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:54.365690 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d51d-a9bf-412c-b374-fdea0d108c74 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:54.399556 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ff6c4-0b64-4519-9ad6-3f690b9870dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:54.400193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ff6c4-0b64-4519-9ad6-3f690b9870dc None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:54.400476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ff6c4-0b64-4519-9ad6-3f690b9870dc None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:54.400749 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ff6c4-0b64-4519-9ad6-3f690b9870dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:54.409490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:54.468373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ff6c4-0b64-4519-9ad6-3f690b9870dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:54.469874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ff6c4-0b64-4519-9ad6-3f690b9870dc None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:54.569384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 587/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:51:54.575486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542cf5f-566b-43a8-8bb5-9013a0b84277 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:54.594402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:54.675988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542cf5f-566b-43a8-8bb5-9013a0b84277 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:54.708932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf93ed-7cff-43cf-865d-67e28afe6096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:54.709594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf93ed-7cff-43cf-865d-67e28afe6096 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:54.709827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf93ed-7cff-43cf-865d-67e28afe6096 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:54.710100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf93ed-7cff-43cf-865d-67e28afe6096 None admin] PATH_INFO: `/v3/projects/05267a69f37c4a2c84385f8942a9112b` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:54.711218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf93ed-7cff-43cf-865d-67e28afe6096 None admin] RBAC: Authorizing `identity:get_project(project_id=05267a69f37c4a2c84385f8942a9112b)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:54.712755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf93ed-7cff-43cf-865d-67e28afe6096 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:54.714411 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 573/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:51:54 2022] GET /identity/v3/projects/05267a69f37c4a2c84385f8942a9112b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:54.721766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ff6c4-0b64-4519-9ad6-3f690b9870dc None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:54.762982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:54.826844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ff6c4-0b64-4519-9ad6-3f690b9870dc None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:54.861405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc032a-e2f1-44f7-aa4b-1f885b7b88aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:54.862001 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc032a-e2f1-44f7-aa4b-1f885b7b88aa None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:54.862278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc032a-e2f1-44f7-aa4b-1f885b7b88aa None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:54.862547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc032a-e2f1-44f7-aa4b-1f885b7b88aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:54.863271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc032a-e2f1-44f7-aa4b-1f885b7b88aa None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=05267a69f37c4a2c84385f8942a9112b, user.id=912cfb1d695c40d389009eed119c085a) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:54.863573 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc032a-e2f1-44f7-aa4b-1f885b7b88aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:54.865025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc032a-e2f1-44f7-aa4b-1f885b7b88aa None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:54.870636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 588/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:51:54 2022] GET /identity/v3/role_assignments?user.id=912cfb1d695c40d389009eed119c085a&scope.project.id=05267a69f37c4a2c84385f8942a9112b&role.id=638e1fc82db44124ae615c46408110a7 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:56.921464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557af06-79fc-4fac-a1eb-1851f0a4e6eb None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:56.921982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557af06-79fc-4fac-a1eb-1851f0a4e6eb None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:56.921982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557af06-79fc-4fac-a1eb-1851f0a4e6eb None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:56.923299 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 574/1162] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:56.928614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91152793-6f43-4dc2-9cc4-e559fa1a2aed None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:56.928994 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91152793-6f43-4dc2-9cc4-e559fa1a2aed None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:56.929168 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91152793-6f43-4dc2-9cc4-e559fa1a2aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:56.947384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-91152793-6f43-4dc2-9cc4-e559fa1a2aed None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:56.948617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-91152793-6f43-4dc2-9cc4-e559fa1a2aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:57.020317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 589/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:57.043284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557af06-79fc-4fac-a1eb-1851f0a4e6eb None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:57.136722 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:57.155628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557af06-79fc-4fac-a1eb-1851f0a4e6eb None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:57.192376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e834c96-113d-4416-ae7b-713dac7b345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:57.192903 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e834c96-113d-4416-ae7b-713dac7b345a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:57.193185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e834c96-113d-4416-ae7b-713dac7b345a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:57.193458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e834c96-113d-4416-ae7b-713dac7b345a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:57.265191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e834c96-113d-4416-ae7b-713dac7b345a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:57.266698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e834c96-113d-4416-ae7b-713dac7b345a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:57.350624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:57.367840 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 575/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:51:57.375590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91152793-6f43-4dc2-9cc4-e559fa1a2aed None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:57.408272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:57.476332 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91152793-6f43-4dc2-9cc4-e559fa1a2aed None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:57.518497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bcbfd-cb9b-4c30-8432-9a491cb7c1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:57.519209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bcbfd-cb9b-4c30-8432-9a491cb7c1ca None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:57.519488 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bcbfd-cb9b-4c30-8432-9a491cb7c1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:57.519806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bcbfd-cb9b-4c30-8432-9a491cb7c1ca None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:57.527923 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bcbfd-cb9b-4c30-8432-9a491cb7c1ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:57.529566 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bcbfd-cb9b-4c30-8432-9a491cb7c1ca None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-cf7bcbfd-cb9b-4c30-8432-9a491cb7c1ca None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:57.540919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:57.542161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:57.543054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:57.543054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:57.543054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:57.543054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:57.543054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:57.543054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:57.543054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:57.543054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:57.543054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:57.543054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:57.543054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 00:51:57.543054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:51:57.543054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 00:51:57.543054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:51:57.543054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 590/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Aug 7 00:51:57 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:57.548934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e834c96-113d-4416-ae7b-713dac7b345a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:57.649195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e834c96-113d-4416-ae7b-713dac7b345a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:57.683492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1d802-d6a7-4053-9fdc-0f07e76ba342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:57.684128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1d802-d6a7-4053-9fdc-0f07e76ba342 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:57.684412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1d802-d6a7-4053-9fdc-0f07e76ba342 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:57.684686 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1d802-d6a7-4053-9fdc-0f07e76ba342 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:57.685920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1d802-d6a7-4053-9fdc-0f07e76ba342 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:57.686224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1d802-d6a7-4053-9fdc-0f07e76ba342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:57.687602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1d802-d6a7-4053-9fdc-0f07e76ba342 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:57.695063 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 576/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Aug 7 00:51:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:59.749370 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2b5fc-f8a2-46c7-a3c9-8822468ef2d4 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:59.749895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2b5fc-f8a2-46c7-a3c9-8822468ef2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:59.749895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2b5fc-f8a2-46c7-a3c9-8822468ef2d4 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:59.751279 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 591/1167] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:59.756499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24518a24-290e-4162-a40e-776248063caa None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:59.756918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24518a24-290e-4162-a40e-776248063caa None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:59.757031 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24518a24-290e-4162-a40e-776248063caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:59.775504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-24518a24-290e-4162-a40e-776248063caa None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:59.776711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-24518a24-290e-4162-a40e-776248063caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:59.823799 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:59.847099 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 577/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:51:59.870483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2b5fc-f8a2-46c7-a3c9-8822468ef2d4 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:59.979666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:59.992915 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2b5fc-f8a2-46c7-a3c9-8822468ef2d4 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:00.030156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d6004-00a3-4821-976b-4524ed219ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:00.030752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d6004-00a3-4821-976b-4524ed219ece None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:00.031035 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d6004-00a3-4821-976b-4524ed219ece None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:00.031310 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d6004-00a3-4821-976b-4524ed219ece None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:00.032001 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d6004-00a3-4821-976b-4524ed219ece None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:00.033375 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d6004-00a3-4821-976b-4524ed219ece None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:00.050542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 592/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Sun Aug 7 00:51:59 2022] POST /identity/v3/domains => generated 267 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:52:02.088275 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86309ee4-8469-4d17-a8d6-c4de13d22a91 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:02.088813 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86309ee4-8469-4d17-a8d6-c4de13d22a91 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:02.088936 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86309ee4-8469-4d17-a8d6-c4de13d22a91 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:02.090374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 578/1170] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:02.096097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe307216-0e03-44f5-9ef5-3e3afcf4b7a5 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:02.096502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe307216-0e03-44f5-9ef5-3e3afcf4b7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:02.096653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe307216-0e03-44f5-9ef5-3e3afcf4b7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:02.114376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-fe307216-0e03-44f5-9ef5-3e3afcf4b7a5 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:02.115562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-fe307216-0e03-44f5-9ef5-3e3afcf4b7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:02.183880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 593/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:52:02.206861 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86309ee4-8469-4d17-a8d6-c4de13d22a91 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:02.308438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86309ee4-8469-4d17-a8d6-c4de13d22a91 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:02.342681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c9d99-ef1b-41d4-b75e-73e2087fc316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:02.343234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c9d99-ef1b-41d4-b75e-73e2087fc316 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:02.343509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c9d99-ef1b-41d4-b75e-73e2087fc316 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:02.343780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c9d99-ef1b-41d4-b75e-73e2087fc316 None admin] PATH_INFO: `/v3/domains/54a483ce5e6f471e98a9039b2737343f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:02.353803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c9d99-ef1b-41d4-b75e-73e2087fc316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=54a483ce5e6f471e98a9039b2737343f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:02.355233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c9d99-ef1b-41d4-b75e-73e2087fc316 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:02.357568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 579/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Sun Aug 7 00:52:02 2022] GET /identity/v3/domains/54a483ce5e6f471e98a9039b2737343f => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:02.363464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe307216-0e03-44f5-9ef5-3e3afcf4b7a5 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:02.442635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:02.461721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe307216-0e03-44f5-9ef5-3e3afcf4b7a5 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:02.495396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72d951-5cac-4684-b1b8-08bdc64be8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:02.496024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72d951-5cac-4684-b1b8-08bdc64be8f9 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:02.496303 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72d951-5cac-4684-b1b8-08bdc64be8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:02.496572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72d951-5cac-4684-b1b8-08bdc64be8f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:02.497511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72d951-5cac-4684-b1b8-08bdc64be8f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:02.498868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72d951-5cac-4684-b1b8-08bdc64be8f9 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:02.528940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 594/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Aug 7 00:52:02 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:52:04.608921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503903b-ab0f-40b1-b7f7-a99e9bfd6297 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:04.609454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503903b-ab0f-40b1-b7f7-a99e9bfd6297 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:04.609454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503903b-ab0f-40b1-b7f7-a99e9bfd6297 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:04.610820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 580/1174] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:04.616249 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fed6c6-80c3-4918-969d-6ce25340d818 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:04.616644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fed6c6-80c3-4918-969d-6ce25340d818 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:04.616791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fed6c6-80c3-4918-969d-6ce25340d818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:04.634914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-36fed6c6-80c3-4918-969d-6ce25340d818 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:04.636144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-36fed6c6-80c3-4918-969d-6ce25340d818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:04.705995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 595/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:52:04.730778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503903b-ab0f-40b1-b7f7-a99e9bfd6297 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:04.773169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:04.833146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503903b-ab0f-40b1-b7f7-a99e9bfd6297 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:04.866595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25123424-12b0-4cce-b2d6-b7aeb5f356a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:04.867154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123424-12b0-4cce-b2d6-b7aeb5f356a2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:04.867434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123424-12b0-4cce-b2d6-b7aeb5f356a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:04.867706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123424-12b0-4cce-b2d6-b7aeb5f356a2 None admin] PATH_INFO: `/v3/domains/54a483ce5e6f471e98a9039b2737343f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:04.868842 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25123424-12b0-4cce-b2d6-b7aeb5f356a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=54a483ce5e6f471e98a9039b2737343f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:04.870283 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25123424-12b0-4cce-b2d6-b7aeb5f356a2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:04.871880 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 581/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Sun Aug 7 00:52:04 2022] GET /identity/v3/domains/54a483ce5e6f471e98a9039b2737343f => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:04.878318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fed6c6-80c3-4918-969d-6ce25340d818 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:04.943740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:04.982881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fed6c6-80c3-4918-969d-6ce25340d818 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:05.016325 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545803b-f1c5-4107-8eb2-6c6bd4fd603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:05.017452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545803b-f1c5-4107-8eb2-6c6bd4fd603c None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:05.017452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545803b-f1c5-4107-8eb2-6c6bd4fd603c None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:05.017452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545803b-f1c5-4107-8eb2-6c6bd4fd603c None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:05.018364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545803b-f1c5-4107-8eb2-6c6bd4fd603c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:05.019799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545803b-f1c5-4107-8eb2-6c6bd4fd603c None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:05.040916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 596/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:52:04 2022] POST /identity/v3/users => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:52:07.111082 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7980aa5-ef9c-4c74-8e77-cd3854612be6 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:07.111749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7980aa5-ef9c-4c74-8e77-cd3854612be6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:07.111749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7980aa5-ef9c-4c74-8e77-cd3854612be6 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:07.112971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 582/1178] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:07.118214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01904028-e96b-4202-8975-1576ce6ebbcc None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:07.118673 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01904028-e96b-4202-8975-1576ce6ebbcc None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:07.118772 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01904028-e96b-4202-8975-1576ce6ebbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:07.136780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-01904028-e96b-4202-8975-1576ce6ebbcc None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:07.138506 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-01904028-e96b-4202-8975-1576ce6ebbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:07.212143 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 597/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:52:07.240760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7980aa5-ef9c-4c74-8e77-cd3854612be6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:07.344611 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7980aa5-ef9c-4c74-8e77-cd3854612be6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:07.352342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:07.384211 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917d326-9549-47f0-a912-32824259f323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:07.384732 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917d326-9549-47f0-a912-32824259f323 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:07.385004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917d326-9549-47f0-a912-32824259f323 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:07.385274 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917d326-9549-47f0-a912-32824259f323 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:07.396668 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917d326-9549-47f0-a912-32824259f323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-8917d326-9549-47f0-a912-32824259f323 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:07.401332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:07.402531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:07.403824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:07.403824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:07.403824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:07.403824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:07.403824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:07.403824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:07.403824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:07.403824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:07.403824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:07.403824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:07.403824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:07.403824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:52:07.403824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 583/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:52:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:07.408708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01904028-e96b-4202-8975-1576ce6ebbcc None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:07.459081 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:07.515436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01904028-e96b-4202-8975-1576ce6ebbcc None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:07.550162 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9c072-2623-4bd0-bd93-5a846acdc33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:07.550780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9c072-2623-4bd0-bd93-5a846acdc33a None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:07.551060 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9c072-2623-4bd0-bd93-5a846acdc33a None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:07.551334 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9c072-2623-4bd0-bd93-5a846acdc33a None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:07.552033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9c072-2623-4bd0-bd93-5a846acdc33a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:07.552335 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9c072-2623-4bd0-bd93-5a846acdc33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:07.553711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9c072-2623-4bd0-bd93-5a846acdc33a None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:07.562679 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 598/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:07.568663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917d326-9549-47f0-a912-32824259f323 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:07.669064 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917d326-9549-47f0-a912-32824259f323 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:07.703393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713be1a-6534-4889-81c3-49e2bf0f32ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:07.704055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713be1a-6534-4889-81c3-49e2bf0f32ac None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:07.704335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713be1a-6534-4889-81c3-49e2bf0f32ac None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:07.704604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713be1a-6534-4889-81c3-49e2bf0f32ac None admin] PATH_INFO: `/v3/users/6261fd2231984183b9d2003251d9743b` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:07.721933 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713be1a-6534-4889-81c3-49e2bf0f32ac None admin] RBAC: Authorizing `identity:get_user(user_id=6261fd2231984183b9d2003251d9743b)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:07.723383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713be1a-6534-4889-81c3-49e2bf0f32ac None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:07.725101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 584/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:07 2022] GET /identity/v3/users/6261fd2231984183b9d2003251d9743b => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:07.731693 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9c072-2623-4bd0-bd93-5a846acdc33a None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:07.838402 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9c072-2623-4bd0-bd93-5a846acdc33a None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:07.851502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:07.876518 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579d9ab-2bc3-4f66-93b7-2978bbc95b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:07.877124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579d9ab-2bc3-4f66-93b7-2978bbc95b56 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:07.877404 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579d9ab-2bc3-4f66-93b7-2978bbc95b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:07.877682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579d9ab-2bc3-4f66-93b7-2978bbc95b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:07.952513 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579d9ab-2bc3-4f66-93b7-2978bbc95b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:07.953979 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579d9ab-2bc3-4f66-93b7-2978bbc95b56 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:08.054781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 599/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:52:08.061033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713be1a-6534-4889-81c3-49e2bf0f32ac None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:08.089555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:08.171897 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713be1a-6534-4889-81c3-49e2bf0f32ac None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:08.207318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ffc92-c3f9-4299-9f84-754610d62321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:08.207867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ffc92-c3f9-4299-9f84-754610d62321 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:08.208181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ffc92-c3f9-4299-9f84-754610d62321 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:08.208453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ffc92-c3f9-4299-9f84-754610d62321 None admin] PATH_INFO: `/v3/projects/f0f5758daf284eea963f1ace6c6f4e5b` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:08.209575 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ffc92-c3f9-4299-9f84-754610d62321 None admin] RBAC: Authorizing `identity:get_project(project_id=f0f5758daf284eea963f1ace6c6f4e5b)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:08.210995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ffc92-c3f9-4299-9f84-754610d62321 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:08.212674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 585/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:08 2022] GET /identity/v3/projects/f0f5758daf284eea963f1ace6c6f4e5b => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:08.219502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579d9ab-2bc3-4f66-93b7-2978bbc95b56 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:08.234188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:08.329832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579d9ab-2bc3-4f66-93b7-2978bbc95b56 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:08.366083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f024fe-071a-4c2a-9dba-6d5e60727a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:08.366685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f024fe-071a-4c2a-9dba-6d5e60727a74 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:08.366966 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f024fe-071a-4c2a-9dba-6d5e60727a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:08.367241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f024fe-071a-4c2a-9dba-6d5e60727a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:08.368002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f024fe-071a-4c2a-9dba-6d5e60727a74 None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=f0f5758daf284eea963f1ace6c6f4e5b, user.id=6261fd2231984183b9d2003251d9743b) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:08.368317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f024fe-071a-4c2a-9dba-6d5e60727a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:08.369760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f024fe-071a-4c2a-9dba-6d5e60727a74 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:08.377090 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 600/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:08 2022] GET /identity/v3/role_assignments?user.id=6261fd2231984183b9d2003251d9743b&scope.project.id=f0f5758daf284eea963f1ace6c6f4e5b&role.id=638e1fc82db44124ae615c46408110a7 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:10.378482 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1b002-b457-470c-871b-bf2b124fd5af None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:10.379040 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1b002-b457-470c-871b-bf2b124fd5af None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:10.379040 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1b002-b457-470c-871b-bf2b124fd5af None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:10.380423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 586/1186] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:10.385489 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0450f-4a28-45c5-80f8-ab83a163a68e None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:10.385914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0450f-4a28-45c5-80f8-ab83a163a68e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:10.386017 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0450f-4a28-45c5-80f8-ab83a163a68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:10.404680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-32a0450f-4a28-45c5-80f8-ab83a163a68e None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:10.405866 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-32a0450f-4a28-45c5-80f8-ab83a163a68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:10.472138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 601/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:52:10.493868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1b002-b457-470c-871b-bf2b124fd5af None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:10.589645 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:10.600239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1b002-b457-470c-871b-bf2b124fd5af None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:10.634397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183f8dc-54b5-48ea-9cb4-ce1348b9d332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:10.634948 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183f8dc-54b5-48ea-9cb4-ce1348b9d332 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:10.635228 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183f8dc-54b5-48ea-9cb4-ce1348b9d332 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:10.635496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183f8dc-54b5-48ea-9cb4-ce1348b9d332 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:10.646037 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183f8dc-54b5-48ea-9cb4-ce1348b9d332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-0183f8dc-54b5-48ea-9cb4-ce1348b9d332 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:10.650705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:10.651825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:10.653426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:10.653426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:10.653426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:10.653426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:10.653426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:10.653426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:10.653426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:10.653426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:10.653426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:10.653426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:10.653426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:10.653426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:52:10.653426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 587/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:52:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:10.658610 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0450f-4a28-45c5-80f8-ab83a163a68e None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:10.666605 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:10.757510 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0450f-4a28-45c5-80f8-ab83a163a68e None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:10.790089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86fe0b-d659-4c3e-a747-286016d445c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:10.790685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86fe0b-d659-4c3e-a747-286016d445c3 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:10.790958 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86fe0b-d659-4c3e-a747-286016d445c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:10.791226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86fe0b-d659-4c3e-a747-286016d445c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:10.791876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86fe0b-d659-4c3e-a747-286016d445c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:10.792202 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86fe0b-d659-4c3e-a747-286016d445c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:10.794245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86fe0b-d659-4c3e-a747-286016d445c3 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:10.802018 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 602/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:10.807841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183f8dc-54b5-48ea-9cb4-ce1348b9d332 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:10.911954 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183f8dc-54b5-48ea-9cb4-ce1348b9d332 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:10.947368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e9d40-51aa-4597-aa78-5f3b0d4683bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:10.948029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e9d40-51aa-4597-aa78-5f3b0d4683bf None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:10.948312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e9d40-51aa-4597-aa78-5f3b0d4683bf None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:10.948587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e9d40-51aa-4597-aa78-5f3b0d4683bf None admin] PATH_INFO: `/v3/users/6261fd2231984183b9d2003251d9743b` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:10.950252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e9d40-51aa-4597-aa78-5f3b0d4683bf None admin] RBAC: Authorizing `identity:get_user(user_id=6261fd2231984183b9d2003251d9743b)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:10.951852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e9d40-51aa-4597-aa78-5f3b0d4683bf None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:10.953469 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 588/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:10 2022] GET /identity/v3/users/6261fd2231984183b9d2003251d9743b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:10.959347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86fe0b-d659-4c3e-a747-286016d445c3 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:11.026048 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:11.059846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86fe0b-d659-4c3e-a747-286016d445c3 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:11.093452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd8d7d-4286-45d6-9611-e6ac1ae951b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:11.094074 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd8d7d-4286-45d6-9611-e6ac1ae951b3 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:11.094355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd8d7d-4286-45d6-9611-e6ac1ae951b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:11.094628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd8d7d-4286-45d6-9611-e6ac1ae951b3 None admin] PATH_INFO: `/v3/projects/f0f5758daf284eea963f1ace6c6f4e5b` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:11.095738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd8d7d-4286-45d6-9611-e6ac1ae951b3 None admin] RBAC: Authorizing `identity:get_project(project_id=f0f5758daf284eea963f1ace6c6f4e5b)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:11.097197 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd8d7d-4286-45d6-9611-e6ac1ae951b3 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:11.098837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 603/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:10 2022] GET /identity/v3/projects/f0f5758daf284eea963f1ace6c6f4e5b => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:11.104827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e9d40-51aa-4597-aa78-5f3b0d4683bf None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:11.127509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:11.205269 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e9d40-51aa-4597-aa78-5f3b0d4683bf None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:11.237870 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cefbc8-bb6e-4bf6-9dd0-371279f92870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:11.238518 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cefbc8-bb6e-4bf6-9dd0-371279f92870 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:11.238798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cefbc8-bb6e-4bf6-9dd0-371279f92870 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:11.239069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cefbc8-bb6e-4bf6-9dd0-371279f92870 None admin] PATH_INFO: `/v3/projects/f0f5758daf284eea963f1ace6c6f4e5b/users/6261fd2231984183b9d2003251d9743b/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:11.240964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cefbc8-bb6e-4bf6-9dd0-371279f92870 None admin] RBAC: Authorizing `identity:create_grant(project_id=f0f5758daf284eea963f1ace6c6f4e5b, user_id=6261fd2231984183b9d2003251d9743b, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:11.242377 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cefbc8-bb6e-4bf6-9dd0-371279f92870 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:11.255134 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 589/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:52:11 2022] PUT /identity/v3/projects/f0f5758daf284eea963f1ace6c6f4e5b/users/6261fd2231984183b9d2003251d9743b/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:52:13.243235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36bb5d-19f3-4e8b-8890-82b1d2b28ecf None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.243795 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36bb5d-19f3-4e8b-8890-82b1d2b28ecf None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.243795 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36bb5d-19f3-4e8b-8890-82b1d2b28ecf None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.245155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 604/1193] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:13.250266 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09617c-8f3d-46be-b50c-248f640892b6 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.250692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09617c-8f3d-46be-b50c-248f640892b6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.250823 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09617c-8f3d-46be-b50c-248f640892b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.270062 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-df09617c-8f3d-46be-b50c-248f640892b6 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:13.271242 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-df09617c-8f3d-46be-b50c-248f640892b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:13.339368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 590/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:52:13.364821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36bb5d-19f3-4e8b-8890-82b1d2b28ecf None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:13.476869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36bb5d-19f3-4e8b-8890-82b1d2b28ecf None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:13.513120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93180844-0e9c-4934-bd63-ffed678edbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:13.513680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93180844-0e9c-4934-bd63-ffed678edbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.513959 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93180844-0e9c-4934-bd63-ffed678edbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.514227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93180844-0e9c-4934-bd63-ffed678edbe0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.517265 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:13.528628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93180844-0e9c-4934-bd63-ffed678edbe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-93180844-0e9c-4934-bd63-ffed678edbe0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:13.533356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:13.535226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:13.537223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:13.537223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:13.537223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:13.537223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:13.537223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:13.537223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:13.537223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:13.537223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:13.537223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:13.537223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:13.537223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:13.537223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:52:13.537223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 605/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:52:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:13.542352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09617c-8f3d-46be-b50c-248f640892b6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:13.555128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:13.648732 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09617c-8f3d-46be-b50c-248f640892b6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:13.685716 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119f501-7b81-4547-b1e2-37b4c9aa9c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:13.686328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119f501-7b81-4547-b1e2-37b4c9aa9c32 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.686604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119f501-7b81-4547-b1e2-37b4c9aa9c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.686874 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119f501-7b81-4547-b1e2-37b4c9aa9c32 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.687548 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119f501-7b81-4547-b1e2-37b4c9aa9c32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:13.687849 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119f501-7b81-4547-b1e2-37b4c9aa9c32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:13.689265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119f501-7b81-4547-b1e2-37b4c9aa9c32 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:13.699125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 591/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:13.706663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93180844-0e9c-4934-bd63-ffed678edbe0 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:13.836238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93180844-0e9c-4934-bd63-ffed678edbe0 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:13.875887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccba4c-0b3d-46a2-8230-a8e72a2d8214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:13.876551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccba4c-0b3d-46a2-8230-a8e72a2d8214 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.876830 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccba4c-0b3d-46a2-8230-a8e72a2d8214 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.877099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccba4c-0b3d-46a2-8230-a8e72a2d8214 None admin] PATH_INFO: `/v3/users/6261fd2231984183b9d2003251d9743b` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.878245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccba4c-0b3d-46a2-8230-a8e72a2d8214 None admin] RBAC: Authorizing `identity:get_user(user_id=6261fd2231984183b9d2003251d9743b)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:13.879691 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccba4c-0b3d-46a2-8230-a8e72a2d8214 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:13.881320 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 606/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:13 2022] GET /identity/v3/users/6261fd2231984183b9d2003251d9743b => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:13.887441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119f501-7b81-4547-b1e2-37b4c9aa9c32 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:13.969586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:14.008195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119f501-7b81-4547-b1e2-37b4c9aa9c32 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:14.042468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bb18f-92c3-42c6-a61a-d428f7c40f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:14.043791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bb18f-92c3-42c6-a61a-d428f7c40f29 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:14.044170 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bb18f-92c3-42c6-a61a-d428f7c40f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:14.044445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437bb18f-92c3-42c6-a61a-d428f7c40f29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:14.116965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437bb18f-92c3-42c6-a61a-d428f7c40f29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:14.118324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437bb18f-92c3-42c6-a61a-d428f7c40f29 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:14.189149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:14.221034 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 592/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:52:14.226941 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccba4c-0b3d-46a2-8230-a8e72a2d8214 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:14.295087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:14.334190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccba4c-0b3d-46a2-8230-a8e72a2d8214 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:14.368614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd516e1c-930a-4e57-a175-06ea318134c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:14.369161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516e1c-930a-4e57-a175-06ea318134c9 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:14.369435 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516e1c-930a-4e57-a175-06ea318134c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:14.369705 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516e1c-930a-4e57-a175-06ea318134c9 None admin] PATH_INFO: `/v3/projects/f0f5758daf284eea963f1ace6c6f4e5b` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:14.370815 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd516e1c-930a-4e57-a175-06ea318134c9 None admin] RBAC: Authorizing `identity:get_project(project_id=f0f5758daf284eea963f1ace6c6f4e5b)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:14.372318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd516e1c-930a-4e57-a175-06ea318134c9 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:14.373961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 607/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:14 2022] GET /identity/v3/projects/f0f5758daf284eea963f1ace6c6f4e5b => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:14.380556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bb18f-92c3-42c6-a61a-d428f7c40f29 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:14.487048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437bb18f-92c3-42c6-a61a-d428f7c40f29 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:14.523795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e78766-7a51-4cbf-8684-80284a39b5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:14.524437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e78766-7a51-4cbf-8684-80284a39b5bf None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:14.524720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e78766-7a51-4cbf-8684-80284a39b5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:14.524990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e78766-7a51-4cbf-8684-80284a39b5bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:14.525722 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e78766-7a51-4cbf-8684-80284a39b5bf None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=f0f5758daf284eea963f1ace6c6f4e5b, user.id=6261fd2231984183b9d2003251d9743b) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:14.526029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e78766-7a51-4cbf-8684-80284a39b5bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:14.527490 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e78766-7a51-4cbf-8684-80284a39b5bf None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:14.534182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 593/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:14 2022] GET /identity/v3/role_assignments?user.id=6261fd2231984183b9d2003251d9743b&scope.project.id=f0f5758daf284eea963f1ace6c6f4e5b&role.id=638e1fc82db44124ae615c46408110a7 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:24.364394 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=34 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:24.531613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=82 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:14.085617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f083c-c229-46a7-8680-61d5b5c495ea None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:14.086236 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f083c-c229-46a7-8680-61d5b5c495ea None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:14.086236 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f083c-c229-46a7-8680-61d5b5c495ea None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:14.087778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 608/1201] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:53:14.093644 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf328-bc2a-4196-9db7-0601121e0703 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:14.094202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf328-bc2a-4196-9db7-0601121e0703 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:14.094202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf328-bc2a-4196-9db7-0601121e0703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:14.115474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-370bf328-bc2a-4196-9db7-0601121e0703 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:14.117024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-370bf328-bc2a-4196-9db7-0601121e0703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:14.220261 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 594/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:14.263114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f083c-c229-46a7-8680-61d5b5c495ea None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:14.452406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f083c-c229-46a7-8680-61d5b5c495ea None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:14.507817 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94981462-51f1-4051-a949-1ce8cdae84ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:14.509572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94981462-51f1-4051-a949-1ce8cdae84ee None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:14.510017 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94981462-51f1-4051-a949-1ce8cdae84ee None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:14.510311 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94981462-51f1-4051-a949-1ce8cdae84ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:14.532149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94981462-51f1-4051-a949-1ce8cdae84ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:14.534107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94981462-51f1-4051-a949-1ce8cdae84ee None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-94981462-51f1-4051-a949-1ce8cdae84ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:14.558421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:14.561128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:14.562595 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:14.562595 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:14.562595 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:14.562595 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 609/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:14.567885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bf328-bc2a-4196-9db7-0601121e0703 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:14.800355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bf328-bc2a-4196-9db7-0601121e0703 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:14.863160 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:14.875118 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138dc07-74f9-4e32-b6f8-0be6f9142a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:14.876178 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138dc07-74f9-4e32-b6f8-0be6f9142a14 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:14.876667 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138dc07-74f9-4e32-b6f8-0be6f9142a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:14.877159 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138dc07-74f9-4e32-b6f8-0be6f9142a14 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:14.878402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138dc07-74f9-4e32-b6f8-0be6f9142a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:14.878961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138dc07-74f9-4e32-b6f8-0be6f9142a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:14.881744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138dc07-74f9-4e32-b6f8-0be6f9142a14 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:14.913132 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 595/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:14.916108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94981462-51f1-4051-a949-1ce8cdae84ee None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:15.010000 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:15.066627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94981462-51f1-4051-a949-1ce8cdae84ee None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:15.107805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e604c5-e5b3-4867-b713-a9578707f41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:15.109242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e604c5-e5b3-4867-b713-a9578707f41a None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:15.109850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e604c5-e5b3-4867-b713-a9578707f41a None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:15.110342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e604c5-e5b3-4867-b713-a9578707f41a None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:15.111216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e604c5-e5b3-4867-b713-a9578707f41a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:15.112824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e604c5-e5b3-4867-b713-a9578707f41a None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:15.142491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 610/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Aug 7 00:53:14 2022] POST /identity/v3/users => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:53:17.652002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62623872-85ba-4c15-94c2-5ad65543fedd None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:17.652623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62623872-85ba-4c15-94c2-5ad65543fedd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:17.652811 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62623872-85ba-4c15-94c2-5ad65543fedd None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:17.654781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 596/1206] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:17.663971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681132f-c938-4734-a850-a184037a4017 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:17.663971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681132f-c938-4734-a850-a184037a4017 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:17.663971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681132f-c938-4734-a850-a184037a4017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:17.686055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-1681132f-c938-4734-a850-a184037a4017 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:17.687213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1681132f-c938-4734-a850-a184037a4017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:17.784089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 611/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:17.806007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62623872-85ba-4c15-94c2-5ad65543fedd None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:17.963539 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62623872-85ba-4c15-94c2-5ad65543fedd None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:18.027497 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7b16e-62eb-4970-8d25-04fd0a181b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:18.028972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7b16e-62eb-4970-8d25-04fd0a181b0a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:18.029502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7b16e-62eb-4970-8d25-04fd0a181b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:18.029924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7b16e-62eb-4970-8d25-04fd0a181b0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:18.053368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7b16e-62eb-4970-8d25-04fd0a181b0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-6ce7b16e-62eb-4970-8d25-04fd0a181b0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:18.059233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:18.064243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:18.065335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:18.065335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:18.065335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:18.065335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:18.065335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:18.065335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:18.065335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:18.065335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:18.065335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:18.065335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:18.065335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:18.065335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:18.065335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 597/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:18.067603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681132f-c938-4734-a850-a184037a4017 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:18.165427 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:18.246097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681132f-c938-4734-a850-a184037a4017 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:18.292476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139768a-9828-45f2-8026-d1a905819169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:18.292994 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139768a-9828-45f2-8026-d1a905819169 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:18.293268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139768a-9828-45f2-8026-d1a905819169 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:18.293557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139768a-9828-45f2-8026-d1a905819169 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:18.294222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139768a-9828-45f2-8026-d1a905819169 None admin] RBAC: Adding query filter params (name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:18.294525 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139768a-9828-45f2-8026-d1a905819169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:18.295949 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139768a-9828-45f2-8026-d1a905819169 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:18.311163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 612/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:18.312267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7b16e-62eb-4970-8d25-04fd0a181b0a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:18.413355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:18.522494 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7b16e-62eb-4970-8d25-04fd0a181b0a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:18.586039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e0d9a-c46f-428d-9894-e128e8b57551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:18.587285 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e0d9a-c46f-428d-9894-e128e8b57551 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:18.587754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e0d9a-c46f-428d-9894-e128e8b57551 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:18.588235 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e0d9a-c46f-428d-9894-e128e8b57551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:18.614644 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e0d9a-c46f-428d-9894-e128e8b57551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:18.616264 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e0d9a-c46f-428d-9894-e128e8b57551 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-550e0d9a-c46f-428d-9894-e128e8b57551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:18.644984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:18.646846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:18.649369 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:18.649369 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:18.649369 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:18.649369 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 598/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:18.660983 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139768a-9828-45f2-8026-d1a905819169 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:18.854736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:18.861122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139768a-9828-45f2-8026-d1a905819169 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:18.928140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395843e-e334-4e50-8465-3b0bfc5f5c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:18.929089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395843e-e334-4e50-8465-3b0bfc5f5c88 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:18.929585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395843e-e334-4e50-8465-3b0bfc5f5c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:18.931149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395843e-e334-4e50-8465-3b0bfc5f5c88 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:18.932741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395843e-e334-4e50-8465-3b0bfc5f5c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:18.933227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395843e-e334-4e50-8465-3b0bfc5f5c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:18.935753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395843e-e334-4e50-8465-3b0bfc5f5c88 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:18.961900 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 613/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:18.970219 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e0d9a-c46f-428d-9894-e128e8b57551 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:19.234900 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e0d9a-c46f-428d-9894-e128e8b57551 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:19.237405 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:19.324629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912bdee-f71e-4a53-8000-390a298500cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:19.325814 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912bdee-f71e-4a53-8000-390a298500cf None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:19.326398 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912bdee-f71e-4a53-8000-390a298500cf None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:19.326902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912bdee-f71e-4a53-8000-390a298500cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:19.346278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912bdee-f71e-4a53-8000-390a298500cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:19.348409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912bdee-f71e-4a53-8000-390a298500cf None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-7912bdee-f71e-4a53-8000-390a298500cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:19.382277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:19.383458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:19.384598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:19.384598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:19.384598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:19.384598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:19.384598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:19.384598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:19.384598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:19.384598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:19.384598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:53:19.384598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:19.389058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 599/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:19.395108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395843e-e334-4e50-8465-3b0bfc5f5c88 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:19.573465 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395843e-e334-4e50-8465-3b0bfc5f5c88 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:19.645181 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7b1c2-3004-4021-9a75-aeb7e7bc29eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:19.645961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7b1c2-3004-4021-9a75-aeb7e7bc29eb None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:19.646341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7b1c2-3004-4021-9a75-aeb7e7bc29eb None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:19.646739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7b1c2-3004-4021-9a75-aeb7e7bc29eb None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:19.647644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7b1c2-3004-4021-9a75-aeb7e7bc29eb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:19.648086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7b1c2-3004-4021-9a75-aeb7e7bc29eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:19.654505 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7b1c2-3004-4021-9a75-aeb7e7bc29eb None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:19.682766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 614/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Aug 7 00:53:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:19.694506 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912bdee-f71e-4a53-8000-390a298500cf None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:19.909551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912bdee-f71e-4a53-8000-390a298500cf None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:19.960572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8035c9-4e1e-4465-a780-e920e79cc8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:19.961595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8035c9-4e1e-4465-a780-e920e79cc8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:19.961977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8035c9-4e1e-4465-a780-e920e79cc8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:19.962269 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8035c9-4e1e-4465-a780-e920e79cc8e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:20.004996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:20.073088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8035c9-4e1e-4465-a780-e920e79cc8e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:20.075333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8035c9-4e1e-4465-a780-e920e79cc8e8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:20.263253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 600/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:53:20.265285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7b1c2-3004-4021-9a75-aeb7e7bc29eb None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:20.294894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:20.448712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7b1c2-3004-4021-9a75-aeb7e7bc29eb None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:20.501694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016719b-171b-41aa-b22f-ab9b5099cfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:20.502458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016719b-171b-41aa-b22f-ab9b5099cfef None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:20.502935 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016719b-171b-41aa-b22f-ab9b5099cfef None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:20.503316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016719b-171b-41aa-b22f-ab9b5099cfef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:20.521413 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016719b-171b-41aa-b22f-ab9b5099cfef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:20.523090 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016719b-171b-41aa-b22f-ab9b5099cfef None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-d016719b-171b-41aa-b22f-ab9b5099cfef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:20.545020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:20.547471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:20.557024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:20.557024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:20.557024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:20.557024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 615/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:20.557716 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8035c9-4e1e-4465-a780-e920e79cc8e8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:20.654386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:20.721891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8035c9-4e1e-4465-a780-e920e79cc8e8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:20.761587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a3df1-3d8f-4b5f-9d81-b4f48540849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:20.762202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a3df1-3d8f-4b5f-9d81-b4f48540849a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:20.762482 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a3df1-3d8f-4b5f-9d81-b4f48540849a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:20.762759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a3df1-3d8f-4b5f-9d81-b4f48540849a None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:20.763457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a3df1-3d8f-4b5f-9d81-b4f48540849a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:20.763764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a3df1-3d8f-4b5f-9d81-b4f48540849a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:20.765189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a3df1-3d8f-4b5f-9d81-b4f48540849a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:20.778488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 601/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:20.785192 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016719b-171b-41aa-b22f-ab9b5099cfef None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:20.898251 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:20.948930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016719b-171b-41aa-b22f-ab9b5099cfef None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:20.996155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc6a5e-2980-450a-9e7c-16ef278dcdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:20.996988 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc6a5e-2980-450a-9e7c-16ef278dcdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:20.997277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc6a5e-2980-450a-9e7c-16ef278dcdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:20.997540 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc6a5e-2980-450a-9e7c-16ef278dcdd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:21.007106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc6a5e-2980-450a-9e7c-16ef278dcdd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:21.009069 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc6a5e-2980-450a-9e7c-16ef278dcdd3 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:21.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-29dc6a5e-2980-450a-9e7c-16ef278dcdd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:21.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:21.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:21.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:21.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:21.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:21.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:21.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:21.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:21.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:21.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:21.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:21.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:21.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:21.023107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:21.025848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:21.030206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:21.030206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:21.030206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:21.030206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:21.030206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:21.030206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:21.030206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:21.030206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:21.030206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 616/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:21.035872 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a3df1-3d8f-4b5f-9d81-b4f48540849a None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:21.193361 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a3df1-3d8f-4b5f-9d81-b4f48540849a None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:21.227484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:21.247676 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8cc23-9838-4b5b-90b4-983b57656b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:21.248499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8cc23-9838-4b5b-90b4-983b57656b54 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:21.248764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8cc23-9838-4b5b-90b4-983b57656b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:21.249042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8cc23-9838-4b5b-90b4-983b57656b54 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:21.249797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8cc23-9838-4b5b-90b4-983b57656b54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:21.250110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8cc23-9838-4b5b-90b4-983b57656b54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:21.251623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8cc23-9838-4b5b-90b4-983b57656b54 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:21.272544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 602/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:21.280826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc6a5e-2980-450a-9e7c-16ef278dcdd3 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:21.417040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc6a5e-2980-450a-9e7c-16ef278dcdd3 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:21.457653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:21.467110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3aa2e-5d24-47c9-a072-e71acef60e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:21.467854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3aa2e-5d24-47c9-a072-e71acef60e07 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:21.468213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3aa2e-5d24-47c9-a072-e71acef60e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:21.468492 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3aa2e-5d24-47c9-a072-e71acef60e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:21.469413 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3aa2e-5d24-47c9-a072-e71acef60e07 None admin] RBAC: Adding query filter params (role.id=05605552a8ef41ce895f7d776aefd260, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=f7d9f23893704741bcc8ced0550c0391) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:21.469723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3aa2e-5d24-47c9-a072-e71acef60e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:21.471561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3aa2e-5d24-47c9-a072-e71acef60e07 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:21.480145 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 617/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:21 2022] GET /identity/v3/role_assignments?user.id=f7d9f23893704741bcc8ced0550c0391&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=05605552a8ef41ce895f7d776aefd260 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:23.607426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c8433-4394-42cb-b40f-64f4b95a2ef1 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:23.608150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c8433-4394-42cb-b40f-64f4b95a2ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:23.608150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c8433-4394-42cb-b40f-64f4b95a2ef1 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:23.609592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 603/1220] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:23.615501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f96ca-e417-46a3-9a60-e9d8b03e8f54 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:23.615984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f96ca-e417-46a3-9a60-e9d8b03e8f54 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:23.616094 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f96ca-e417-46a3-9a60-e9d8b03e8f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:23.636297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-0f9f96ca-e417-46a3-9a60-e9d8b03e8f54 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:23.637526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-0f9f96ca-e417-46a3-9a60-e9d8b03e8f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:23.713400 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 618/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:23.738929 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c8433-4394-42cb-b40f-64f4b95a2ef1 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:23.858279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c8433-4394-42cb-b40f-64f4b95a2ef1 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:23.904464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e37934-5211-46f4-a7a1-a8b860bbb5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:23.905269 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e37934-5211-46f4-a7a1-a8b860bbb5ad None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:23.905682 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e37934-5211-46f4-a7a1-a8b860bbb5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:23.906086 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e37934-5211-46f4-a7a1-a8b860bbb5ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:23.919973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e37934-5211-46f4-a7a1-a8b860bbb5ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-b4e37934-5211-46f4-a7a1-a8b860bbb5ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:23.925239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:23.926248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:23.927117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:23.927117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:23.927117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:23.927117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:23.927117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:23.927117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:23.927117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:23.927117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:23.927117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:23.927117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:23.927117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:23.927117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:23.932230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 604/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:23.933299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f96ca-e417-46a3-9a60-e9d8b03e8f54 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:24.048436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f96ca-e417-46a3-9a60-e9d8b03e8f54 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:24.074583 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:24.085334 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcf768-faaa-4dd5-9a4a-c3b11357558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:24.085989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcf768-faaa-4dd5-9a4a-c3b11357558b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:24.086266 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcf768-faaa-4dd5-9a4a-c3b11357558b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:24.086535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcf768-faaa-4dd5-9a4a-c3b11357558b None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:24.087200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcf768-faaa-4dd5-9a4a-c3b11357558b None admin] RBAC: Adding query filter params (name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:24.087500 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcf768-faaa-4dd5-9a4a-c3b11357558b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:24.088914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcf768-faaa-4dd5-9a4a-c3b11357558b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:24.097297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 619/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:24.104048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e37934-5211-46f4-a7a1-a8b860bbb5ad None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:24.161472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:24.238215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e37934-5211-46f4-a7a1-a8b860bbb5ad None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:24.281973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef696b-ce06-4592-8285-241c344b7639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:24.282719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef696b-ce06-4592-8285-241c344b7639 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:24.283138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef696b-ce06-4592-8285-241c344b7639 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:24.283457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef696b-ce06-4592-8285-241c344b7639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:24.295598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef696b-ce06-4592-8285-241c344b7639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:24.297119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef696b-ce06-4592-8285-241c344b7639 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-14ef696b-ce06-4592-8285-241c344b7639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:24.312443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:24.313589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:24.314910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:24.314910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:24.314910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:24.314910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 605/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:24.320724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcf768-faaa-4dd5-9a4a-c3b11357558b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:24.435247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcf768-faaa-4dd5-9a4a-c3b11357558b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:24.471697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244cb78-2f6e-4989-8277-82ead9177d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:24.472331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244cb78-2f6e-4989-8277-82ead9177d05 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:24.472612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244cb78-2f6e-4989-8277-82ead9177d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:24.472890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244cb78-2f6e-4989-8277-82ead9177d05 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:24.473537 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244cb78-2f6e-4989-8277-82ead9177d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:24.473908 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244cb78-2f6e-4989-8277-82ead9177d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:24.475289 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244cb78-2f6e-4989-8277-82ead9177d05 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:24.487866 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 620/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:24.493761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef696b-ce06-4592-8285-241c344b7639 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:24.605186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:24.613762 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef696b-ce06-4592-8285-241c344b7639 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:24.653076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39b4f1-b5ea-44d1-97bd-393aa776a20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:24.653767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39b4f1-b5ea-44d1-97bd-393aa776a20e None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:24.654045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39b4f1-b5ea-44d1-97bd-393aa776a20e None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:24.654317 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39b4f1-b5ea-44d1-97bd-393aa776a20e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:24.663002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39b4f1-b5ea-44d1-97bd-393aa776a20e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:24.665193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39b4f1-b5ea-44d1-97bd-393aa776a20e None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-2f39b4f1-b5ea-44d1-97bd-393aa776a20e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:24.678141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:24.679439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:24.681273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:24.681273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:24.681273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:24.681273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:24.681273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:24.681273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:24.681273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:24.681273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:24.681273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:53:24.681273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:24.681273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 606/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:24.686498 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244cb78-2f6e-4989-8277-82ead9177d05 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:24.739876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:24.797489 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244cb78-2f6e-4989-8277-82ead9177d05 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:24.837628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ea2fd-1808-4b79-b34d-0f8f0e2d5705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:24.838245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ea2fd-1808-4b79-b34d-0f8f0e2d5705 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:24.838525 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ea2fd-1808-4b79-b34d-0f8f0e2d5705 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:24.838795 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ea2fd-1808-4b79-b34d-0f8f0e2d5705 None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:24.839538 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ea2fd-1808-4b79-b34d-0f8f0e2d5705 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:24.839841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ea2fd-1808-4b79-b34d-0f8f0e2d5705 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:24.841316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ea2fd-1808-4b79-b34d-0f8f0e2d5705 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:24.859837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 621/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Aug 7 00:53:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:24.865585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39b4f1-b5ea-44d1-97bd-393aa776a20e None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:24.978063 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39b4f1-b5ea-44d1-97bd-393aa776a20e None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:25.020328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03c1b6-ce26-4654-8f80-17f1fbf16d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:25.021242 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03c1b6-ce26-4654-8f80-17f1fbf16d8b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:25.021557 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03c1b6-ce26-4654-8f80-17f1fbf16d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:25.021927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03c1b6-ce26-4654-8f80-17f1fbf16d8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:25.035884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03c1b6-ce26-4654-8f80-17f1fbf16d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:25.037573 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03c1b6-ce26-4654-8f80-17f1fbf16d8b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-6b03c1b6-ce26-4654-8f80-17f1fbf16d8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:25.054415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:25.056254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:25.057364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:25.057364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:25.057364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:25.057364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 607/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:25.062792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ea2fd-1808-4b79-b34d-0f8f0e2d5705 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:25.183147 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ea2fd-1808-4b79-b34d-0f8f0e2d5705 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:25.186330 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:25.234421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badab80-a3db-42a6-a8f4-068339f1143b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:25.235107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badab80-a3db-42a6-a8f4-068339f1143b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:25.235510 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badab80-a3db-42a6-a8f4-068339f1143b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:25.235837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badab80-a3db-42a6-a8f4-068339f1143b None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:25.236961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badab80-a3db-42a6-a8f4-068339f1143b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:25.237334 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badab80-a3db-42a6-a8f4-068339f1143b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:25.239117 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badab80-a3db-42a6-a8f4-068339f1143b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:25.256901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 622/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:25.267025 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03c1b6-ce26-4654-8f80-17f1fbf16d8b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:25.281047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:25.384116 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03c1b6-ce26-4654-8f80-17f1fbf16d8b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:25.424887 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712e0fe-6bb5-43b7-8e9b-0958afef9130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:25.425679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712e0fe-6bb5-43b7-8e9b-0958afef9130 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:25.425978 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712e0fe-6bb5-43b7-8e9b-0958afef9130 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:25.426257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712e0fe-6bb5-43b7-8e9b-0958afef9130 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:25.434716 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712e0fe-6bb5-43b7-8e9b-0958afef9130 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:25.436197 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712e0fe-6bb5-43b7-8e9b-0958afef9130 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:25.448262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-f712e0fe-6bb5-43b7-8e9b-0958afef9130 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:25.448262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:25.448262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:25.448262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:25.448262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:25.448262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:25.448262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:25.448262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:25.448262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:25.448262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:25.448262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:25.448262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:25.448262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:25.448262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:25.448262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:25.449588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:25.450888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:25.450888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:25.450888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:25.450888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:25.450888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:25.450888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:25.450888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:25.450888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:25.454958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 608/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:25.456114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badab80-a3db-42a6-a8f4-068339f1143b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:25.568134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badab80-a3db-42a6-a8f4-068339f1143b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:25.607623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f06e31-7499-4419-a20e-64f78517c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:25.608296 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f06e31-7499-4419-a20e-64f78517c131 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:25.608702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f06e31-7499-4419-a20e-64f78517c131 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:25.609011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f06e31-7499-4419-a20e-64f78517c131 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:25.609969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f06e31-7499-4419-a20e-64f78517c131 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:25.610398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f06e31-7499-4419-a20e-64f78517c131 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:25.612667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f06e31-7499-4419-a20e-64f78517c131 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:25.627333 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 623/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:25.635563 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712e0fe-6bb5-43b7-8e9b-0958afef9130 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:25.721110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:25.763732 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712e0fe-6bb5-43b7-8e9b-0958afef9130 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:25.801396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0f008-ea2e-4542-9abd-536a9c781360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:25.802229 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0f008-ea2e-4542-9abd-536a9c781360 None admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:25.802610 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0f008-ea2e-4542-9abd-536a9c781360 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:25.802988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0f008-ea2e-4542-9abd-536a9c781360 None admin] PATH_INFO: `/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/f7d9f23893704741bcc8ced0550c0391/roles/05605552a8ef41ce895f7d776aefd260` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:25.819369 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0f008-ea2e-4542-9abd-536a9c781360 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9f64c951f44fd48eedc312b1f33694, user_id=f7d9f23893704741bcc8ced0550c0391, role_id=05605552a8ef41ce895f7d776aefd260)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:25.821130 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0f008-ea2e-4542-9abd-536a9c781360 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:25.834592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 609/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:53:25 2022] PUT /identity/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/f7d9f23893704741bcc8ced0550c0391/roles/05605552a8ef41ce895f7d776aefd260 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:53:27.953905 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736fe60-fd62-4b7e-849a-c15c65bbc0af None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:27.954456 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736fe60-fd62-4b7e-849a-c15c65bbc0af None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:27.954547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736fe60-fd62-4b7e-849a-c15c65bbc0af None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:27.956069 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 624/1233] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:53:27.961701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630e952-e83e-4799-b89d-8e6d2ac37bde None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:27.962135 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630e952-e83e-4799-b89d-8e6d2ac37bde None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:27.962297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630e952-e83e-4799-b89d-8e6d2ac37bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:27.981547 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5630e952-e83e-4799-b89d-8e6d2ac37bde None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:27.982738 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5630e952-e83e-4799-b89d-8e6d2ac37bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:28.056364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 610/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:28.081485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736fe60-fd62-4b7e-849a-c15c65bbc0af None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:28.122646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:28.215775 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736fe60-fd62-4b7e-849a-c15c65bbc0af None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:28.261720 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f775d-0fe8-4028-b9d5-c322a6e88e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:28.262641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f775d-0fe8-4028-b9d5-c322a6e88e4e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.263030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f775d-0fe8-4028-b9d5-c322a6e88e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.263439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f775d-0fe8-4028-b9d5-c322a6e88e4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.279302 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f775d-0fe8-4028-b9d5-c322a6e88e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-e25f775d-0fe8-4028-b9d5-c322a6e88e4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:28.284250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:28.285521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:28.286639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:28.286639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:28.286639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:28.286639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:28.286639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:28.286639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:28.286639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:28.286639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:28.286639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:28.286639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:28.286639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:28.286639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:28.286639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 625/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:28.292329 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630e952-e83e-4799-b89d-8e6d2ac37bde None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:28.342324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:28.397986 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630e952-e83e-4799-b89d-8e6d2ac37bde None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:28.437463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f07eb-1f3d-4cc4-aa17-a12f85603776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:28.438075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f07eb-1f3d-4cc4-aa17-a12f85603776 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.438346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f07eb-1f3d-4cc4-aa17-a12f85603776 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.438612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f07eb-1f3d-4cc4-aa17-a12f85603776 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.439285 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f07eb-1f3d-4cc4-aa17-a12f85603776 None admin] RBAC: Adding query filter params (name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:28.439564 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f07eb-1f3d-4cc4-aa17-a12f85603776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:28.440940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f07eb-1f3d-4cc4-aa17-a12f85603776 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:28.449481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 611/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:28.455615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f775d-0fe8-4028-b9d5-c322a6e88e4e None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:28.544301 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:28.560543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f775d-0fe8-4028-b9d5-c322a6e88e4e None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:28.598010 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efc7ad-3563-48fe-9a6e-715ad83ca92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:28.598667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efc7ad-3563-48fe-9a6e-715ad83ca92b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.598932 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efc7ad-3563-48fe-9a6e-715ad83ca92b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.599238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efc7ad-3563-48fe-9a6e-715ad83ca92b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.609791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efc7ad-3563-48fe-9a6e-715ad83ca92b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:28.611279 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efc7ad-3563-48fe-9a6e-715ad83ca92b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-31efc7ad-3563-48fe-9a6e-715ad83ca92b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:28.626739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:28.628037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:28.629155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:28.629155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:28.629155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:28.629155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 626/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:28.635660 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f07eb-1f3d-4cc4-aa17-a12f85603776 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:28.746182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f07eb-1f3d-4cc4-aa17-a12f85603776 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:28.756320 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:28.783226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba12f62-8d3a-42f2-8d8a-8c547b2243b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:28.784097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba12f62-8d3a-42f2-8d8a-8c547b2243b8 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.784438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba12f62-8d3a-42f2-8d8a-8c547b2243b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.784776 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba12f62-8d3a-42f2-8d8a-8c547b2243b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.785573 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba12f62-8d3a-42f2-8d8a-8c547b2243b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:28.785935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba12f62-8d3a-42f2-8d8a-8c547b2243b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:28.787674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba12f62-8d3a-42f2-8d8a-8c547b2243b8 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:28.801178 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 612/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:28.808049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efc7ad-3563-48fe-9a6e-715ad83ca92b None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:28.916150 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efc7ad-3563-48fe-9a6e-715ad83ca92b None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:28.955211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc6bb3-9da4-4c47-89de-363923082b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:28.956013 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc6bb3-9da4-4c47-89de-363923082b21 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.956149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc6bb3-9da4-4c47-89de-363923082b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.956431 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc6bb3-9da4-4c47-89de-363923082b21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.959409 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:28.966021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc6bb3-9da4-4c47-89de-363923082b21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:28.967724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc6bb3-9da4-4c47-89de-363923082b21 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-bcfc6bb3-9da4-4c47-89de-363923082b21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:28.981138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:28.982388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:28.983546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:28.983546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:28.983546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:28.983546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:28.983546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:28.983546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:28.983546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:28.983546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:28.983546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:53:28.983546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:28.983546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 627/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:28.988951 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba12f62-8d3a-42f2-8d8a-8c547b2243b8 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:29.109245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba12f62-8d3a-42f2-8d8a-8c547b2243b8 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:29.152752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc75f1-c222-46db-8b8f-4ce7df32fa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:29.153482 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc75f1-c222-46db-8b8f-4ce7df32fa85 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:29.153778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc75f1-c222-46db-8b8f-4ce7df32fa85 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:29.154113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc75f1-c222-46db-8b8f-4ce7df32fa85 None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:29.154947 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc75f1-c222-46db-8b8f-4ce7df32fa85 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:29.155245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc75f1-c222-46db-8b8f-4ce7df32fa85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:29.156821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc75f1-c222-46db-8b8f-4ce7df32fa85 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:29.180950 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 613/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Aug 7 00:53:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:29.187883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc6bb3-9da4-4c47-89de-363923082b21 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:29.304924 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc6bb3-9da4-4c47-89de-363923082b21 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:29.344494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff57e4-a921-409e-8f6e-091e53d53240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:29.345110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff57e4-a921-409e-8f6e-091e53d53240 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:29.345391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff57e4-a921-409e-8f6e-091e53d53240 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:29.345670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff57e4-a921-409e-8f6e-091e53d53240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:29.413340 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:29.420826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff57e4-a921-409e-8f6e-091e53d53240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:29.422307 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff57e4-a921-409e-8f6e-091e53d53240 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:29.527738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 628/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:53:29.534016 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc75f1-c222-46db-8b8f-4ce7df32fa85 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:29.567017 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:29.650924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc75f1-c222-46db-8b8f-4ce7df32fa85 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:29.687105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb884f5-84c0-4b37-961b-a382f217b569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:29.687686 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb884f5-84c0-4b37-961b-a382f217b569 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:29.687992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb884f5-84c0-4b37-961b-a382f217b569 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:29.688267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb884f5-84c0-4b37-961b-a382f217b569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:29.699815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb884f5-84c0-4b37-961b-a382f217b569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:29.701332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb884f5-84c0-4b37-961b-a382f217b569 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-4eb884f5-84c0-4b37-961b-a382f217b569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:29.720042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:29.721529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:29.722609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:29.722609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:29.722609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:29.726908 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 614/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:29.727854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff57e4-a921-409e-8f6e-091e53d53240 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:29.839011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:29.846315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff57e4-a921-409e-8f6e-091e53d53240 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:29.896560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61501c3c-8c07-4c80-a94b-1974dc9d6cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:29.897274 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61501c3c-8c07-4c80-a94b-1974dc9d6cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:29.897556 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61501c3c-8c07-4c80-a94b-1974dc9d6cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:29.897844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61501c3c-8c07-4c80-a94b-1974dc9d6cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:29.898560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61501c3c-8c07-4c80-a94b-1974dc9d6cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:29.898950 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61501c3c-8c07-4c80-a94b-1974dc9d6cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:29.900374 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61501c3c-8c07-4c80-a94b-1974dc9d6cb5 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:29.912716 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 629/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:29.918898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb884f5-84c0-4b37-961b-a382f217b569 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:30.012241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:30.036761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb884f5-84c0-4b37-961b-a382f217b569 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:30.072316 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c895c12-0772-4869-bef0-0c9373e15144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:30.072953 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c895c12-0772-4869-bef0-0c9373e15144 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:30.073231 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c895c12-0772-4869-bef0-0c9373e15144 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:30.073498 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c895c12-0772-4869-bef0-0c9373e15144 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:30.080660 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c895c12-0772-4869-bef0-0c9373e15144 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:30.082107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c895c12-0772-4869-bef0-0c9373e15144 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:30.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-7c895c12-0772-4869-bef0-0c9373e15144 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:30.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:30.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:30.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:30.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:30.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:30.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:30.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:30.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:30.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:30.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:30.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:30.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:30.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:30.094393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:30.095662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:30.096781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:30.096781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:30.096781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:30.096781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:30.096781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:30.096781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:30.096781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:30.096781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:30.096781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 615/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:30.102213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61501c3c-8c07-4c80-a94b-1974dc9d6cb5 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:30.222862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61501c3c-8c07-4c80-a94b-1974dc9d6cb5 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:30.274494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d951e7-24c6-4dcb-9edc-ed555fe3da41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:30.275575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d951e7-24c6-4dcb-9edc-ed555fe3da41 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:30.275979 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d951e7-24c6-4dcb-9edc-ed555fe3da41 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:30.276276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d951e7-24c6-4dcb-9edc-ed555fe3da41 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:30.277179 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d951e7-24c6-4dcb-9edc-ed555fe3da41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:30.277491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d951e7-24c6-4dcb-9edc-ed555fe3da41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:30.279304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d951e7-24c6-4dcb-9edc-ed555fe3da41 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:30.294726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 630/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:30.301698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c895c12-0772-4869-bef0-0c9373e15144 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:30.428608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c895c12-0772-4869-bef0-0c9373e15144 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:30.469482 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ff500-6914-45ff-a3b9-eba6594daf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:30.470208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ff500-6914-45ff-a3b9-eba6594daf3a None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:30.470495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ff500-6914-45ff-a3b9-eba6594daf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:30.470840 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ff500-6914-45ff-a3b9-eba6594daf3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:30.471607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ff500-6914-45ff-a3b9-eba6594daf3a None admin] RBAC: Adding query filter params (role.id=05605552a8ef41ce895f7d776aefd260, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=f7d9f23893704741bcc8ced0550c0391) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:30.471924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ff500-6914-45ff-a3b9-eba6594daf3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:30.473612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ff500-6914-45ff-a3b9-eba6594daf3a None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:30.481436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 616/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:30 2022] GET /identity/v3/role_assignments?user.id=f7d9f23893704741bcc8ced0550c0391&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=05605552a8ef41ce895f7d776aefd260 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:32.844669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2b07-b1b8-452a-a865-aa54c3c4b699 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:32.845253 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2b07-b1b8-452a-a865-aa54c3c4b699 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:32.845253 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2b07-b1b8-452a-a865-aa54c3c4b699 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:32.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 631/1247] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:53:32.854428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170056f6-5318-4cc8-85b1-bea9ad8969e4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:32.855057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170056f6-5318-4cc8-85b1-bea9ad8969e4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:32.855373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170056f6-5318-4cc8-85b1-bea9ad8969e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:32.864617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:32.878838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-170056f6-5318-4cc8-85b1-bea9ad8969e4 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:32.880894 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-170056f6-5318-4cc8-85b1-bea9ad8969e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:32.969205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 617/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:32.994110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd2b07-b1b8-452a-a865-aa54c3c4b699 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:33.017436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:33.125456 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd2b07-b1b8-452a-a865-aa54c3c4b699 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:33.185850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103e34d-c5b5-448f-ba6e-3cded5830b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:33.187290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103e34d-c5b5-448f-ba6e-3cded5830b3e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:33.187876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103e34d-c5b5-448f-ba6e-3cded5830b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:33.188632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103e34d-c5b5-448f-ba6e-3cded5830b3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:33.204179 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103e34d-c5b5-448f-ba6e-3cded5830b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-c103e34d-c5b5-448f-ba6e-3cded5830b3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:33.212278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:33.213660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:33.214683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:33.214683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:33.214683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:33.214683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:33.214683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:33.214683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:33.214683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:33.214683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:33.214683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:33.214683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:33.214683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:33.214683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:33.218794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 632/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:53:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:33.226817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170056f6-5318-4cc8-85b1-bea9ad8969e4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:33.360163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170056f6-5318-4cc8-85b1-bea9ad8969e4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:33.395807 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:33.402092 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac1287-4614-49fb-84db-a178b543c196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:33.402717 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac1287-4614-49fb-84db-a178b543c196 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:33.402998 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac1287-4614-49fb-84db-a178b543c196 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:33.403355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac1287-4614-49fb-84db-a178b543c196 None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:33.403978 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac1287-4614-49fb-84db-a178b543c196 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:33.404331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac1287-4614-49fb-84db-a178b543c196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:33.405810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac1287-4614-49fb-84db-a178b543c196 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:33.416214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 618/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:53:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:33.424653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103e34d-c5b5-448f-ba6e-3cded5830b3e None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:33.523811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:33.550654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103e34d-c5b5-448f-ba6e-3cded5830b3e None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:33.590890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce8dfb-841f-4cdf-9122-28bf69359f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:33.591530 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce8dfb-841f-4cdf-9122-28bf69359f41 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:33.591823 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce8dfb-841f-4cdf-9122-28bf69359f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:33.592124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce8dfb-841f-4cdf-9122-28bf69359f41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:33.604914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce8dfb-841f-4cdf-9122-28bf69359f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:33.606818 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce8dfb-841f-4cdf-9122-28bf69359f41 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-32ce8dfb-841f-4cdf-9122-28bf69359f41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:33.625710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:33.626831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:33.627801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:33.627801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:33.627801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:33.627801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 633/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:33.635409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac1287-4614-49fb-84db-a178b543c196 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:33.766452 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac1287-4614-49fb-84db-a178b543c196 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:33.804773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7d5e5-e783-47a5-bd24-b7d6ca55102b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:33.805320 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7d5e5-e783-47a5-bd24-b7d6ca55102b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:33.805651 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7d5e5-e783-47a5-bd24-b7d6ca55102b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:33.805891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7d5e5-e783-47a5-bd24-b7d6ca55102b None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:33.806523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7d5e5-e783-47a5-bd24-b7d6ca55102b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:33.806825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7d5e5-e783-47a5-bd24-b7d6ca55102b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:33.808232 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7d5e5-e783-47a5-bd24-b7d6ca55102b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:33.823117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 619/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:33.829239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce8dfb-841f-4cdf-9122-28bf69359f41 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:33.948803 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce8dfb-841f-4cdf-9122-28bf69359f41 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:33.984784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:33.996561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3da32e-8300-41c2-b0a3-58d6de8c7844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:33.997213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3da32e-8300-41c2-b0a3-58d6de8c7844 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:33.997527 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3da32e-8300-41c2-b0a3-58d6de8c7844 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:33.998277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3da32e-8300-41c2-b0a3-58d6de8c7844 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:34.006572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3da32e-8300-41c2-b0a3-58d6de8c7844 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:34.008648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3da32e-8300-41c2-b0a3-58d6de8c7844 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-8d3da32e-8300-41c2-b0a3-58d6de8c7844 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:34.028044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:34.029126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:34.030092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:34.030092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:34.030092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:34.030092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:34.030092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:34.030092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:34.030092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:34.030092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:34.030092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:53:34.030092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:34.030092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 634/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:34.035560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7d5e5-e783-47a5-bd24-b7d6ca55102b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:34.105417 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:34.163019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7d5e5-e783-47a5-bd24-b7d6ca55102b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:34.202201 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540b648-5efe-4826-b083-78812725de5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:34.202990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540b648-5efe-4826-b083-78812725de5c None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:34.203183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540b648-5efe-4826-b083-78812725de5c None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:34.203443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540b648-5efe-4826-b083-78812725de5c None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:34.204343 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540b648-5efe-4826-b083-78812725de5c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:34.204697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540b648-5efe-4826-b083-78812725de5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:34.206364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540b648-5efe-4826-b083-78812725de5c None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:34.227233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 620/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Aug 7 00:53:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:34.233700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3da32e-8300-41c2-b0a3-58d6de8c7844 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:34.353267 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3da32e-8300-41c2-b0a3-58d6de8c7844 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:34.390981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd0546-2083-4174-a4b6-b900944fa44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:34.391532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd0546-2083-4174-a4b6-b900944fa44e None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:34.391811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd0546-2083-4174-a4b6-b900944fa44e None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:34.392114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd0546-2083-4174-a4b6-b900944fa44e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:34.469647 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:34.485553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd0546-2083-4174-a4b6-b900944fa44e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:34.487191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd0546-2083-4174-a4b6-b900944fa44e None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:34.621564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 635/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 00:53:34.628572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540b648-5efe-4826-b083-78812725de5c None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:34.760770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540b648-5efe-4826-b083-78812725de5c None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:34.776409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:34.807616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97caad-1253-4982-bf8d-5e6db2ed0913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:34.808313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97caad-1253-4982-bf8d-5e6db2ed0913 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:34.808606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97caad-1253-4982-bf8d-5e6db2ed0913 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:34.808883 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97caad-1253-4982-bf8d-5e6db2ed0913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:34.822340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97caad-1253-4982-bf8d-5e6db2ed0913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:34.824950 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97caad-1253-4982-bf8d-5e6db2ed0913 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-1e97caad-1253-4982-bf8d-5e6db2ed0913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:34.846810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:34.848596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:34.850409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:34.850409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:34.850409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:34.850409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 621/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:34.855136 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd0546-2083-4174-a4b6-b900944fa44e None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:34.979728 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:34.997995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd0546-2083-4174-a4b6-b900944fa44e None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:35.048929 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802c965-999c-4a5e-b822-ecc8bf3e2c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:35.049615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802c965-999c-4a5e-b822-ecc8bf3e2c9a None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:35.049855 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802c965-999c-4a5e-b822-ecc8bf3e2c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:35.050110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802c965-999c-4a5e-b822-ecc8bf3e2c9a None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:35.050806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802c965-999c-4a5e-b822-ecc8bf3e2c9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:35.051125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802c965-999c-4a5e-b822-ecc8bf3e2c9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:35.052543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802c965-999c-4a5e-b822-ecc8bf3e2c9a None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:35.066427 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 636/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:35.073204 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97caad-1253-4982-bf8d-5e6db2ed0913 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:35.206941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97caad-1253-4982-bf8d-5e6db2ed0913 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:35.252065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b164403-9c3f-4f64-b688-bbded42cc8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:35.252908 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b164403-9c3f-4f64-b688-bbded42cc8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:35.253299 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b164403-9c3f-4f64-b688-bbded42cc8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:35.253666 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b164403-9c3f-4f64-b688-bbded42cc8b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:35.261639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b164403-9c3f-4f64-b688-bbded42cc8b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:35.263131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b164403-9c3f-4f64-b688-bbded42cc8b5 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:35.279205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-6b164403-9c3f-4f64-b688-bbded42cc8b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:35.279205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:35.279205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:35.279205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:35.279205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:35.279205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:35.279205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:35.279205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:35.279205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:35.279205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:35.279205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:35.279205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:35.279205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:35.279205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:35.279205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:35.281434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:35.283608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:35.283608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:35.283608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:35.283608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:35.283608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:35.283608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:35.283608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:35.283608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:35.283608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 622/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:35.289365 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802c965-999c-4a5e-b822-ecc8bf3e2c9a None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:35.437157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802c965-999c-4a5e-b822-ecc8bf3e2c9a None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:35.493449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b3a61-2c05-44bf-b806-8b26bcefbc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:35.494430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b3a61-2c05-44bf-b806-8b26bcefbc29 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:35.494895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b3a61-2c05-44bf-b806-8b26bcefbc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:35.495360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b3a61-2c05-44bf-b806-8b26bcefbc29 None admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:35.496621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b3a61-2c05-44bf-b806-8b26bcefbc29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:35.497149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b3a61-2c05-44bf-b806-8b26bcefbc29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:35.499556 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b3a61-2c05-44bf-b806-8b26bcefbc29 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:35.527621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 637/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:35.531704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b164403-9c3f-4f64-b688-bbded42cc8b5 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:35.563451 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:35.680090 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b164403-9c3f-4f64-b688-bbded42cc8b5 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:35.725874 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa66e4-d64f-4de0-97d0-e62d30cdcd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:35.726745 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa66e4-d64f-4de0-97d0-e62d30cdcd25 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:35.727075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa66e4-d64f-4de0-97d0-e62d30cdcd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:35.727396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa66e4-d64f-4de0-97d0-e62d30cdcd25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:35.728340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa66e4-d64f-4de0-97d0-e62d30cdcd25 None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=f7d9f23893704741bcc8ced0550c0391) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:35.728731 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa66e4-d64f-4de0-97d0-e62d30cdcd25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:35.730458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa66e4-d64f-4de0-97d0-e62d30cdcd25 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:35.743130 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 623/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:35 2022] GET /identity/v3/role_assignments?user.id=f7d9f23893704741bcc8ced0550c0391&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=638e1fc82db44124ae615c46408110a7 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:37.839586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779333-7383-4115-b366-e4f94cb3e587 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:37.840135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779333-7383-4115-b366-e4f94cb3e587 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:37.840135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779333-7383-4115-b366-e4f94cb3e587 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:37.841506 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 638/1261] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:53:37.847015 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac66c0-ecea-4b9d-92d2-b5068f99ecb5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:37.847507 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac66c0-ecea-4b9d-92d2-b5068f99ecb5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:37.847602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac66c0-ecea-4b9d-92d2-b5068f99ecb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:37.867497 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-17ac66c0-ecea-4b9d-92d2-b5068f99ecb5 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:37.868739 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-17ac66c0-ecea-4b9d-92d2-b5068f99ecb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:37.945558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 624/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:37.969131 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd779333-7383-4115-b366-e4f94cb3e587 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:37.983568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:38.089733 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd779333-7383-4115-b366-e4f94cb3e587 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:38.126277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b808d-77bd-424f-bbeb-84b1cc085e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:38.126907 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b808d-77bd-424f-bbeb-84b1cc085e46 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:38.127186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b808d-77bd-424f-bbeb-84b1cc085e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:38.127459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b808d-77bd-424f-bbeb-84b1cc085e46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:38.141926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b808d-77bd-424f-bbeb-84b1cc085e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-6d6b808d-77bd-424f-bbeb-84b1cc085e46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:38.146593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:38.147725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:38.149067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:38.149067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:38.149067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:38.149067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:38.149067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:38.149067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:38.149067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:38.149067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:38.149067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:38.149067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:38.149067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:38.149067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:38.149067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 639/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:53:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:38.154071 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac66c0-ecea-4b9d-92d2-b5068f99ecb5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:38.173022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:38.280284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac66c0-ecea-4b9d-92d2-b5068f99ecb5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:38.316829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0bbc9-42a5-452d-ba8d-e464471d7e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:38.317450 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0bbc9-42a5-452d-ba8d-e464471d7e2d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:38.317729 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0bbc9-42a5-452d-ba8d-e464471d7e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:38.318004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0bbc9-42a5-452d-ba8d-e464471d7e2d None admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:38.318687 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0bbc9-42a5-452d-ba8d-e464471d7e2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:38.318990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0bbc9-42a5-452d-ba8d-e464471d7e2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:38.321254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0bbc9-42a5-452d-ba8d-e464471d7e2d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:38.330083 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 625/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:53:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:38.336901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b808d-77bd-424f-bbeb-84b1cc085e46 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:38.409092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:38.446242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b808d-77bd-424f-bbeb-84b1cc085e46 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:38.481390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e3b2e-cc08-4013-9e19-aaf3f6dfc892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:38.482023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e3b2e-cc08-4013-9e19-aaf3f6dfc892 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:38.482302 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e3b2e-cc08-4013-9e19-aaf3f6dfc892 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:38.482574 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e3b2e-cc08-4013-9e19-aaf3f6dfc892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:38.495428 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e3b2e-cc08-4013-9e19-aaf3f6dfc892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:38.496934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e3b2e-cc08-4013-9e19-aaf3f6dfc892 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-0d3e3b2e-cc08-4013-9e19-aaf3f6dfc892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:38.513315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:38.515157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:38.517048 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:38.517048 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:38.517048 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:38.517048 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 640/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:38.520888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0bbc9-42a5-452d-ba8d-e464471d7e2d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:38.605092 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:38.627776 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0bbc9-42a5-452d-ba8d-e464471d7e2d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:38.664091 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84872e7b-851a-49f7-9406-3cc3f8e5491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:38.664704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84872e7b-851a-49f7-9406-3cc3f8e5491d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:38.664981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84872e7b-851a-49f7-9406-3cc3f8e5491d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:38.665247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84872e7b-851a-49f7-9406-3cc3f8e5491d None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:38.665888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84872e7b-851a-49f7-9406-3cc3f8e5491d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:38.666187 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84872e7b-851a-49f7-9406-3cc3f8e5491d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:38.667540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84872e7b-851a-49f7-9406-3cc3f8e5491d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:38.679729 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 626/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:38.685493 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e3b2e-cc08-4013-9e19-aaf3f6dfc892 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:38.793037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e3b2e-cc08-4013-9e19-aaf3f6dfc892 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:38.814392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:38.846106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12300ed4-5138-4dbb-bc86-36df40381b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:38.846766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12300ed4-5138-4dbb-bc86-36df40381b02 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:38.846996 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12300ed4-5138-4dbb-bc86-36df40381b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:38.847264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12300ed4-5138-4dbb-bc86-36df40381b02 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:38.855291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12300ed4-5138-4dbb-bc86-36df40381b02 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:38.856696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12300ed4-5138-4dbb-bc86-36df40381b02 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-12300ed4-5138-4dbb-bc86-36df40381b02 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:38.868105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:38.869888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:38.871727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:38.871727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:38.871727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:38.871727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:38.871727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:38.871727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:38.871727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:38.871727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:38.871727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:53:38.871727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:38.871727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 641/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:38.877188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84872e7b-851a-49f7-9406-3cc3f8e5491d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:38.981307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84872e7b-851a-49f7-9406-3cc3f8e5491d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:39.015159 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb45a4b-38a7-42f9-93ca-0a75e55254af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:39.016039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb45a4b-38a7-42f9-93ca-0a75e55254af None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:39.016316 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb45a4b-38a7-42f9-93ca-0a75e55254af None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:39.016583 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb45a4b-38a7-42f9-93ca-0a75e55254af None admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:39.017304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb45a4b-38a7-42f9-93ca-0a75e55254af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:39.017598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb45a4b-38a7-42f9-93ca-0a75e55254af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:39.019002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb45a4b-38a7-42f9-93ca-0a75e55254af None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:39.028112 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:39.036816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 627/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Aug 7 00:53:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:39.043088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12300ed4-5138-4dbb-bc86-36df40381b02 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:39.143186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12300ed4-5138-4dbb-bc86-36df40381b02 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:39.176824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d3482-fd2c-4ca4-9ff6-f91409125a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:39.177468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d3482-fd2c-4ca4-9ff6-f91409125a87 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:39.178038 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d3482-fd2c-4ca4-9ff6-f91409125a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:39.178038 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d3482-fd2c-4ca4-9ff6-f91409125a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:39.189500 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d3482-fd2c-4ca4-9ff6-f91409125a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:39.190952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d3482-fd2c-4ca4-9ff6-f91409125a87 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-243d3482-fd2c-4ca4-9ff6-f91409125a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:39.207139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:39.208535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:39.209736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:39.209736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:39.209736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:39.209736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 642/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:39.215113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb45a4b-38a7-42f9-93ca-0a75e55254af None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:39.332878 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb45a4b-38a7-42f9-93ca-0a75e55254af None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:39.368913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fef0e2-9cd4-4013-acf9-943de3361e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:39.369524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fef0e2-9cd4-4013-acf9-943de3361e0d None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:39.369806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fef0e2-9cd4-4013-acf9-943de3361e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:39.370082 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fef0e2-9cd4-4013-acf9-943de3361e0d None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:39.370731 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fef0e2-9cd4-4013-acf9-943de3361e0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:39.371032 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fef0e2-9cd4-4013-acf9-943de3361e0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:39.372445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fef0e2-9cd4-4013-acf9-943de3361e0d None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:39.384329 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 628/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:39.390324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d3482-fd2c-4ca4-9ff6-f91409125a87 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:39.426005 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:39.499571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d3482-fd2c-4ca4-9ff6-f91409125a87 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:39.536920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34078eb-deeb-4187-917b-7bb81ec23a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:39.537556 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34078eb-deeb-4187-917b-7bb81ec23a30 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:39.537835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34078eb-deeb-4187-917b-7bb81ec23a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:39.538628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34078eb-deeb-4187-917b-7bb81ec23a30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:39.546452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34078eb-deeb-4187-917b-7bb81ec23a30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:39.547937 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34078eb-deeb-4187-917b-7bb81ec23a30 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:39.560611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-c34078eb-deeb-4187-917b-7bb81ec23a30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:39.560611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:39.560611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:39.560611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:39.560611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:39.560611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:39.560611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:39.560611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:39.560611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:39.560611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:39.560611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:39.560611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:39.560611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:39.560611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:39.560611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:39.561766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:39.563021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:39.563021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:39.563021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:39.563021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:39.563021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:39.563021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:39.563021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:39.563021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:39.563021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 643/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:39.570185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fef0e2-9cd4-4013-acf9-943de3361e0d None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:39.635677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:39.681915 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fef0e2-9cd4-4013-acf9-943de3361e0d None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:39.716219 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a030488-04e2-4d80-88bf-cdfa67d84e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:39.716822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030488-04e2-4d80-88bf-cdfa67d84e33 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:39.717103 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030488-04e2-4d80-88bf-cdfa67d84e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:39.717372 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030488-04e2-4d80-88bf-cdfa67d84e33 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:39.718062 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a030488-04e2-4d80-88bf-cdfa67d84e33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:39.718358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a030488-04e2-4d80-88bf-cdfa67d84e33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:39.719769 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a030488-04e2-4d80-88bf-cdfa67d84e33 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:39.733251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 629/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:39.739438 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34078eb-deeb-4187-917b-7bb81ec23a30 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:39.838480 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:39.847836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34078eb-deeb-4187-917b-7bb81ec23a30 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:39.883027 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad8070-acba-4dad-9ab8-ee6218d3afca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:39.883694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8070-acba-4dad-9ab8-ee6218d3afca None admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:39.884001 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8070-acba-4dad-9ab8-ee6218d3afca None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:39.884266 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad8070-acba-4dad-9ab8-ee6218d3afca None admin] PATH_INFO: `/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/f7d9f23893704741bcc8ced0550c0391/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:39.886162 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad8070-acba-4dad-9ab8-ee6218d3afca None admin] RBAC: Authorizing `identity:create_grant(project_id=0b9f64c951f44fd48eedc312b1f33694, user_id=f7d9f23893704741bcc8ced0550c0391, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:39.887603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad8070-acba-4dad-9ab8-ee6218d3afca None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:39.902297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 644/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Aug 7 00:53:39 2022] PUT /identity/v3/projects/0b9f64c951f44fd48eedc312b1f33694/users/f7d9f23893704741bcc8ced0550c0391/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:53:41.930045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab8fd1-4964-4860-8428-2920dfe1db05 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:41.930569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab8fd1-4964-4860-8428-2920dfe1db05 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:41.930569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab8fd1-4964-4860-8428-2920dfe1db05 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:41.931839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 630/1274] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:41.937151 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5dd97-f710-4f6f-b84b-b8d804db4d48 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:41.937613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5dd97-f710-4f6f-b84b-b8d804db4d48 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:41.937714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5dd97-f710-4f6f-b84b-b8d804db4d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:41.956353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-42a5dd97-f710-4f6f-b84b-b8d804db4d48 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:41.957600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-42a5dd97-f710-4f6f-b84b-b8d804db4d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:42.034059 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 645/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:42.058206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab8fd1-4964-4860-8428-2920dfe1db05 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:42.172501 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab8fd1-4964-4860-8428-2920dfe1db05 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:42.192383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:42.211069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03dfac-667b-49da-b960-dfc662c31d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:42.211706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03dfac-667b-49da-b960-dfc662c31d65 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:42.212025 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03dfac-667b-49da-b960-dfc662c31d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:42.212293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03dfac-667b-49da-b960-dfc662c31d65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:42.222870 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03dfac-667b-49da-b960-dfc662c31d65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-7a03dfac-667b-49da-b960-dfc662c31d65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:42.230263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:42.231386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:42.232319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:42.232319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:42.232319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:42.232319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:42.232319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:42.232319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:42.232319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:42.232319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:42.232319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:42.232319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:42.232319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:42.232319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:42.232319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 631/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Aug 7 00:53:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:42.240239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5dd97-f710-4f6f-b84b-b8d804db4d48 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:42.340165 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:42.360581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5dd97-f710-4f6f-b84b-b8d804db4d48 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:42.396518 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea334ab-52c2-444f-a736-b556d432f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:42.397208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea334ab-52c2-444f-a736-b556d432f4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:42.397496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea334ab-52c2-444f-a736-b556d432f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:42.397768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea334ab-52c2-444f-a736-b556d432f4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:42.398601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea334ab-52c2-444f-a736-b556d432f4d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:42.398898 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea334ab-52c2-444f-a736-b556d432f4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:42.400311 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea334ab-52c2-444f-a736-b556d432f4d6 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:42.408777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 646/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Aug 7 00:53:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:42.415047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03dfac-667b-49da-b960-dfc662c31d65 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:42.517027 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03dfac-667b-49da-b960-dfc662c31d65 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:42.553189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4bebe3-3cd9-4cd4-8cae-0dfcaccf0a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:42.554457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4bebe3-3cd9-4cd4-8cae-0dfcaccf0a75 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:42.554741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4bebe3-3cd9-4cd4-8cae-0dfcaccf0a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:42.555012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4bebe3-3cd9-4cd4-8cae-0dfcaccf0a75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:42.569502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4bebe3-3cd9-4cd4-8cae-0dfcaccf0a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:42.570944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4bebe3-3cd9-4cd4-8cae-0dfcaccf0a75 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-be4bebe3-3cd9-4cd4-8cae-0dfcaccf0a75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:42.586263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:42.587941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:42.589182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:42.589182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:42.589182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:42.589182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 632/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:42.595011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea334ab-52c2-444f-a736-b556d432f4d6 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:42.723686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea334ab-52c2-444f-a736-b556d432f4d6 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:42.763523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd886ff-b125-4c90-b6c9-322b31f2d1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:42.764158 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd886ff-b125-4c90-b6c9-322b31f2d1be None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:42.764438 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd886ff-b125-4c90-b6c9-322b31f2d1be None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:42.764710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd886ff-b125-4c90-b6c9-322b31f2d1be None admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:42.765972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd886ff-b125-4c90-b6c9-322b31f2d1be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:42.766516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd886ff-b125-4c90-b6c9-322b31f2d1be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:42.768292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd886ff-b125-4c90-b6c9-322b31f2d1be None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:42.782644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 647/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:42.789668 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4bebe3-3cd9-4cd4-8cae-0dfcaccf0a75 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:42.826073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:42.905662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4bebe3-3cd9-4cd4-8cae-0dfcaccf0a75 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:42.943129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f454f63-f644-4d19-b2ea-1b2d78610cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:42.943814 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454f63-f644-4d19-b2ea-1b2d78610cfc None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:42.944649 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454f63-f644-4d19-b2ea-1b2d78610cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:42.944926 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454f63-f644-4d19-b2ea-1b2d78610cfc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:42.952725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f454f63-f644-4d19-b2ea-1b2d78610cfc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:42.954160 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f454f63-f644-4d19-b2ea-1b2d78610cfc None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-4f454f63-f644-4d19-b2ea-1b2d78610cfc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:42.965702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:42.966902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:42.967971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:42.967971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:42.967971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:42.967971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:42.967971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:42.967971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:42.967971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:42.967971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:42.967971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:53:42.967971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:42.967971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 633/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:42.973263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd886ff-b125-4c90-b6c9-322b31f2d1be None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:42.977865 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:43.086453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd886ff-b125-4c90-b6c9-322b31f2d1be None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:43.123526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae1965-3d1b-4e3f-a390-66c4814381fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:43.124169 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae1965-3d1b-4e3f-a390-66c4814381fb None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:43.124452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae1965-3d1b-4e3f-a390-66c4814381fb None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:43.124726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae1965-3d1b-4e3f-a390-66c4814381fb None admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:43.125463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae1965-3d1b-4e3f-a390-66c4814381fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:43.125774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae1965-3d1b-4e3f-a390-66c4814381fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:43.127215 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae1965-3d1b-4e3f-a390-66c4814381fb None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:43.145175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 648/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Aug 7 00:53:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:43.151639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f454f63-f644-4d19-b2ea-1b2d78610cfc None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:43.247059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:43.258509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f454f63-f644-4d19-b2ea-1b2d78610cfc None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:43.292402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05a166-b832-4dd1-8aff-fb51731e2b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:43.293006 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05a166-b832-4dd1-8aff-fb51731e2b9f None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:43.293291 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05a166-b832-4dd1-8aff-fb51731e2b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:43.293550 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05a166-b832-4dd1-8aff-fb51731e2b9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:43.359321 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05a166-b832-4dd1-8aff-fb51731e2b9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:43.360703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05a166-b832-4dd1-8aff-fb51731e2b9f None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:43.449667 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:43.460653 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 634/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:53:43.466556 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae1965-3d1b-4e3f-a390-66c4814381fb None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:43.529619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:43.570374 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae1965-3d1b-4e3f-a390-66c4814381fb None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:43.605968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb88c8-a733-4eb9-830d-6a277e48aae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:43.606703 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb88c8-a733-4eb9-830d-6a277e48aae3 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:43.606986 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb88c8-a733-4eb9-830d-6a277e48aae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:43.607262 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb88c8-a733-4eb9-830d-6a277e48aae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:43.617388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb88c8-a733-4eb9-830d-6a277e48aae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:43.618772 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb88c8-a733-4eb9-830d-6a277e48aae3 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-6cbb88c8-a733-4eb9-830d-6a277e48aae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:43.632722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:43.633872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:43.634812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:43.634812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:43.634812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:43.634812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 649/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:43.639581 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05a166-b832-4dd1-8aff-fb51731e2b9f None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:43.737325 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05a166-b832-4dd1-8aff-fb51731e2b9f None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:43.770645 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541223ec-12cc-4f10-b09b-c6b0686ab7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:43.771252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541223ec-12cc-4f10-b09b-c6b0686ab7be None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:43.771529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541223ec-12cc-4f10-b09b-c6b0686ab7be None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:43.771800 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541223ec-12cc-4f10-b09b-c6b0686ab7be None admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:43.772995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541223ec-12cc-4f10-b09b-c6b0686ab7be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:43.773295 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541223ec-12cc-4f10-b09b-c6b0686ab7be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:43.774648 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541223ec-12cc-4f10-b09b-c6b0686ab7be None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:43.785573 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 635/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:43.791333 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb88c8-a733-4eb9-830d-6a277e48aae3 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:43.905586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb88c8-a733-4eb9-830d-6a277e48aae3 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:43.919966 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:43.940357 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb6134-eafe-4468-a75f-d852b3c35d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:43.940988 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb6134-eafe-4468-a75f-d852b3c35d43 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:43.941264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb6134-eafe-4468-a75f-d852b3c35d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:43.941534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb6134-eafe-4468-a75f-d852b3c35d43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:43.948465 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb6134-eafe-4468-a75f-d852b3c35d43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:43.949915 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb6134-eafe-4468-a75f-d852b3c35d43 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:43.961188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application [None req-56cb6134-eafe-4468-a75f-d852b3c35d43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:43.961188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:43.961188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:43.961188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:43.961188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:43.961188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:43.961188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:43.961188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:43.961188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:43.961188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:43.961188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:43.961188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:43.961188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:43.961188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:43.961188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:43.962314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:43.963349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:43.963349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:43.963349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:43.963349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:43.963349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:43.963349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:43.963349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:43.963349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: ERROR keystone.server.flask.application Aug 07 00:53:43.963349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 650/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:43.968404 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541223ec-12cc-4f10-b09b-c6b0686ab7be None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:44.019849 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:44.071476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541223ec-12cc-4f10-b09b-c6b0686ab7be None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:44.111623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa332ef-c830-437a-80c2-49d9893e87f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:44.112264 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa332ef-c830-437a-80c2-49d9893e87f2 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:44.112540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa332ef-c830-437a-80c2-49d9893e87f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:44.112811 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa332ef-c830-437a-80c2-49d9893e87f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:44.113500 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa332ef-c830-437a-80c2-49d9893e87f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:44.113804 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa332ef-c830-437a-80c2-49d9893e87f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:44.115223 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa332ef-c830-437a-80c2-49d9893e87f2 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:44.129831 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 636/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:44.134978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb6134-eafe-4468-a75f-d852b3c35d43 None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:44.237621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb6134-eafe-4468-a75f-d852b3c35d43 None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:44.278403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f5718-0677-447d-a99d-e5dc461c9023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:44.279004 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f5718-0677-447d-a99d-e5dc461c9023 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:44.279285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f5718-0677-447d-a99d-e5dc461c9023 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:44.279562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f5718-0677-447d-a99d-e5dc461c9023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:44.280327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f5718-0677-447d-a99d-e5dc461c9023 None admin] RBAC: Adding query filter params (role.id=638e1fc82db44124ae615c46408110a7, scope.project.id=0b9f64c951f44fd48eedc312b1f33694, user.id=f7d9f23893704741bcc8ced0550c0391) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:44.280640 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f5718-0677-447d-a99d-e5dc461c9023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:44.282081 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f5718-0677-447d-a99d-e5dc461c9023 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:44.288169 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 651/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:44 2022] GET /identity/v3/role_assignments?user.id=f7d9f23893704741bcc8ced0550c0391&scope.project.id=0b9f64c951f44fd48eedc312b1f33694&role.id=638e1fc82db44124ae615c46408110a7 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:46.335937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407397f-f549-456e-8430-b863be9c0ebb None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:46.336512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407397f-f549-456e-8430-b863be9c0ebb None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:46.336512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407397f-f549-456e-8430-b863be9c0ebb None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:46.337826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 637/1288] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:46.343214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff49a4-e389-4f25-aba0-b09b271f0a11 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:46.343666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff49a4-e389-4f25-aba0-b09b271f0a11 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:46.343771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff49a4-e389-4f25-aba0-b09b271f0a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:46.362104 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-f9ff49a4-e389-4f25-aba0-b09b271f0a11 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:46.363296 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f9ff49a4-e389-4f25-aba0-b09b271f0a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:46.394151 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:46.432787 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 652/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:46.455397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407397f-f549-456e-8430-b863be9c0ebb None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:46.560319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407397f-f549-456e-8430-b863be9c0ebb None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:46.572236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:46.595690 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b526a52-930a-483c-ae07-c770803d1fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:46.596267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b526a52-930a-483c-ae07-c770803d1fea None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:46.596552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b526a52-930a-483c-ae07-c770803d1fea None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:46.596823 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b526a52-930a-483c-ae07-c770803d1fea None admin] PATH_INFO: `/v3/services/placement` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:46.597401 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b526a52-930a-483c-ae07-c770803d1fea None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:46.598749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b526a52-930a-483c-ae07-c770803d1fea None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-9b526a52-930a-483c-ae07-c770803d1fea None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:46.607555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:46.608854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:46.609918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:46.609918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:46.609918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:46.609918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:46.609918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:46.609918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:46.609918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:46.609918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:46.609918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:46.609918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:46.609918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:46.609918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:46.609918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:53:46.609918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:46.609918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 638/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Aug 7 00:53:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:46.614714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff49a4-e389-4f25-aba0-b09b271f0a11 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:46.718028 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff49a4-e389-4f25-aba0-b09b271f0a11 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:46.752449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85342fe6-b715-4cb9-8979-adf7216ce416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:46.753051 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85342fe6-b715-4cb9-8979-adf7216ce416 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:46.753950 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85342fe6-b715-4cb9-8979-adf7216ce416 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:46.753950 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85342fe6-b715-4cb9-8979-adf7216ce416 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:46.754212 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85342fe6-b715-4cb9-8979-adf7216ce416 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:46.754509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85342fe6-b715-4cb9-8979-adf7216ce416 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:46.755870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85342fe6-b715-4cb9-8979-adf7216ce416 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:46.760835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 653/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Aug 7 00:53:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:46.766897 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b526a52-930a-483c-ae07-c770803d1fea None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:46.866289 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b526a52-930a-483c-ae07-c770803d1fea None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:46.899121 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec191b28-a8a5-426e-a290-10bb51954103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:46.899720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec191b28-a8a5-426e-a290-10bb51954103 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:46.900045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec191b28-a8a5-426e-a290-10bb51954103 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:46.900317 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec191b28-a8a5-426e-a290-10bb51954103 None admin] PATH_INFO: `/v3/services` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:46.900942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec191b28-a8a5-426e-a290-10bb51954103 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:46.901243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec191b28-a8a5-426e-a290-10bb51954103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:46.902598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec191b28-a8a5-426e-a290-10bb51954103 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:46.907015 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 639/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Aug 7 00:53:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:48.909824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94191a63-aa73-42be-80d8-3383378fb8fb None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:48.910351 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94191a63-aa73-42be-80d8-3383378fb8fb None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:48.910351 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94191a63-aa73-42be-80d8-3383378fb8fb None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:48.911631 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 654/1293] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:48.917113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c5851-8c5f-4218-a0c7-ed122ccf34ef None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:48.917542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c5851-8c5f-4218-a0c7-ed122ccf34ef None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:48.917647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c5851-8c5f-4218-a0c7-ed122ccf34ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:48.936012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-8d3c5851-8c5f-4218-a0c7-ed122ccf34ef None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:48.937204 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8d3c5851-8c5f-4218-a0c7-ed122ccf34ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:48.970096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:49.026119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 640/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:49.049200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94191a63-aa73-42be-80d8-3383378fb8fb None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:49.081849 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:49.158432 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94191a63-aa73-42be-80d8-3383378fb8fb None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:49.193195 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36631db7-ee33-40d8-994d-fb3c78d59a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:49.194704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36631db7-ee33-40d8-994d-fb3c78d59a88 None admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:49.194999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36631db7-ee33-40d8-994d-fb3c78d59a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:49.195272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36631db7-ee33-40d8-994d-fb3c78d59a88 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:49.195943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36631db7-ee33-40d8-994d-fb3c78d59a88 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:49.197317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36631db7-ee33-40d8-994d-fb3c78d59a88 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:49.212615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 655/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Aug 7 00:53:49 2022] POST /identity/v3/services => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:53:51.289346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d750234-fe58-4aa3-9524-1169f2bf9e6b None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:51.289919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d750234-fe58-4aa3-9524-1169f2bf9e6b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:51.289919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d750234-fe58-4aa3-9524-1169f2bf9e6b None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:51.291218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 641/1296] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:51.296527 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7820f0-475f-4078-80ea-2adccbef18cb None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:51.296988 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7820f0-475f-4078-80ea-2adccbef18cb None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:51.297105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7820f0-475f-4078-80ea-2adccbef18cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:51.314732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5f7820f0-475f-4078-80ea-2adccbef18cb None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:51.315925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5f7820f0-475f-4078-80ea-2adccbef18cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:51.389158 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 656/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:51.412718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d750234-fe58-4aa3-9524-1169f2bf9e6b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:51.517271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d750234-fe58-4aa3-9524-1169f2bf9e6b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:51.551490 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b3f48-c826-43ac-a1e9-91f2c240a34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:51.552071 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b3f48-c826-43ac-a1e9-91f2c240a34b None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:51.552354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b3f48-c826-43ac-a1e9-91f2c240a34b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:51.552629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b3f48-c826-43ac-a1e9-91f2c240a34b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:51.554181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b3f48-c826-43ac-a1e9-91f2c240a34b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:51.555553 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b3f48-c826-43ac-a1e9-91f2c240a34b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-1d8b3f48-c826-43ac-a1e9-91f2c240a34b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:51.564057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:51.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:51.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:51.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:51.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:51.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:51.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:51.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:51.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:51.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:51.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:51.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:51.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:51.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:51.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:53:51.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:51.566065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 642/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Aug 7 00:53:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:51.571407 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7820f0-475f-4078-80ea-2adccbef18cb None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:51.594622 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:51.696254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7820f0-475f-4078-80ea-2adccbef18cb None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:51.730953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8538c-338f-4e35-ba21-96e2dc020d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:51.731555 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8538c-338f-4e35-ba21-96e2dc020d5f None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:51.731834 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8538c-338f-4e35-ba21-96e2dc020d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:51.732137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8538c-338f-4e35-ba21-96e2dc020d5f None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:51.732767 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8538c-338f-4e35-ba21-96e2dc020d5f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:51.733066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8538c-338f-4e35-ba21-96e2dc020d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:51.734442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8538c-338f-4e35-ba21-96e2dc020d5f None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:51.739702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 657/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Aug 7 00:53:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:51.746424 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b3f48-c826-43ac-a1e9-91f2c240a34b None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:51.778794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:51.851246 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b3f48-c826-43ac-a1e9-91f2c240a34b None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:51.885383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e065bda-508b-474a-91e5-fcc93be987ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:51.885989 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e065bda-508b-474a-91e5-fcc93be987ba None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:51.886272 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e065bda-508b-474a-91e5-fcc93be987ba None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:51.886546 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e065bda-508b-474a-91e5-fcc93be987ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:51.887253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e065bda-508b-474a-91e5-fcc93be987ba None admin] RBAC: Adding query filter params (interface=public, service_id=04fa2fa90e2b499380d6cc9142dd3ed8, region_id=RegionOne) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:51.887560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e065bda-508b-474a-91e5-fcc93be987ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:51.888954 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e065bda-508b-474a-91e5-fcc93be987ba None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:51.894380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 643/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Aug 7 00:53:51 2022] GET /identity/v3/endpoints?service_id=04fa2fa90e2b499380d6cc9142dd3ed8&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:51.900283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8538c-338f-4e35-ba21-96e2dc020d5f None admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:51.983756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:52.002502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8538c-338f-4e35-ba21-96e2dc020d5f None admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:52.038225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cefd7b-6af2-40f9-9cfc-cbd52abb1ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:52.038951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cefd7b-6af2-40f9-9cfc-cbd52abb1ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:52.039231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cefd7b-6af2-40f9-9cfc-cbd52abb1ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:52.039508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cefd7b-6af2-40f9-9cfc-cbd52abb1ab2 None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:52.040144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cefd7b-6af2-40f9-9cfc-cbd52abb1ab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:52.041512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cefd7b-6af2-40f9-9cfc-cbd52abb1ab2 None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:52.048350 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 658/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Aug 7 00:53:51 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:53:54.101172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9cea0-e1cc-4d43-bb57-04a0b755f44b None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:54.101758 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9cea0-e1cc-4d43-bb57-04a0b755f44b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:54.101758 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9cea0-e1cc-4d43-bb57-04a0b755f44b None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:54.103085 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 644/1302] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:54.108610 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ad58f-ceeb-437f-9e1b-7ac56de3ba79 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:54.109137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ad58f-ceeb-437f-9e1b-7ac56de3ba79 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:54.109137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ad58f-ceeb-437f-9e1b-7ac56de3ba79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:54.128495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c76ad58f-ceeb-437f-9e1b-7ac56de3ba79 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:54.129739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c76ad58f-ceeb-437f-9e1b-7ac56de3ba79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:54.200698 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 659/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:54.224257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9cea0-e1cc-4d43-bb57-04a0b755f44b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:54.324968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:54.331896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9cea0-e1cc-4d43-bb57-04a0b755f44b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:54.366967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f844d7-2612-4e6a-882f-054ce89b3a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:54.367510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f844d7-2612-4e6a-882f-054ce89b3a70 None admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:54.367786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f844d7-2612-4e6a-882f-054ce89b3a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:54.368087 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f844d7-2612-4e6a-882f-054ce89b3a70 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:54.368668 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f844d7-2612-4e6a-882f-054ce89b3a70 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:54.370022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f844d7-2612-4e6a-882f-054ce89b3a70 None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application [None req-10f844d7-2612-4e6a-882f-054ce89b3a70 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:54.378612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:54.379817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:54.380962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:54.380962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:54.380962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:54.380962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:54.380962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:54.380962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:54.380962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:54.380962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:54.380962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:54.380962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:54.380962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:54.380962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:54.380962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:53:54.380962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: ERROR keystone.server.flask.application Aug 07 00:53:54.380962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 645/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Aug 7 00:53:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:54.385978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ad58f-ceeb-437f-9e1b-7ac56de3ba79 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:54.462529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:54.485296 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ad58f-ceeb-437f-9e1b-7ac56de3ba79 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:54.520517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148f3e7-1405-497b-a8e7-3a1be5c65a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:54.521126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148f3e7-1405-497b-a8e7-3a1be5c65a2b None admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:54.521481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148f3e7-1405-497b-a8e7-3a1be5c65a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:54.521799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148f3e7-1405-497b-a8e7-3a1be5c65a2b None admin] PATH_INFO: `/v3/services` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:54.522445 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148f3e7-1405-497b-a8e7-3a1be5c65a2b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:54.522745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148f3e7-1405-497b-a8e7-3a1be5c65a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:54.524141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148f3e7-1405-497b-a8e7-3a1be5c65a2b None admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:54.529378 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 660/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Aug 7 00:53:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:54.535376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f844d7-2612-4e6a-882f-054ce89b3a70 None admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:54.638997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f844d7-2612-4e6a-882f-054ce89b3a70 None admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:54.675023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1df483-b2b6-486a-b90f-decb0585d50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:54.675637 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1df483-b2b6-486a-b90f-decb0585d50b None admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:54.675937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1df483-b2b6-486a-b90f-decb0585d50b None admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:54.676212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1df483-b2b6-486a-b90f-decb0585d50b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:54.676871 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1df483-b2b6-486a-b90f-decb0585d50b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:54.679244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1df483-b2b6-486a-b90f-decb0585d50b None admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:54.700169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 646/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 00:53:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:54:04.527143 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=30 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:04.695593 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:03.269084 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fa6bd-ba18-4e90-a4a3-40f2b61cce0c None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:03.269540 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fa6bd-ba18-4e90-a4a3-40f2b61cce0c None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:03.269540 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fa6bd-ba18-4e90-a4a3-40f2b61cce0c None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:03.271331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 661/1307] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:55:03.279384 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db5b40-b68f-499d-8a90-533290b5ef44 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:03.279831 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db5b40-b68f-499d-8a90-533290b5ef44 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:03.280339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db5b40-b68f-499d-8a90-533290b5ef44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:03.432174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b3db5b40-b68f-499d-8a90-533290b5ef44 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:03.434088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b3db5b40-b68f-499d-8a90-533290b5ef44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:03.569024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 647/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:55:03.660018 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0cbb0-e8f1-4e42-98da-f9b356711f7d None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:03.660931 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0cbb0-e8f1-4e42-98da-f9b356711f7d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:03.661647 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0cbb0-e8f1-4e42-98da-f9b356711f7d None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:03.664662 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 662/1309] 10.222.0.20 () {54 vars in 965 bytes} [Sun Aug 7 00:55:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:55:03.671349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c1f95-1596-48a0-b0e3-ddcfb800abdb None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:03.671637 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c1f95-1596-48a0-b0e3-ddcfb800abdb None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:03.672044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c1f95-1596-48a0-b0e3-ddcfb800abdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:03.789192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c78c1f95-1596-48a0-b0e3-ddcfb800abdb None None] MFA Rules not processed for user `e393d9c50bbb4f69a48ae635d13b1197`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:03.791550 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c78c1f95-1596-48a0-b0e3-ddcfb800abdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:03.836222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:03.938362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 648/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Sun Aug 7 00:55:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:55:03.938882 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0cbb0-e8f1-4e42-98da-f9b356711f7d None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:03.942737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a0a0cbb0-e8f1-4e42-98da-f9b356711f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:04.114209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0cbb0-e8f1-4e42-98da-f9b356711f7d None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:04.221422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a171bd-604c-4f97-8248-293f84784cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:04.222074 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a171bd-604c-4f97-8248-293f84784cdb service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:04.222525 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a171bd-604c-4f97-8248-293f84784cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:04.222792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a171bd-604c-4f97-8248-293f84784cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:04.224650 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-59a171bd-604c-4f97-8248-293f84784cdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:04.334338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:04.465686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a171bd-604c-4f97-8248-293f84784cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:04.469873 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a171bd-604c-4f97-8248-293f84784cdb service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:04.511519 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 663/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:55:07.093728 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8975669-b0fe-45ad-b7fa-61ffb7c7da05 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:07.094529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8975669-b0fe-45ad-b7fa-61ffb7c7da05 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:07.094529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8975669-b0fe-45ad-b7fa-61ffb7c7da05 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:07.096134 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 649/1312] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:55:07.102746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5feae8-686a-4fd9-a1a2-f32314ce0903 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:07.103346 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5feae8-686a-4fd9-a1a2-f32314ce0903 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:07.103741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5feae8-686a-4fd9-a1a2-f32314ce0903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:07.210745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3a5feae8-686a-4fd9-a1a2-f32314ce0903 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:07.212234 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3a5feae8-686a-4fd9-a1a2-f32314ce0903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:07.334912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 664/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:55:07.378358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8975669-b0fe-45ad-b7fa-61ffb7c7da05 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:07.381994 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b8975669-b0fe-45ad-b7fa-61ffb7c7da05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:07.542008 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8975669-b0fe-45ad-b7fa-61ffb7c7da05 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:07.636675 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:07.641433 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ab21e-38f9-43bc-a47e-cd955fbc70e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:07.642474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ab21e-38f9-43bc-a47e-cd955fbc70e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:07.643167 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ab21e-38f9-43bc-a47e-cd955fbc70e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:07.643574 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ab21e-38f9-43bc-a47e-cd955fbc70e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:07.645873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-648ab21e-38f9-43bc-a47e-cd955fbc70e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:07.777051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ab21e-38f9-43bc-a47e-cd955fbc70e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:07.778488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ab21e-38f9-43bc-a47e-cd955fbc70e9 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:07.800146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 650/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:55:10.214910 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3cffa-bb21-4d46-877a-fe753247ae3e None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:10.215492 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3cffa-bb21-4d46-877a-fe753247ae3e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:10.215492 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3cffa-bb21-4d46-877a-fe753247ae3e None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:10.216893 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 665/1315] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:55:10.223434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69b385-e799-471a-8492-7da984b62bad None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:10.223990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69b385-e799-471a-8492-7da984b62bad None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:10.224088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69b385-e799-471a-8492-7da984b62bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:10.295116 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4f69b385-e799-471a-8492-7da984b62bad None None] MFA Rules not processed for user `2bf11b0baf04484ca570c05d33f49c63`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:10.296454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4f69b385-e799-471a-8492-7da984b62bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:10.349959 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:10.397059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 651/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:10 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:55:10.438572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3cffa-bb21-4d46-877a-fe753247ae3e None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:10.440774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a1c3cffa-bb21-4d46-877a-fe753247ae3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:10.450419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:10.557974 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3cffa-bb21-4d46-877a-fe753247ae3e None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:10.640054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de481176-b9af-49e0-977e-a6da1d52f68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:10.640685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de481176-b9af-49e0-977e-a6da1d52f68d service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:10.640967 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de481176-b9af-49e0-977e-a6da1d52f68d service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:10.641236 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de481176-b9af-49e0-977e-a6da1d52f68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:10.643784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-de481176-b9af-49e0-977e-a6da1d52f68d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:10.714581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:10.770863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de481176-b9af-49e0-977e-a6da1d52f68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:10.772370 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de481176-b9af-49e0-977e-a6da1d52f68d service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:10.792143 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 666/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:55:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:55:13.487322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e67b4-0f28-426e-9eed-84c37ac1c4dc None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:13.488008 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e67b4-0f28-426e-9eed-84c37ac1c4dc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:13.488008 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e67b4-0f28-426e-9eed-84c37ac1c4dc None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:13.489268 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 652/1318] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:55:13.494935 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cded035-b1aa-4707-b5b6-cde355aa57c5 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:13.495434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cded035-b1aa-4707-b5b6-cde355aa57c5 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:13.495542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cded035-b1aa-4707-b5b6-cde355aa57c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:13.570068 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-8cded035-b1aa-4707-b5b6-cde355aa57c5 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:13.571295 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8cded035-b1aa-4707-b5b6-cde355aa57c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:13.673239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 667/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:55:13.712691 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e67b4-0f28-426e-9eed-84c37ac1c4dc None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:13.714395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3a5e67b4-0f28-426e-9eed-84c37ac1c4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:13.827071 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e67b4-0f28-426e-9eed-84c37ac1c4dc None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:13.911371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eaeb21-12ba-451e-8b38-3e5295b4239f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:13.912038 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaeb21-12ba-451e-8b38-3e5295b4239f service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:13.912320 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaeb21-12ba-451e-8b38-3e5295b4239f service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:13.912594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaeb21-12ba-451e-8b38-3e5295b4239f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:13.914294 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e0eaeb21-12ba-451e-8b38-3e5295b4239f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:13.922623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:14.034208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eaeb21-12ba-451e-8b38-3e5295b4239f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:14.038732 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eaeb21-12ba-451e-8b38-3e5295b4239f service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:14.057427 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 653/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:55:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:55:17.261486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a079-e250-4acb-8385-17aa85215d71 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:17.262390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a079-e250-4acb-8385-17aa85215d71 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:17.262390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774a079-e250-4acb-8385-17aa85215d71 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:17.263717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 668/1321] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:55:17.269947 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe3e4e-4fa7-4497-bcc9-466a13e58750 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:17.270829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe3e4e-4fa7-4497-bcc9-466a13e58750 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:17.270829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe3e4e-4fa7-4497-bcc9-466a13e58750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:17.355488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4afe3e4e-4fa7-4497-bcc9-466a13e58750 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:17.356783 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4afe3e4e-4fa7-4497-bcc9-466a13e58750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:17.436549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:17.488111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 654/1322] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:55:17.542947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafce8bd-8ede-4ba4-8836-534b1cdc4456 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:17.543442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafce8bd-8ede-4ba4-8836-534b1cdc4456 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:17.543865 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafce8bd-8ede-4ba4-8836-534b1cdc4456 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:17.545516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 669/1323] 10.222.0.20 () {54 vars in 965 bytes} [Sun Aug 7 00:55:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:55:17.557731 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc21e2-47c1-42b6-9c81-e4ee4a371c1f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:17.558107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc21e2-47c1-42b6-9c81-e4ee4a371c1f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:17.558393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc21e2-47c1-42b6-9c81-e4ee4a371c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:17.648310 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-bbfc21e2-47c1-42b6-9c81-e4ee4a371c1f None None] MFA Rules not processed for user `e393d9c50bbb4f69a48ae635d13b1197`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:17.649549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bbfc21e2-47c1-42b6-9c81-e4ee4a371c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:17.734182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 655/1324] 10.222.0.20 () {58 vars in 1062 bytes} [Sun Aug 7 00:55:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:55:17.744091 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafce8bd-8ede-4ba4-8836-534b1cdc4456 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:17.745749 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-cafce8bd-8ede-4ba4-8836-534b1cdc4456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:17.771778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:17.876608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafce8bd-8ede-4ba4-8836-534b1cdc4456 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:17.970272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aeb6aa-8736-4285-9d8b-f93c66f83bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:17.970932 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aeb6aa-8736-4285-9d8b-f93c66f83bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:17.971215 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aeb6aa-8736-4285-9d8b-f93c66f83bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:17.971491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aeb6aa-8736-4285-9d8b-f93c66f83bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:17.973277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-15aeb6aa-8736-4285-9d8b-f93c66f83bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:18.056999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:18.101473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aeb6aa-8736-4285-9d8b-f93c66f83bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:18.103297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aeb6aa-8736-4285-9d8b-f93c66f83bb4 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:18.127481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 670/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:55:20.550512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84dded-ca65-42b9-8abb-7e692fdcba51 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:20.551313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84dded-ca65-42b9-8abb-7e692fdcba51 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:20.551313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84dded-ca65-42b9-8abb-7e692fdcba51 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:20.552803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 656/1326] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:55:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:55:20.559356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c8530-51d4-4862-adef-e81e7c9d3fe6 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:20.559356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c8530-51d4-4862-adef-e81e7c9d3fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:20.559356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c8530-51d4-4862-adef-e81e7c9d3fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:20.640808 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-002c8530-51d4-4862-adef-e81e7c9d3fe6 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:20.642375 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-002c8530-51d4-4862-adef-e81e7c9d3fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:20.763600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 671/1327] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:55:20.804900 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84dded-ca65-42b9-8abb-7e692fdcba51 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:20.806674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ec84dded-ca65-42b9-8abb-7e692fdcba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:20.882877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:20.937704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84dded-ca65-42b9-8abb-7e692fdcba51 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:21.021170 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2016c51-c8b6-408b-ba10-8168a0bbf8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:21.021784 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2016c51-c8b6-408b-ba10-8168a0bbf8ae service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:21.022058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2016c51-c8b6-408b-ba10-8168a0bbf8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:21.022322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2016c51-c8b6-408b-ba10-8168a0bbf8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:21.023991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d2016c51-c8b6-408b-ba10-8168a0bbf8ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:21.147698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:21.151125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2016c51-c8b6-408b-ba10-8168a0bbf8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:21.153297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2016c51-c8b6-408b-ba10-8168a0bbf8ae service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:21.177359 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 657/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:55:23.333161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a30ac8-b72d-4a64-85b7-d11ddda647d2 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:23.333695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a30ac8-b72d-4a64-85b7-d11ddda647d2 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:23.333778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a30ac8-b72d-4a64-85b7-d11ddda647d2 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:23.335137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 672/1329] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:55:23.340715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9d8b6-8ec7-4c6c-a50a-8d414c4b7660 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:23.341192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9d8b6-8ec7-4c6c-a50a-8d414c4b7660 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:23.341347 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9d8b6-8ec7-4c6c-a50a-8d414c4b7660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:23.444594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6fe9d8b6-8ec7-4c6c-a50a-8d414c4b7660 None None] MFA Rules not processed for user `2bf11b0baf04484ca570c05d33f49c63`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:23.445858 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6fe9d8b6-8ec7-4c6c-a50a-8d414c4b7660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:23.561305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 658/1330] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:23 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:55:23.600905 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a30ac8-b72d-4a64-85b7-d11ddda647d2 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:23.604420 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-54a30ac8-b72d-4a64-85b7-d11ddda647d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:23.637890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:23.718598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a30ac8-b72d-4a64-85b7-d11ddda647d2 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:23.805556 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529c92e-a01a-4b23-95f3-4708219abdd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:23.806164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529c92e-a01a-4b23-95f3-4708219abdd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:23.806441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529c92e-a01a-4b23-95f3-4708219abdd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:23.806704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529c92e-a01a-4b23-95f3-4708219abdd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:23.808348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e529c92e-a01a-4b23-95f3-4708219abdd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:23.903260 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:23.942847 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529c92e-a01a-4b23-95f3-4708219abdd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:23.944338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529c92e-a01a-4b23-95f3-4708219abdd8 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:23.966517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 673/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:55:23 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:55:26.429853 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de43938-0b47-4f44-bff4-bf384e0d0555 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:26.430430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de43938-0b47-4f44-bff4-bf384e0d0555 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:26.430430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de43938-0b47-4f44-bff4-bf384e0d0555 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:26.431848 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 659/1332] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:55:26.437931 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc30da-72b5-49c3-b123-dd8041ff9f13 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:26.438460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc30da-72b5-49c3-b123-dd8041ff9f13 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:26.438573 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc30da-72b5-49c3-b123-dd8041ff9f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:26.515394 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-2fdc30da-72b5-49c3-b123-dd8041ff9f13 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:26.516932 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2fdc30da-72b5-49c3-b123-dd8041ff9f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:26.639505 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 674/1333] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:55:26.676804 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de43938-0b47-4f44-bff4-bf384e0d0555 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:26.678387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8de43938-0b47-4f44-bff4-bf384e0d0555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:26.780708 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:26.818473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de43938-0b47-4f44-bff4-bf384e0d0555 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:26.899511 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61923e-9acb-4d79-8b71-83fa2087c5c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:26.900333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61923e-9acb-4d79-8b71-83fa2087c5c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:26.900657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61923e-9acb-4d79-8b71-83fa2087c5c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:26.900963 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61923e-9acb-4d79-8b71-83fa2087c5c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:26.902774 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6a61923e-9acb-4d79-8b71-83fa2087c5c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:27.032642 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61923e-9acb-4d79-8b71-83fa2087c5c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:27.034539 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61923e-9acb-4d79-8b71-83fa2087c5c4 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:27.046546 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:27.056759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 660/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:55:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:55:29.171188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0926ce-ff03-4a93-aec2-483e8bcd5832 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:29.172043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0926ce-ff03-4a93-aec2-483e8bcd5832 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:29.172223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0926ce-ff03-4a93-aec2-483e8bcd5832 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:29.173647 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 675/1335] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:55:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:55:29.179790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa45eba-27fc-4d36-8add-ee25c0e6acc9 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:29.180362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa45eba-27fc-4d36-8add-ee25c0e6acc9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:29.180535 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa45eba-27fc-4d36-8add-ee25c0e6acc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:29.267563 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2aa45eba-27fc-4d36-8add-ee25c0e6acc9 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:29.270279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2aa45eba-27fc-4d36-8add-ee25c0e6acc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:29.395185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 661/1336] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:55:29.436721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0926ce-ff03-4a93-aec2-483e8bcd5832 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:29.438270 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7c0926ce-ff03-4a93-aec2-483e8bcd5832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:29.480934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:29.553311 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0926ce-ff03-4a93-aec2-483e8bcd5832 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:29.634313 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe299c9-f47d-4b3a-bf1a-f5cbab1a97f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:29.634921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe299c9-f47d-4b3a-bf1a-f5cbab1a97f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:29.635197 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe299c9-f47d-4b3a-bf1a-f5cbab1a97f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:29.635461 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe299c9-f47d-4b3a-bf1a-f5cbab1a97f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:29.637142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2fe299c9-f47d-4b3a-bf1a-f5cbab1a97f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:29.731950 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:29.765598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe299c9-f47d-4b3a-bf1a-f5cbab1a97f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:29.767356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe299c9-f47d-4b3a-bf1a-f5cbab1a97f8 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:29.788780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 676/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:55:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:55:32.786988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912f241-0d68-49a8-89fa-2467b4911afc None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:32.787565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912f241-0d68-49a8-89fa-2467b4911afc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:32.787565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912f241-0d68-49a8-89fa-2467b4911afc None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:32.789175 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 662/1338] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:55:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:55:32.795756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c72a5-7ca2-420a-a078-65789685f283 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:32.796255 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c72a5-7ca2-420a-a078-65789685f283 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:32.796417 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c72a5-7ca2-420a-a078-65789685f283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:32.877714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c05c72a5-7ca2-420a-a078-65789685f283 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:32.879194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c05c72a5-7ca2-420a-a078-65789685f283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:32.997702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 677/1339] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:55:33.040787 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912f241-0d68-49a8-89fa-2467b4911afc None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:33.042592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7912f241-0d68-49a8-89fa-2467b4911afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:33.278085 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:33.315323 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912f241-0d68-49a8-89fa-2467b4911afc None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:33.414792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856bab2-0d02-4bf4-86df-c11473824d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:33.415619 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856bab2-0d02-4bf4-86df-c11473824d93 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:33.415997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856bab2-0d02-4bf4-86df-c11473824d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:33.416371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856bab2-0d02-4bf4-86df-c11473824d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:33.418602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5856bab2-0d02-4bf4-86df-c11473824d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:33.561247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856bab2-0d02-4bf4-86df-c11473824d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:33.563215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856bab2-0d02-4bf4-86df-c11473824d93 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:33.590313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 663/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:55:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 00:55:38.214619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d7bdc-b89d-41de-8e87-1a94efd6e009 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:38.215163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d7bdc-b89d-41de-8e87-1a94efd6e009 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:38.215163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d7bdc-b89d-41de-8e87-1a94efd6e009 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:38.216623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 678/1341] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:55:38.222430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32900efe-4c5e-48b3-a302-662dc965f547 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:38.223050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32900efe-4c5e-48b3-a302-662dc965f547 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:38.223050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32900efe-4c5e-48b3-a302-662dc965f547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:38.228957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:38.311050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-32900efe-4c5e-48b3-a302-662dc965f547 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:38.312340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-32900efe-4c5e-48b3-a302-662dc965f547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:38.445396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 664/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:55:38.486026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d7bdc-b89d-41de-8e87-1a94efd6e009 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:38.487686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-649d7bdc-b89d-41de-8e87-1a94efd6e009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:38.546419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:38.612425 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d7bdc-b89d-41de-8e87-1a94efd6e009 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:38.744079 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3ef69-2d5e-4a71-8841-9b212cf590be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:38.745405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3ef69-2d5e-4a71-8841-9b212cf590be service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:38.745694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3ef69-2d5e-4a71-8841-9b212cf590be service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:38.746026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3ef69-2d5e-4a71-8841-9b212cf590be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:38.749293 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-42b3ef69-2d5e-4a71-8841-9b212cf590be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:38.865753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:38.884131 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3ef69-2d5e-4a71-8841-9b212cf590be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:38.885600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3ef69-2d5e-4a71-8841-9b212cf590be service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:38.906083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 679/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:55:41.688708 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4adfd-6b0e-4a4b-bd30-eed392247e64 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:41.689572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4adfd-6b0e-4a4b-bd30-eed392247e64 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:41.689572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4adfd-6b0e-4a4b-bd30-eed392247e64 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:41.690715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 665/1344] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:55:41.696593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47619b-99fe-48c4-a8e5-6340fc7e25bc None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:41.697040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47619b-99fe-48c4-a8e5-6340fc7e25bc None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:41.697154 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47619b-99fe-48c4-a8e5-6340fc7e25bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:41.775392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3c47619b-99fe-48c4-a8e5-6340fc7e25bc None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:41.776656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3c47619b-99fe-48c4-a8e5-6340fc7e25bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:41.888875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 680/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:55:41.929154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4adfd-6b0e-4a4b-bd30-eed392247e64 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:41.930698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-add4adfd-6b0e-4a4b-bd30-eed392247e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:42.052466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:42.072635 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4adfd-6b0e-4a4b-bd30-eed392247e64 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:42.159808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abeb2b-8b64-4af7-93b3-4f8fcba0ed50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:42.161001 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abeb2b-8b64-4af7-93b3-4f8fcba0ed50 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:42.161274 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abeb2b-8b64-4af7-93b3-4f8fcba0ed50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:42.161595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abeb2b-8b64-4af7-93b3-4f8fcba0ed50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:42.163251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b2abeb2b-8b64-4af7-93b3-4f8fcba0ed50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:42.327850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abeb2b-8b64-4af7-93b3-4f8fcba0ed50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:42.329301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abeb2b-8b64-4af7-93b3-4f8fcba0ed50 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:42.350772 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 666/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:55:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 00:55:47.146394 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690f831-5c01-4d00-989a-3a2d187047e6 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:47.147141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690f831-5c01-4d00-989a-3a2d187047e6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:47.147301 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690f831-5c01-4d00-989a-3a2d187047e6 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:47.149352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 681/1347] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:55:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:55:47.155558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de089c-eea9-425c-bfef-ffa2ad3057e5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:47.156123 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de089c-eea9-425c-bfef-ffa2ad3057e5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:47.156217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de089c-eea9-425c-bfef-ffa2ad3057e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:47.172737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:47.237868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-77de089c-eea9-425c-bfef-ffa2ad3057e5 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:47.239167 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-77de089c-eea9-425c-bfef-ffa2ad3057e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:47.405440 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 667/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:55:47.445779 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690f831-5c01-4d00-989a-3a2d187047e6 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:47.447398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e690f831-5c01-4d00-989a-3a2d187047e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:47.525424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:47.592712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690f831-5c01-4d00-989a-3a2d187047e6 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:47.716279 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a616b-47e0-47c8-b942-97169b74ea34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:47.716904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a616b-47e0-47c8-b942-97169b74ea34 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:47.717178 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a616b-47e0-47c8-b942-97169b74ea34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:47.717444 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a616b-47e0-47c8-b942-97169b74ea34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:47.719303 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e14a616b-47e0-47c8-b942-97169b74ea34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:47.886680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:47.892167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a616b-47e0-47c8-b942-97169b74ea34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:47.894008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a616b-47e0-47c8-b942-97169b74ea34 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:47.927600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 682/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:55:53.233843 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75055e-580c-4f80-b8bf-31cf18033cbd None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:53.234407 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75055e-580c-4f80-b8bf-31cf18033cbd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:53.234640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75055e-580c-4f80-b8bf-31cf18033cbd None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:53.236715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 668/1350] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 00:55:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:55:53.243619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43732bf6-fe30-453c-a60f-7ce086277c38 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:53.244391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43732bf6-fe30-453c-a60f-7ce086277c38 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:53.245091 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43732bf6-fe30-453c-a60f-7ce086277c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:53.390121 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-43732bf6-fe30-453c-a60f-7ce086277c38 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:53.394124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-43732bf6-fe30-453c-a60f-7ce086277c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:53.684810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 683/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 00:55:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:55:57.402807 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=59 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:58.313011 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e4ebf-4bed-4928-8171-b7341b5d00aa None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:58.313487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e4ebf-4bed-4928-8171-b7341b5d00aa None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:58.314251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e4ebf-4bed-4928-8171-b7341b5d00aa None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:58.317765 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 669/1352] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 00:55:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:55:58.322539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fe39b-14b5-4b24-9a37-fe69692beff8 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:58.323025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fe39b-14b5-4b24-9a37-fe69692beff8 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:58.323110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fe39b-14b5-4b24-9a37-fe69692beff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:58.384166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:58.410034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-8e0fe39b-14b5-4b24-9a37-fe69692beff8 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:58.412216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8e0fe39b-14b5-4b24-9a37-fe69692beff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:58.535690 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 684/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 00:55:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:00.244507 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceebc2f-cf21-4aec-ad70-fd44e2566aba None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:00.245092 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceebc2f-cf21-4aec-ad70-fd44e2566aba None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:00.245092 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceebc2f-cf21-4aec-ad70-fd44e2566aba None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:00.246422 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 670/1354] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 00:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:00.252317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c950c-886b-4f5b-83f5-01f3bd6ba119 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:00.252833 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c950c-886b-4f5b-83f5-01f3bd6ba119 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:00.253120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c950c-886b-4f5b-83f5-01f3bd6ba119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:00.346722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-2a7c950c-886b-4f5b-83f5-01f3bd6ba119 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:00.347991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2a7c950c-886b-4f5b-83f5-01f3bd6ba119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:00.393292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:00.471241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 685/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 00:56:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:03.673364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158d00d-afcf-4cee-8aab-6ba54bd752cd None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:03.674073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158d00d-afcf-4cee-8aab-6ba54bd752cd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:03.674073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158d00d-afcf-4cee-8aab-6ba54bd752cd None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:03.675304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 671/1356] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:56:03.682384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b1fa1-9ff2-44e8-8343-e0a99566bb0d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:03.682912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b1fa1-9ff2-44e8-8343-e0a99566bb0d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:03.682912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b1fa1-9ff2-44e8-8343-e0a99566bb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:03.784518 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-267b1fa1-9ff2-44e8-8343-e0a99566bb0d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:03.786042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-267b1fa1-9ff2-44e8-8343-e0a99566bb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:03.904942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 686/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:56:03.959956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f15b3-12f9-41de-908b-0fa1836678c8 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:03.960846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f15b3-12f9-41de-908b-0fa1836678c8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:03.962600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f15b3-12f9-41de-908b-0fa1836678c8 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:03.964350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 672/1358] 10.222.0.20 () {54 vars in 962 bytes} [Sun Aug 7 00:56:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:03.983324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eca99-5d98-496f-968c-699517436eaa None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:03.983860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eca99-5d98-496f-968c-699517436eaa None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:03.984242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4eca99-5d98-496f-968c-699517436eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:04.008999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:04.086321 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-2e4eca99-5d98-496f-968c-699517436eaa None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:04.087575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2e4eca99-5d98-496f-968c-699517436eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:04.225041 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 687/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Aug 7 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:04.232827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f15b3-12f9-41de-908b-0fa1836678c8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:04.234336 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8b3f15b3-12f9-41de-908b-0fa1836678c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:04.389316 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f15b3-12f9-41de-908b-0fa1836678c8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:04.474205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:04.523638 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5308c-d050-4bdc-841c-ed03ac18a4f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:04.524180 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5308c-d050-4bdc-841c-ed03ac18a4f0 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:04.524460 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5308c-d050-4bdc-841c-ed03ac18a4f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:04.524721 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5308c-d050-4bdc-841c-ed03ac18a4f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:04.526314 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bac5308c-d050-4bdc-841c-ed03ac18a4f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:04.624997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5308c-d050-4bdc-841c-ed03ac18a4f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:04.626577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5308c-d050-4bdc-841c-ed03ac18a4f0 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:04.650518 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 673/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:56:06.938374 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b704a7-7d59-4aed-85a0-a930ecd4b35b None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:06.938783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b704a7-7d59-4aed-85a0-a930ecd4b35b None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:06.939199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b704a7-7d59-4aed-85a0-a930ecd4b35b None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:06.941920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 688/1361] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:56:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:06.947879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d10c-c8ea-4749-9059-3ede57d56ea8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:06.948445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d10c-c8ea-4749-9059-3ede57d56ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:06.948535 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d10c-c8ea-4749-9059-3ede57d56ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:07.025818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7bb3d10c-c8ea-4749-9059-3ede57d56ea8 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:07.027033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7bb3d10c-c8ea-4749-9059-3ede57d56ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:07.067856 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:07.140472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 674/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:07.184715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b704a7-7d59-4aed-85a0-a930ecd4b35b None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:07.186492 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-82b704a7-7d59-4aed-85a0-a930ecd4b35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:07.281975 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:07.380731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b704a7-7d59-4aed-85a0-a930ecd4b35b None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:07.545236 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3c529-d56e-4084-a9bf-f02fe8b8aabe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:07.545853 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3c529-d56e-4084-a9bf-f02fe8b8aabe service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:07.546131 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3c529-d56e-4084-a9bf-f02fe8b8aabe service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:07.546401 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3c529-d56e-4084-a9bf-f02fe8b8aabe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:07.548047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-06e3c529-d56e-4084-a9bf-f02fe8b8aabe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:07.575489 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:07.661175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3c529-d56e-4084-a9bf-f02fe8b8aabe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:07.664003 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3c529-d56e-4084-a9bf-f02fe8b8aabe service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:07.696111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 689/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:56:10.084350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c00628-5e2d-4b73-8cb8-a0df071c0c95 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:10.085379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c00628-5e2d-4b73-8cb8-a0df071c0c95 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:10.085737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c00628-5e2d-4b73-8cb8-a0df071c0c95 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:10.087261 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 675/1364] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:56:10.093078 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894d0d1-5ad5-4a15-8d37-501e80f1f4ad None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:10.093696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894d0d1-5ad5-4a15-8d37-501e80f1f4ad None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:10.093696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894d0d1-5ad5-4a15-8d37-501e80f1f4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:10.187426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-9894d0d1-5ad5-4a15-8d37-501e80f1f4ad None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:10.187426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9894d0d1-5ad5-4a15-8d37-501e80f1f4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:10.314134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:10.318584 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 690/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:10.367698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd6b63-1008-4822-8d38-853a492ba5da None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:10.368445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd6b63-1008-4822-8d38-853a492ba5da None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:10.368950 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd6b63-1008-4822-8d38-853a492ba5da None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:10.370726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 676/1366] 10.222.0.20 () {54 vars in 962 bytes} [Sun Aug 7 00:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:10.378621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cc379-6517-4bb6-999a-1581ec7b5335 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:10.379129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cc379-6517-4bb6-999a-1581ec7b5335 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:10.379632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cc379-6517-4bb6-999a-1581ec7b5335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:10.482731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c50cc379-6517-4bb6-999a-1581ec7b5335 None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:10.483996 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c50cc379-6517-4bb6-999a-1581ec7b5335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:10.650922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 691/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Aug 7 00:56:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:10.659631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd6b63-1008-4822-8d38-853a492ba5da None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:10.661477 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-82fd6b63-1008-4822-8d38-853a492ba5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:10.876183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd6b63-1008-4822-8d38-853a492ba5da None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:10.898337 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:11.008375 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387a79d-5ef5-4ba6-b65d-64536344a199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:11.008999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387a79d-5ef5-4ba6-b65d-64536344a199 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:11.009274 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387a79d-5ef5-4ba6-b65d-64536344a199 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:11.009542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387a79d-5ef5-4ba6-b65d-64536344a199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:11.011259 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e387a79d-5ef5-4ba6-b65d-64536344a199 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:11.120430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387a79d-5ef5-4ba6-b65d-64536344a199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:11.122023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387a79d-5ef5-4ba6-b65d-64536344a199 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:11.156311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 677/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:56:13.483464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52995f0-2c97-4c35-85cc-de64476c548a None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:13.484007 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52995f0-2c97-4c35-85cc-de64476c548a None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:13.484241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52995f0-2c97-4c35-85cc-de64476c548a None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:13.485797 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 692/1369] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:13.493590 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8882ed-0854-46a7-a248-7583e13085f9 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:13.494086 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8882ed-0854-46a7-a248-7583e13085f9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:13.494185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8882ed-0854-46a7-a248-7583e13085f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:13.542317 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:13.602267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5c8882ed-0854-46a7-a248-7583e13085f9 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:13.603613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5c8882ed-0854-46a7-a248-7583e13085f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:13.750911 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 678/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:13.836498 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52995f0-2c97-4c35-85cc-de64476c548a None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:13.836498 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d52995f0-2c97-4c35-85cc-de64476c548a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:13.957821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:14.204189 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52995f0-2c97-4c35-85cc-de64476c548a None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:14.407555 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10399cf1-3852-4254-98c1-feef4f61f0c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:14.408451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10399cf1-3852-4254-98c1-feef4f61f0c3 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:14.408859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10399cf1-3852-4254-98c1-feef4f61f0c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:14.409228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10399cf1-3852-4254-98c1-feef4f61f0c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:14.412581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-10399cf1-3852-4254-98c1-feef4f61f0c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:14.425810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:14.541246 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10399cf1-3852-4254-98c1-feef4f61f0c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:14.543160 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10399cf1-3852-4254-98c1-feef4f61f0c3 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:14.567357 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 693/1371] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:56:15.902074 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb924f0-c389-45fd-a74e-d7874c3b23f2 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:15.902635 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb924f0-c389-45fd-a74e-d7874c3b23f2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:15.902635 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb924f0-c389-45fd-a74e-d7874c3b23f2 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:15.904247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 679/1372] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:15.909948 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d999f-763f-444c-9e2f-24b03b25b4c5 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:15.910435 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d999f-763f-444c-9e2f-24b03b25b4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:15.910904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d999f-763f-444c-9e2f-24b03b25b4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:15.988540 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-870d999f-763f-444c-9e2f-24b03b25b4c5 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:15.989894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-870d999f-763f-444c-9e2f-24b03b25b4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:16.093589 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:16.117537 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 694/1373] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:56:16.467852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373751c1-2ddf-4dfc-b4c7-99f343e7d9e5 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:16.467852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373751c1-2ddf-4dfc-b4c7-99f343e7d9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:16.467852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373751c1-2ddf-4dfc-b4c7-99f343e7d9e5 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:16.470870 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 680/1374] 10.222.0.20 () {54 vars in 964 bytes} [Sun Aug 7 00:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:16.474112 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351cb8d-a189-4329-b2f2-da203a62216a None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:16.475016 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351cb8d-a189-4329-b2f2-da203a62216a None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:16.475450 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351cb8d-a189-4329-b2f2-da203a62216a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:16.567714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3351cb8d-a189-4329-b2f2-da203a62216a None None] MFA Rules not processed for user `803d0ab121784d688b58374aaa6a8e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:16.569215 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3351cb8d-a189-4329-b2f2-da203a62216a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:16.674404 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 695/1375] 10.222.0.20 () {58 vars in 1061 bytes} [Sun Aug 7 00:56:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:16.682762 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373751c1-2ddf-4dfc-b4c7-99f343e7d9e5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:16.684382 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-373751c1-2ddf-4dfc-b4c7-99f343e7d9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:16.806945 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373751c1-2ddf-4dfc-b4c7-99f343e7d9e5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:16.812218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:16.902251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccca29-28f1-4f49-8d73-b89c16713f07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '803d0ab121784d688b58374aaa6a8e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:16.903033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccca29-28f1-4f49-8d73-b89c16713f07 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:16.903418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccca29-28f1-4f49-8d73-b89c16713f07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:16.903792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccca29-28f1-4f49-8d73-b89c16713f07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:16.905566 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1dccca29-28f1-4f49-8d73-b89c16713f07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:16.913732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2b9cb-9ceb-495a-a36a-663b23c8ef6b None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:16.914441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2b9cb-9ceb-495a-a36a-663b23c8ef6b None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:16.914441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2b9cb-9ceb-495a-a36a-663b23c8ef6b None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:16.915619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 696/1376] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:56:16.920792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9fdc0-a1f7-4df9-b5c1-b4906f8a4862 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:16.921244 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9fdc0-a1f7-4df9-b5c1-b4906f8a4862 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:16.921511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9fdc0-a1f7-4df9-b5c1-b4906f8a4862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:17.003296 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-dde9fdc0-a1f7-4df9-b5c1-b4906f8a4862 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:17.005012 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-dde9fdc0-a1f7-4df9-b5c1-b4906f8a4862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:17.033970 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccca29-28f1-4f49-8d73-b89c16713f07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:17.035323 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccca29-28f1-4f49-8d73-b89c16713f07 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:17.044393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:17.061128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 681/1377] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 00:56:17.129913 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 697/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:17.177264 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccca29-28f1-4f49-8d73-b89c16713f07 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:17.179208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1dccca29-28f1-4f49-8d73-b89c16713f07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:17.221789 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:17.300143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccca29-28f1-4f49-8d73-b89c16713f07 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:17.452173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7abc1-d74a-448f-8a7e-d0ee3de784d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:17.453016 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7abc1-d74a-448f-8a7e-d0ee3de784d1 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:17.453476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7abc1-d74a-448f-8a7e-d0ee3de784d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:17.453747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7abc1-d74a-448f-8a7e-d0ee3de784d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:17.455418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2db7abc1-d74a-448f-8a7e-d0ee3de784d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:17.508780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:17.573346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7abc1-d74a-448f-8a7e-d0ee3de784d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:17.576351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7abc1-d74a-448f-8a7e-d0ee3de784d1 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:17.614016 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 682/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 00:56:19.778366 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cd874-bd06-42a9-865a-5cf4ab52f72f None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:19.778887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cd874-bd06-42a9-865a-5cf4ab52f72f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:19.778887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cd874-bd06-42a9-865a-5cf4ab52f72f None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:19.780544 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 698/1380] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:19.786151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f0529-0e13-45a0-9273-f5c58fb4a3ad None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:19.786631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f0529-0e13-45a0-9273-f5c58fb4a3ad None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:19.786744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f0529-0e13-45a0-9273-f5c58fb4a3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:19.870547 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-269f0529-0e13-45a0-9273-f5c58fb4a3ad None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:19.872128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-269f0529-0e13-45a0-9273-f5c58fb4a3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:20.017186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 683/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:20.063059 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cd874-bd06-42a9-865a-5cf4ab52f72f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:20.064619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b93cd874-bd06-42a9-865a-5cf4ab52f72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:20.250549 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cd874-bd06-42a9-865a-5cf4ab52f72f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:20.266984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:20.480017 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e07ba8-2bad-4c8a-8fbd-3f2ef4fc8a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:20.480017 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e07ba8-2bad-4c8a-8fbd-3f2ef4fc8a40 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:20.480017 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e07ba8-2bad-4c8a-8fbd-3f2ef4fc8a40 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:20.480017 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e07ba8-2bad-4c8a-8fbd-3f2ef4fc8a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:20.482922 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a9e07ba8-2bad-4c8a-8fbd-3f2ef4fc8a40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:20.613207 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e07ba8-2bad-4c8a-8fbd-3f2ef4fc8a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:20.615878 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e07ba8-2bad-4c8a-8fbd-3f2ef4fc8a40 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:20.638813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 699/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:56:22.869930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdaf1a-21d2-41f4-92f6-41fab307760e None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:22.870514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdaf1a-21d2-41f4-92f6-41fab307760e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:22.870514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdaf1a-21d2-41f4-92f6-41fab307760e None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:22.877349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600c13-e213-40db-979f-4134b6c5c20c None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:22.878085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600c13-e213-40db-979f-4134b6c5c20c None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:22.878085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600c13-e213-40db-979f-4134b6c5c20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:22.882610 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 684/1383] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:56:22 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:22.902666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:22.956889 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-52600c13-e213-40db-979f-4134b6c5c20c None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:22.958106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-52600c13-e213-40db-979f-4134b6c5c20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:23.086026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 700/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:56:23.129528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdaf1a-21d2-41f4-92f6-41fab307760e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:23.131461 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-80fdaf1a-21d2-41f4-92f6-41fab307760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:23.158976 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:23.321621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdaf1a-21d2-41f4-92f6-41fab307760e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:23.441864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:23.468385 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd5027-9a45-4c14-95a1-9dd63c28111d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:23.469681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd5027-9a45-4c14-95a1-9dd63c28111d service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:23.470173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd5027-9a45-4c14-95a1-9dd63c28111d service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:23.470650 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd5027-9a45-4c14-95a1-9dd63c28111d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:23.472818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-fefd5027-9a45-4c14-95a1-9dd63c28111d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:23.613709 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd5027-9a45-4c14-95a1-9dd63c28111d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:23.616412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd5027-9a45-4c14-95a1-9dd63c28111d service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:23.648891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 685/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:56:25.812628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9070a-d430-4f2c-8f44-e408def573e2 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:25.813178 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9070a-d430-4f2c-8f44-e408def573e2 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:25.813274 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9070a-d430-4f2c-8f44-e408def573e2 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:25.814709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 701/1386] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:56:25.821587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418134b-3506-4a4d-b48b-2875af3291cc None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:25.822124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418134b-3506-4a4d-b48b-2875af3291cc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:25.822124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418134b-3506-4a4d-b48b-2875af3291cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:25.922741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c418134b-3506-4a4d-b48b-2875af3291cc None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:25.923667 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c418134b-3506-4a4d-b48b-2875af3291cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:25.988781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:26.041089 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 686/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:56:26.089764 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9070a-d430-4f2c-8f44-e408def573e2 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:26.091323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-42b9070a-d430-4f2c-8f44-e408def573e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:26.199786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:26.264095 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9070a-d430-4f2c-8f44-e408def573e2 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:26.403729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec69fde-a070-4a14-879a-82940f3f6f41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:26.404398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec69fde-a070-4a14-879a-82940f3f6f41 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:26.404698 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec69fde-a070-4a14-879a-82940f3f6f41 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:26.404984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec69fde-a070-4a14-879a-82940f3f6f41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:26.406724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1ec69fde-a070-4a14-879a-82940f3f6f41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:26.485061 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:26.521729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec69fde-a070-4a14-879a-82940f3f6f41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:26.524375 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec69fde-a070-4a14-879a-82940f3f6f41 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:26.545236 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 702/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:56:28.702950 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b5bd6-0d57-4cc2-b6e2-416cdbeccea3 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:28.703540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b5bd6-0d57-4cc2-b6e2-416cdbeccea3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:28.704155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b5bd6-0d57-4cc2-b6e2-416cdbeccea3 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:28.706946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 687/1389] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:56:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:28.713080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e9454-5a65-4d34-bb14-8cc937329c68 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:28.713601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e9454-5a65-4d34-bb14-8cc937329c68 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:28.713601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e9454-5a65-4d34-bb14-8cc937329c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:28.808788 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-430e9454-5a65-4d34-bb14-8cc937329c68 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:28.810025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-430e9454-5a65-4d34-bb14-8cc937329c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:28.929812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 703/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:28.978175 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b5bd6-0d57-4cc2-b6e2-416cdbeccea3 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:28.979772 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a01b5bd6-0d57-4cc2-b6e2-416cdbeccea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:29.189281 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b5bd6-0d57-4cc2-b6e2-416cdbeccea3 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:29.245827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:29.345339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecb02f-8265-4b9a-b723-18e4b75bf71a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:29.345977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecb02f-8265-4b9a-b723-18e4b75bf71a service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:29.346256 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecb02f-8265-4b9a-b723-18e4b75bf71a service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:29.346520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecb02f-8265-4b9a-b723-18e4b75bf71a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:29.348243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4aecb02f-8265-4b9a-b723-18e4b75bf71a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:29.504736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecb02f-8265-4b9a-b723-18e4b75bf71a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:29.509106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecb02f-8265-4b9a-b723-18e4b75bf71a service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:29.557126 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 688/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:56:31.740476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170acba-0c32-4928-ac91-0b7046e948ae None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:31.741685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170acba-0c32-4928-ac91-0b7046e948ae None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:31.741803 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170acba-0c32-4928-ac91-0b7046e948ae None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:31.743681 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 704/1392] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:31.749271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085de24-92cc-45c2-90e5-948316d8d4f1 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:31.749776 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085de24-92cc-45c2-90e5-948316d8d4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:31.749877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085de24-92cc-45c2-90e5-948316d8d4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:31.816575 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:31.828731 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7085de24-92cc-45c2-90e5-948316d8d4f1 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:31.829987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7085de24-92cc-45c2-90e5-948316d8d4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:31.944172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 689/1393] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:31.990611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170acba-0c32-4928-ac91-0b7046e948ae None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:31.992601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f170acba-0c32-4928-ac91-0b7046e948ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:32.035324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:32.159110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170acba-0c32-4928-ac91-0b7046e948ae None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:32.289879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:32.293528 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bb8b6-a40e-4145-a0ab-51dd39509108 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:32.294408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bb8b6-a40e-4145-a0ab-51dd39509108 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:32.294873 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bb8b6-a40e-4145-a0ab-51dd39509108 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:32.295175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bb8b6-a40e-4145-a0ab-51dd39509108 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:32.297137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ec1bb8b6-a40e-4145-a0ab-51dd39509108 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:32.402969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1bb8b6-a40e-4145-a0ab-51dd39509108 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:32.404609 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1bb8b6-a40e-4145-a0ab-51dd39509108 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:32.424021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 705/1394] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:56:33.073206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e8ee5-d4b3-4885-bd11-f90947309bc7 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:33.074041 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e8ee5-d4b3-4885-bd11-f90947309bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:33.074235 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e8ee5-d4b3-4885-bd11-f90947309bc7 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:33.075705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 690/1395] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:33.081254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eddcd0-6656-4edf-a6b4-bb26ced0e387 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:33.081745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eddcd0-6656-4edf-a6b4-bb26ced0e387 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:33.081888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eddcd0-6656-4edf-a6b4-bb26ced0e387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:33.154408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-f9eddcd0-6656-4edf-a6b4-bb26ced0e387 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:33.155757 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f9eddcd0-6656-4edf-a6b4-bb26ced0e387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:33.227189 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:33.258353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 706/1396] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:33.318788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87007904-0d4c-4ce3-8785-659ba50bf947 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:33.319830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87007904-0d4c-4ce3-8785-659ba50bf947 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:33.320214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87007904-0d4c-4ce3-8785-659ba50bf947 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:33.322344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 691/1397] 10.222.0.20 () {54 vars in 966 bytes} [Sun Aug 7 00:56:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:33.328028 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e829b64-f39e-4473-9c0b-74c5e38a9717 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:33.328268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e829b64-f39e-4473-9c0b-74c5e38a9717 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:33.328543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e829b64-f39e-4473-9c0b-74c5e38a9717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:33.414393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-8e829b64-f39e-4473-9c0b-74c5e38a9717 None None] MFA Rules not processed for user `345c25e7dd2341bcb4c53d0a5aa36b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:33.415619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8e829b64-f39e-4473-9c0b-74c5e38a9717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:33.495825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 707/1398] 10.222.0.20 () {58 vars in 1063 bytes} [Sun Aug 7 00:56:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:33.503350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87007904-0d4c-4ce3-8785-659ba50bf947 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:33.504910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-87007904-0d4c-4ce3-8785-659ba50bf947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:33.629484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87007904-0d4c-4ce3-8785-659ba50bf947 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:33.664122 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:33.719155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91dd97-cfad-4fa9-add9-7bb90f3d71a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345c25e7dd2341bcb4c53d0a5aa36b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:33.719852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91dd97-cfad-4fa9-add9-7bb90f3d71a3 service glance] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:33.720165 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91dd97-cfad-4fa9-add9-7bb90f3d71a3 service glance] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:33.720433 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91dd97-cfad-4fa9-add9-7bb90f3d71a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:33.722037 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9c91dd97-cfad-4fa9-add9-7bb90f3d71a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:33.838487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91dd97-cfad-4fa9-add9-7bb90f3d71a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:33.839962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91dd97-cfad-4fa9-add9-7bb90f3d71a3 service glance] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:33.860438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 692/1399] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:56:34.543354 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e405d6c-f9c7-4e70-ac05-d626a4fbf269 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:34.543956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e405d6c-f9c7-4e70-ac05-d626a4fbf269 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:34.543956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e405d6c-f9c7-4e70-ac05-d626a4fbf269 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:34.545218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 708/1400] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:34.551171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5510b0-dc7c-4f5c-a041-8c48bb3bbf38 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:34.551752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5510b0-dc7c-4f5c-a041-8c48bb3bbf38 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:34.551752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5510b0-dc7c-4f5c-a041-8c48bb3bbf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:34.627711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-dd5510b0-dc7c-4f5c-a041-8c48bb3bbf38 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:34.628960 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-dd5510b0-dc7c-4f5c-a041-8c48bb3bbf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:34.641807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949429b-80af-46b6-bae9-d8315ddd2b2a None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:34.642115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949429b-80af-46b6-bae9-d8315ddd2b2a None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:34.642449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949429b-80af-46b6-bae9-d8315ddd2b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:34.644226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:34.732975 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-a949429b-80af-46b6-bae9-d8315ddd2b2a None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:34.734790 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a949429b-80af-46b6-bae9-d8315ddd2b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:34.755891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 693/1401] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:34.756481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:34.806049 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5510b0-dc7c-4f5c-a041-8c48bb3bbf38 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:34.807226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-dd5510b0-dc7c-4f5c-a041-8c48bb3bbf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:34.845217 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 709/1402] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 00:56:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:56:34.896381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784f906-db5d-4a9b-b6e2-8f8a948a0294 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:34.896381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784f906-db5d-4a9b-b6e2-8f8a948a0294 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:34.896381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784f906-db5d-4a9b-b6e2-8f8a948a0294 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:34.898893 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 710/1403] 10.222.0.20 () {54 vars in 943 bytes} [Sun Aug 7 00:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:56:34.907884 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5bada-5114-49af-9ed8-8d3a1f5d6569 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:34.908305 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5bada-5114-49af-9ed8-8d3a1f5d6569 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:34.908674 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5bada-5114-49af-9ed8-8d3a1f5d6569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:34.945924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5510b0-dc7c-4f5c-a041-8c48bb3bbf38 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:34.976992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:35.001684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-48f5bada-5114-49af-9ed8-8d3a1f5d6569 None None] MFA Rules not processed for user `04ad38e3598f4b15b74398dbdb9e69b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:35.002936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-48f5bada-5114-49af-9ed8-8d3a1f5d6569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:35.090741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773c353-9322-456a-9b6e-aa410fdd696b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:35.091492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773c353-9322-456a-9b6e-aa410fdd696b service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:35.091775 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773c353-9322-456a-9b6e-aa410fdd696b service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:35.092144 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773c353-9322-456a-9b6e-aa410fdd696b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:35.093861 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7773c353-9322-456a-9b6e-aa410fdd696b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:35.115239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:35.128583 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 711/1404] 10.222.0.20 () {58 vars in 1040 bytes} [Sun Aug 7 00:56:34 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:56:35.139278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5bada-5114-49af-9ed8-8d3a1f5d6569 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:35.150418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5bada-5114-49af-9ed8-8d3a1f5d6569 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:35.196919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773c353-9322-456a-9b6e-aa410fdd696b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:35.198528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773c353-9322-456a-9b6e-aa410fdd696b service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:35.217718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 694/1405] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:56:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 00:56:35.266212 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8cd02-3a41-404f-a83a-1daca7f85d70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:35.266846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8cd02-3a41-404f-a83a-1daca7f85d70 service swift] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:35.267109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8cd02-3a41-404f-a83a-1daca7f85d70 service swift] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:35.267375 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8cd02-3a41-404f-a83a-1daca7f85d70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:35.269098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-74f8cd02-3a41-404f-a83a-1daca7f85d70 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:35.368917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8cd02-3a41-404f-a83a-1daca7f85d70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:35.370480 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8cd02-3a41-404f-a83a-1daca7f85d70 service swift] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:35.382345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 712/1406] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 00:56:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 00:56:37.431762 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d7364-7c60-4650-9724-ca0c9226ee1a None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:37.432467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d7364-7c60-4650-9724-ca0c9226ee1a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:37.432467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d7364-7c60-4650-9724-ca0c9226ee1a None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:37.433708 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 695/1407] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:37.439549 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069efabe-253f-4da4-a63a-af3184126e97 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:37.440183 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069efabe-253f-4da4-a63a-af3184126e97 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:37.440372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069efabe-253f-4da4-a63a-af3184126e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:37.470093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:37.527546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-069efabe-253f-4da4-a63a-af3184126e97 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:37.528850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-069efabe-253f-4da4-a63a-af3184126e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:37.659944 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 713/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:37.698760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d7364-7c60-4650-9724-ca0c9226ee1a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:37.700459 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f19d7364-7c60-4650-9724-ca0c9226ee1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:37.737465 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:37.878582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d7364-7c60-4650-9724-ca0c9226ee1a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:38.006928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:38.024024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63207a81-8ae9-4d57-aa5a-5b580a2757c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:38.024645 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63207a81-8ae9-4d57-aa5a-5b580a2757c5 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:38.024922 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63207a81-8ae9-4d57-aa5a-5b580a2757c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:38.025193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63207a81-8ae9-4d57-aa5a-5b580a2757c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:38.026800 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-63207a81-8ae9-4d57-aa5a-5b580a2757c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:38.131372 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63207a81-8ae9-4d57-aa5a-5b580a2757c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:38.133178 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63207a81-8ae9-4d57-aa5a-5b580a2757c5 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:38.155380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 696/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:56:47.736184 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=57 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:48.153141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=49 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:58.131611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440af80-6e00-4152-a433-41b20dea2c22 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:58.132230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440af80-6e00-4152-a433-41b20dea2c22 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:58.132230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440af80-6e00-4152-a433-41b20dea2c22 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:58.134088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 714/1410] 10.222.0.20 () {54 vars in 918 bytes} [Sun Aug 7 00:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:58.139311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50807dc5-b8e5-4cc5-ba41-44d1b3d763b9 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:58.139751 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50807dc5-b8e5-4cc5-ba41-44d1b3d763b9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:58.139852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50807dc5-b8e5-4cc5-ba41-44d1b3d763b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:58.229535 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-50807dc5-b8e5-4cc5-ba41-44d1b3d763b9 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:58.230761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-50807dc5-b8e5-4cc5-ba41-44d1b3d763b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:58.340144 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 697/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Aug 7 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:56:58.355386 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38789b22-d52b-4fe0-9fe8-96159668bce3 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:58.355669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38789b22-d52b-4fe0-9fe8-96159668bce3 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:58.355975 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38789b22-d52b-4fe0-9fe8-96159668bce3 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:58.357323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 715/1412] 10.222.0.20 () {54 vars in 918 bytes} [Sun Aug 7 00:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:58.362111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb431d9-57fa-4db5-aeb6-e7267932e622 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:58.362393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb431d9-57fa-4db5-aeb6-e7267932e622 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:58.362662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb431d9-57fa-4db5-aeb6-e7267932e622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:58.436869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:58.439442 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3eb431d9-57fa-4db5-aeb6-e7267932e622 None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:58.441470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3eb431d9-57fa-4db5-aeb6-e7267932e622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:58.560885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 698/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Aug 7 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:01.091015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1d6d4-ab0e-47da-83e3-ad5993e34f2f None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:01.091015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1d6d4-ab0e-47da-83e3-ad5993e34f2f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:01.091015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1d6d4-ab0e-47da-83e3-ad5993e34f2f None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:01.092231 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 00:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:57:01.097578 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cfffd-d17b-4d48-9e33-957bc96c0b49 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:01.098041 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cfffd-d17b-4d48-9e33-957bc96c0b49 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:01.098143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cfffd-d17b-4d48-9e33-957bc96c0b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:01.166526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-011cfffd-d17b-4d48-9e33-957bc96c0b49 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:01.167744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-011cfffd-d17b-4d48-9e33-957bc96c0b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:01.224182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:01.267811 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 00:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:57:01.313666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1d6d4-ab0e-47da-83e3-ad5993e34f2f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:01.315324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5cc1d6d4-ab0e-47da-83e3-ad5993e34f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:01.464686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1d6d4-ab0e-47da-83e3-ad5993e34f2f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:01.539981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:01.580498 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef9192-bd32-4486-a3b6-57796a5a3549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:01.581106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef9192-bd32-4486-a3b6-57796a5a3549 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:01.581381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef9192-bd32-4486-a3b6-57796a5a3549 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:01.581648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef9192-bd32-4486-a3b6-57796a5a3549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:01.583263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d6ef9192-bd32-4486-a3b6-57796a5a3549 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:01.676174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef9192-bd32-4486-a3b6-57796a5a3549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:01.677790 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef9192-bd32-4486-a3b6-57796a5a3549 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:01.696051 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 717/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:02.615751 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0a546-c2b8-4969-8b29-f6f81487b985 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:02.616400 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0a546-c2b8-4969-8b29-f6f81487b985 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:02.616400 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0a546-c2b8-4969-8b29-f6f81487b985 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:02.617846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 00:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:02.623186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c3e43-5575-4859-afe4-0e47384ef7c3 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:02.623654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c3e43-5575-4859-afe4-0e47384ef7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:02.623753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c3e43-5575-4859-afe4-0e47384ef7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:02.702955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-f73c3e43-5575-4859-afe4-0e47384ef7c3 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:02.704188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f73c3e43-5575-4859-afe4-0e47384ef7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:02.732196 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:02.812148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 00:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:02.974010 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0a546-c2b8-4969-8b29-f6f81487b985 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:02.975579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a8e0a546-c2b8-4969-8b29-f6f81487b985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:03.126219 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0a546-c2b8-4969-8b29-f6f81487b985 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:03.168522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:03.244524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeec7f8-ebb7-4961-9d96-9630efa78888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:03.245045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeec7f8-ebb7-4961-9d96-9630efa78888 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:03.245361 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeec7f8-ebb7-4961-9d96-9630efa78888 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:03.245636 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeec7f8-ebb7-4961-9d96-9630efa78888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:03.247251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9eeec7f8-ebb7-4961-9d96-9630efa78888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:03.346270 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeec7f8-ebb7-4961-9d96-9630efa78888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:03.347993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeec7f8-ebb7-4961-9d96-9630efa78888 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:03.366797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 701/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:04.267082 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157686ed-ddc7-4415-81be-651e162061e2 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:04.267664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157686ed-ddc7-4415-81be-651e162061e2 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:04.267664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157686ed-ddc7-4415-81be-651e162061e2 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:04.268994 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 00:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:04.274773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe6d21-a416-441c-aeaf-ae2769aba3f9 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:04.275316 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe6d21-a416-441c-aeaf-ae2769aba3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:04.275316 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe6d21-a416-441c-aeaf-ae2769aba3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:04.335711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:04.359134 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d4fe6d21-a416-441c-aeaf-ae2769aba3f9 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:04.360389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d4fe6d21-a416-441c-aeaf-ae2769aba3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:04.458146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 00:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:04.609376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157686ed-ddc7-4415-81be-651e162061e2 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:04.610908 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-157686ed-ddc7-4415-81be-651e162061e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:04.767323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157686ed-ddc7-4415-81be-651e162061e2 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:04.781569 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:04.885402 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b4068-7a41-4eba-bf2d-259066f62f1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:04.885918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b4068-7a41-4eba-bf2d-259066f62f1d service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:04.886195 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b4068-7a41-4eba-bf2d-259066f62f1d service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:04.886466 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b4068-7a41-4eba-bf2d-259066f62f1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:04.888090 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b18b4068-7a41-4eba-bf2d-259066f62f1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:04.987264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b4068-7a41-4eba-bf2d-259066f62f1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:04.988901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b4068-7a41-4eba-bf2d-259066f62f1d service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:05.008330 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 720/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:05.875122 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e54d6e-d695-4020-9671-75f6af517257 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:05.875689 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e54d6e-d695-4020-9671-75f6af517257 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:05.875689 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e54d6e-d695-4020-9671-75f6af517257 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:05.877126 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 00:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:05.882565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21b328-6981-4c02-889f-e6fb87da9ce9 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:05.883615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21b328-6981-4c02-889f-e6fb87da9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:05.883839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21b328-6981-4c02-889f-e6fb87da9ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:05.906822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:05.967068 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-9c21b328-6981-4c02-889f-e6fb87da9ce9 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:05.968330 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9c21b328-6981-4c02-889f-e6fb87da9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:06.066684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 00:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:06.219372 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e54d6e-d695-4020-9671-75f6af517257 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:06.220945 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b7e54d6e-d695-4020-9671-75f6af517257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:06.335555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:06.375970 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e54d6e-d695-4020-9671-75f6af517257 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:06.489951 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e4fce-21e8-4636-a088-3aa8550394e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:06.490462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e4fce-21e8-4636-a088-3aa8550394e1 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:06.491020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e4fce-21e8-4636-a088-3aa8550394e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:06.491290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e4fce-21e8-4636-a088-3aa8550394e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:06.493605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b88e4fce-21e8-4636-a088-3aa8550394e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:06.572801 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:06.587360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e4fce-21e8-4636-a088-3aa8550394e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:06.589121 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e4fce-21e8-4636-a088-3aa8550394e1 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:06.608744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 704/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:07.504762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f07bbd-9675-4cc5-bf81-11b9bf412e14 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:07.505338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f07bbd-9675-4cc5-bf81-11b9bf412e14 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:07.505338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f07bbd-9675-4cc5-bf81-11b9bf412e14 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:07.506656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 00:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:07.512836 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e81d2d-7b69-40e6-9de1-20313c647c04 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:07.513370 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e81d2d-7b69-40e6-9de1-20313c647c04 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:07.513370 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e81d2d-7b69-40e6-9de1-20313c647c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:07.595783 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d4e81d2d-7b69-40e6-9de1-20313c647c04 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:07.597026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d4e81d2d-7b69-40e6-9de1-20313c647c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:07.699602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 00:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:07.854861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f07bbd-9675-4cc5-bf81-11b9bf412e14 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:07.856343 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f2f07bbd-9675-4cc5-bf81-11b9bf412e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:07.942175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:08.006998 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f07bbd-9675-4cc5-bf81-11b9bf412e14 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:08.120668 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a682f7-93a1-421a-8eed-bf57aae118b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:08.121191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a682f7-93a1-421a-8eed-bf57aae118b9 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:08.121474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a682f7-93a1-421a-8eed-bf57aae118b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:08.121746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a682f7-93a1-421a-8eed-bf57aae118b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:08.123391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-65a682f7-93a1-421a-8eed-bf57aae118b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:08.177427 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:08.220791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a682f7-93a1-421a-8eed-bf57aae118b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:08.222406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a682f7-93a1-421a-8eed-bf57aae118b9 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:08.241395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 723/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:09.056653 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b7054-d877-485a-bbf2-d0c8246fbc43 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:09.057203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b7054-d877-485a-bbf2-d0c8246fbc43 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:09.057203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b7054-d877-485a-bbf2-d0c8246fbc43 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:09.058606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 00:57:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:09.063850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf49236-9189-4a02-bd9a-43bec47343d2 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:09.064338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf49236-9189-4a02-bd9a-43bec47343d2 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:09.064467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf49236-9189-4a02-bd9a-43bec47343d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:09.148405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-7cf49236-9189-4a02-bd9a-43bec47343d2 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:09.150719 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7cf49236-9189-4a02-bd9a-43bec47343d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:09.256957 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 00:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:09.409943 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b7054-d877-485a-bbf2-d0c8246fbc43 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:09.411550 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-007b7054-d877-485a-bbf2-d0c8246fbc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:09.461693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:09.563494 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b7054-d877-485a-bbf2-d0c8246fbc43 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:09.678270 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fee1d-de97-4e22-91ab-28bd5c4c1976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:09.678800 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fee1d-de97-4e22-91ab-28bd5c4c1976 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:09.679074 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fee1d-de97-4e22-91ab-28bd5c4c1976 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:09.679342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fee1d-de97-4e22-91ab-28bd5c4c1976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:09.681648 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-152fee1d-de97-4e22-91ab-28bd5c4c1976 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:09.689177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:09.775934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fee1d-de97-4e22-91ab-28bd5c4c1976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:09.777563 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fee1d-de97-4e22-91ab-28bd5c4c1976 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:09.795702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 707/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:10.604507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fa8f3-3157-45eb-a55e-a5c78df91197 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:10.605042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fa8f3-3157-45eb-a55e-a5c78df91197 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:10.605042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fa8f3-3157-45eb-a55e-a5c78df91197 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:10.606321 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 00:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:57:10.611207 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d8c6a-b2db-477c-a584-05c1c6c3a501 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:10.611633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d8c6a-b2db-477c-a584-05c1c6c3a501 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:10.611760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d8c6a-b2db-477c-a584-05c1c6c3a501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:10.689470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-cc0d8c6a-b2db-477c-a584-05c1c6c3a501 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:10.690688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cc0d8c6a-b2db-477c-a584-05c1c6c3a501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:10.763143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:10.794328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 00:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:10.950024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fa8f3-3157-45eb-a55e-a5c78df91197 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:10.951537 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f91fa8f3-3157-45eb-a55e-a5c78df91197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:10.970127 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:11.099788 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fa8f3-3157-45eb-a55e-a5c78df91197 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:11.188631 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:11.216804 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5925577-8356-43e6-bb2a-7b6453ff074f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:11.217330 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5925577-8356-43e6-bb2a-7b6453ff074f service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:11.217609 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5925577-8356-43e6-bb2a-7b6453ff074f service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:11.217880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5925577-8356-43e6-bb2a-7b6453ff074f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:11.219506 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b5925577-8356-43e6-bb2a-7b6453ff074f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:11.312209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5925577-8356-43e6-bb2a-7b6453ff074f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:11.313816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5925577-8356-43e6-bb2a-7b6453ff074f service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:11.332364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 726/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:12.162810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521e313-d5f5-410c-82d8-f9b338fd4912 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:12.163350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521e313-d5f5-410c-82d8-f9b338fd4912 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:12.163350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521e313-d5f5-410c-82d8-f9b338fd4912 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:12.165275 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 00:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:12.170496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031687f-e2fb-4791-b519-bd4f8f6398ef None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:12.171101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031687f-e2fb-4791-b519-bd4f8f6398ef None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:12.171101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031687f-e2fb-4791-b519-bd4f8f6398ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:12.251616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c031687f-e2fb-4791-b519-bd4f8f6398ef None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:12.252921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c031687f-e2fb-4791-b519-bd4f8f6398ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:12.298483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:12.360411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 00:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:12.518419 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521e313-d5f5-410c-82d8-f9b338fd4912 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:12.520073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a521e313-d5f5-410c-82d8-f9b338fd4912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:12.676126 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521e313-d5f5-410c-82d8-f9b338fd4912 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:12.733609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:12.795544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183273c-84db-430a-9833-996b71e6433b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:12.796084 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183273c-84db-430a-9833-996b71e6433b service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:12.796362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183273c-84db-430a-9833-996b71e6433b service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:12.796635 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183273c-84db-430a-9833-996b71e6433b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:12.798220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d183273c-84db-430a-9833-996b71e6433b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:12.891943 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183273c-84db-430a-9833-996b71e6433b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:12.893554 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183273c-84db-430a-9833-996b71e6433b service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:12.913012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 710/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:13.724951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ce499-a1d8-4f08-9a36-ba52b2dc61df None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:13.725530 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ce499-a1d8-4f08-9a36-ba52b2dc61df None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:13.725530 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ce499-a1d8-4f08-9a36-ba52b2dc61df None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:13.726971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 00:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:13.732264 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce4751-3096-41d1-9520-0967510c8390 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:13.732704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce4751-3096-41d1-9520-0967510c8390 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:13.732845 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce4751-3096-41d1-9520-0967510c8390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:13.810753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ecce4751-3096-41d1-9520-0967510c8390 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:13.812008 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ecce4751-3096-41d1-9520-0967510c8390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:13.814091 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:13.925318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 00:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:14.076800 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ce499-a1d8-4f08-9a36-ba52b2dc61df None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:14.078315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ca8ce499-a1d8-4f08-9a36-ba52b2dc61df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:14.230384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ce499-a1d8-4f08-9a36-ba52b2dc61df None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:14.257762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:14.346929 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6e6c4-cae3-4cfe-b200-1a2d9cbecd22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:14.347536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6e6c4-cae3-4cfe-b200-1a2d9cbecd22 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:14.347810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6e6c4-cae3-4cfe-b200-1a2d9cbecd22 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:14.348107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6e6c4-cae3-4cfe-b200-1a2d9cbecd22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:14.349723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3ca6e6c4-cae3-4cfe-b200-1a2d9cbecd22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:14.441507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6e6c4-cae3-4cfe-b200-1a2d9cbecd22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:14.443138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6e6c4-cae3-4cfe-b200-1a2d9cbecd22 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:14.463639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 729/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:16.380753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e97486-efb9-4298-9819-7a049d887a8a None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:16.381347 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e97486-efb9-4298-9819-7a049d887a8a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:16.381347 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e97486-efb9-4298-9819-7a049d887a8a None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:16.382670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 00:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:16.388058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261db94-e1e8-41e7-9c85-ba73b9b3ed3d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:16.388533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261db94-e1e8-41e7-9c85-ba73b9b3ed3d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:16.388669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261db94-e1e8-41e7-9c85-ba73b9b3ed3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:16.432583 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:16.459511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-b261db94-e1e8-41e7-9c85-ba73b9b3ed3d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:16.461038 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b261db94-e1e8-41e7-9c85-ba73b9b3ed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:16.568623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 00:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:16.610609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e97486-efb9-4298-9819-7a049d887a8a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:16.612193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c4e97486-efb9-4298-9819-7a049d887a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:16.725240 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e97486-efb9-4298-9819-7a049d887a8a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:16.758893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:16.800830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5797ad-8da3-4757-b205-761c88f4c0c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:16.801438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5797ad-8da3-4757-b205-761c88f4c0c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:16.801714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5797ad-8da3-4757-b205-761c88f4c0c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:16.801983 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5797ad-8da3-4757-b205-761c88f4c0c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:16.803572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6d5797ad-8da3-4757-b205-761c88f4c0c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:16.916464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5797ad-8da3-4757-b205-761c88f4c0c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:16.917818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5797ad-8da3-4757-b205-761c88f4c0c8 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:16.937749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 713/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:19.224971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b2ce9-eecd-4bcf-8594-39478103d4bf None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:19.225587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b2ce9-eecd-4bcf-8594-39478103d4bf None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:19.225769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b2ce9-eecd-4bcf-8594-39478103d4bf None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:19.227741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 00:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:19.234250 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af0c49-cf76-4974-8f91-0df85f95c487 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:19.234744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af0c49-cf76-4974-8f91-0df85f95c487 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:19.234849 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af0c49-cf76-4974-8f91-0df85f95c487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:19.304799 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-59af0c49-cf76-4974-8f91-0df85f95c487 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:19.306601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-59af0c49-cf76-4974-8f91-0df85f95c487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:19.320623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:19.407610 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 00:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:19.446333 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b2ce9-eecd-4bcf-8594-39478103d4bf None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:19.448082 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1d3b2ce9-eecd-4bcf-8594-39478103d4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:19.560992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b2ce9-eecd-4bcf-8594-39478103d4bf None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:19.573614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:19.637755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b00166-e2db-4bc1-9560-33878f5c4f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:19.638377 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b00166-e2db-4bc1-9560-33878f5c4f0f service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:19.638657 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b00166-e2db-4bc1-9560-33878f5c4f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:19.638930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b00166-e2db-4bc1-9560-33878f5c4f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:19.640603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-18b00166-e2db-4bc1-9560-33878f5c4f0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:19.753872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b00166-e2db-4bc1-9560-33878f5c4f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:19.755317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b00166-e2db-4bc1-9560-33878f5c4f0f service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:19.774293 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 732/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:22.194862 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f66bd0-653f-40ac-8b3c-8cc37d709cf8 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:22.195432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f66bd0-653f-40ac-8b3c-8cc37d709cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:22.195432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f66bd0-653f-40ac-8b3c-8cc37d709cf8 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:22.198084 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 00:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:22.203620 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59a630-1032-4827-b87e-f1ccd58e70ad None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:22.204115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59a630-1032-4827-b87e-f1ccd58e70ad None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:22.204226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59a630-1032-4827-b87e-f1ccd58e70ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:22.253963 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:22.273615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3b59a630-1032-4827-b87e-f1ccd58e70ad None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:22.275721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3b59a630-1032-4827-b87e-f1ccd58e70ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:22.375262 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 00:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:22.416555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f66bd0-653f-40ac-8b3c-8cc37d709cf8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:22.418147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d8f66bd0-653f-40ac-8b3c-8cc37d709cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:22.526687 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f66bd0-653f-40ac-8b3c-8cc37d709cf8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:22.568818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:22.606759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcce212-92f3-4ccb-90b5-f5f5760a469e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:22.607379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcce212-92f3-4ccb-90b5-f5f5760a469e service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:22.607663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcce212-92f3-4ccb-90b5-f5f5760a469e service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:22.607965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcce212-92f3-4ccb-90b5-f5f5760a469e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:22.609591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ffcce212-92f3-4ccb-90b5-f5f5760a469e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:22.733731 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcce212-92f3-4ccb-90b5-f5f5760a469e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:22.735169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcce212-92f3-4ccb-90b5-f5f5760a469e service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:22.754555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 716/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:24.950176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad426cfa-ad9e-4055-b8a0-e0f7f108078f None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:24.950702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad426cfa-ad9e-4055-b8a0-e0f7f108078f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:24.950702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad426cfa-ad9e-4055-b8a0-e0f7f108078f None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:24.952115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 00:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:24.957467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d6477-a6c2-4390-8f74-c3251ad38926 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:24.957895 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d6477-a6c2-4390-8f74-c3251ad38926 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:24.958038 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d6477-a6c2-4390-8f74-c3251ad38926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:25.026470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-961d6477-a6c2-4390-8f74-c3251ad38926 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:25.027680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-961d6477-a6c2-4390-8f74-c3251ad38926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:25.048477 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:25.129053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:25.169277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad426cfa-ad9e-4055-b8a0-e0f7f108078f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:25.170844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ad426cfa-ad9e-4055-b8a0-e0f7f108078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:25.280153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad426cfa-ad9e-4055-b8a0-e0f7f108078f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:25.300470 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:25.356176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f60aae-7d38-4c0a-9813-be55d1bc0c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:25.356780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f60aae-7d38-4c0a-9813-be55d1bc0c1f service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:25.357057 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f60aae-7d38-4c0a-9813-be55d1bc0c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:25.357325 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f60aae-7d38-4c0a-9813-be55d1bc0c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:25.358933 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-47f60aae-7d38-4c0a-9813-be55d1bc0c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:25.470458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f60aae-7d38-4c0a-9813-be55d1bc0c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:25.471897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f60aae-7d38-4c0a-9813-be55d1bc0c1f service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:25.490515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 735/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:27.635432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359cab6-95fd-43a7-9002-81f18d279016 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:27.636043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359cab6-95fd-43a7-9002-81f18d279016 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:27.636043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359cab6-95fd-43a7-9002-81f18d279016 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:27.637395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 00:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:27.643031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afc578-b047-45fd-98d2-ff7092b2c5cb None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:27.643436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afc578-b047-45fd-98d2-ff7092b2c5cb None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:27.643583 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afc578-b047-45fd-98d2-ff7092b2c5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:27.711497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:27.714266 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-16afc578-b047-45fd-98d2-ff7092b2c5cb None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:27.716241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-16afc578-b047-45fd-98d2-ff7092b2c5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:27.816512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 00:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:57:27.855697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359cab6-95fd-43a7-9002-81f18d279016 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:27.857304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3359cab6-95fd-43a7-9002-81f18d279016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:27.964817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359cab6-95fd-43a7-9002-81f18d279016 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:28.015105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:28.042411 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3764601-8121-4c5c-86c8-4642cdb721f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:28.043014 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3764601-8121-4c5c-86c8-4642cdb721f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:28.043291 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3764601-8121-4c5c-86c8-4642cdb721f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:28.043558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3764601-8121-4c5c-86c8-4642cdb721f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:28.045198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a3764601-8121-4c5c-86c8-4642cdb721f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:28.164607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3764601-8121-4c5c-86c8-4642cdb721f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:28.166660 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3764601-8121-4c5c-86c8-4642cdb721f5 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:28.187397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 719/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:30.349123 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4636c0-23d6-4b56-8a6f-8fa941ce234e None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:30.349675 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4636c0-23d6-4b56-8a6f-8fa941ce234e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:30.349675 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4636c0-23d6-4b56-8a6f-8fa941ce234e None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:30.351163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 00:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:30.356960 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db795dd2-3af7-426c-9d14-e293ee4725a6 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:30.357450 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db795dd2-3af7-426c-9d14-e293ee4725a6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:30.357559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db795dd2-3af7-426c-9d14-e293ee4725a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:30.430218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-db795dd2-3af7-426c-9d14-e293ee4725a6 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:30.431439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-db795dd2-3af7-426c-9d14-e293ee4725a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:30.464684 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:30.544516 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 00:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:30.583728 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4636c0-23d6-4b56-8a6f-8fa941ce234e None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:30.585483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-bd4636c0-23d6-4b56-8a6f-8fa941ce234e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:30.709999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4636c0-23d6-4b56-8a6f-8fa941ce234e None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:30.745045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:30.798361 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe6f95-7405-4a1c-9dd2-efc26472564d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:30.798989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe6f95-7405-4a1c-9dd2-efc26472564d service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:30.799269 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe6f95-7405-4a1c-9dd2-efc26472564d service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:30.799543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe6f95-7405-4a1c-9dd2-efc26472564d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:30.801311 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3ffe6f95-7405-4a1c-9dd2-efc26472564d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:30.926155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe6f95-7405-4a1c-9dd2-efc26472564d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:30.927526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe6f95-7405-4a1c-9dd2-efc26472564d service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:30.949016 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 738/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:33.096457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cc8a2-90d8-482f-9613-66924808a1de None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:33.097032 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cc8a2-90d8-482f-9613-66924808a1de None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:33.097032 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cc8a2-90d8-482f-9613-66924808a1de None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:33.098362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 00:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:33.104342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b94d27-140e-47f0-b931-2aad77ecd6a4 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:33.104784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b94d27-140e-47f0-b931-2aad77ecd6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:33.104888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b94d27-140e-47f0-b931-2aad77ecd6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:33.173477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-63b94d27-140e-47f0-b931-2aad77ecd6a4 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:33.174701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-63b94d27-140e-47f0-b931-2aad77ecd6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:33.184192 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:33.277790 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 00:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:33.316627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cc8a2-90d8-482f-9613-66924808a1de None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:33.318185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ae9cc8a2-90d8-482f-9613-66924808a1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:33.426409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cc8a2-90d8-482f-9613-66924808a1de None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:33.483925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:33.503579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09675b66-82e9-4292-9452-6385c651e196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:33.504229 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09675b66-82e9-4292-9452-6385c651e196 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:33.504513 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09675b66-82e9-4292-9452-6385c651e196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:33.504787 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09675b66-82e9-4292-9452-6385c651e196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:33.506386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-09675b66-82e9-4292-9452-6385c651e196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:33.622968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09675b66-82e9-4292-9452-6385c651e196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:33.624447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09675b66-82e9-4292-9452-6385c651e196 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:33.644933 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 722/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:35.761343 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b13d3-dea3-4d86-82e3-904aef690c30 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:35.761881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b13d3-dea3-4d86-82e3-904aef690c30 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:35.761881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b13d3-dea3-4d86-82e3-904aef690c30 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:35.763275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 00:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:35.768540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c2d44-617c-4fb3-ad12-ab0e3830dcd2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:35.768983 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c2d44-617c-4fb3-ad12-ab0e3830dcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:35.769097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c2d44-617c-4fb3-ad12-ab0e3830dcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:35.840294 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b13c2d44-617c-4fb3-ad12-ab0e3830dcd2 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:35.841529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b13c2d44-617c-4fb3-ad12-ab0e3830dcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:35.884932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:35.947034 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 00:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:35.984707 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b13d3-dea3-4d86-82e3-904aef690c30 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:35.986355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-0c1b13d3-dea3-4d86-82e3-904aef690c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:36.099298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b13d3-dea3-4d86-82e3-904aef690c30 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:36.151659 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:36.190172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a969f0-c7d1-420e-9b24-45d218c0cd71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:36.190702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a969f0-c7d1-420e-9b24-45d218c0cd71 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:36.190981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a969f0-c7d1-420e-9b24-45d218c0cd71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:36.191249 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a969f0-c7d1-420e-9b24-45d218c0cd71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:36.192902 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-24a969f0-c7d1-420e-9b24-45d218c0cd71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:36.310502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a969f0-c7d1-420e-9b24-45d218c0cd71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:36.311962 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a969f0-c7d1-420e-9b24-45d218c0cd71 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:36.331418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 741/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:38.410171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140098f-c543-46f4-b15b-522183220982 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:38.410880 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140098f-c543-46f4-b15b-522183220982 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:38.410880 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140098f-c543-46f4-b15b-522183220982 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:38.412445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 00:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:38.419035 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722dfcb-d54f-4c2a-8d17-1c4e0b4bbb62 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:38.419533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722dfcb-d54f-4c2a-8d17-1c4e0b4bbb62 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:38.419669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722dfcb-d54f-4c2a-8d17-1c4e0b4bbb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:38.498357 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-d722dfcb-d54f-4c2a-8d17-1c4e0b4bbb62 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:38.499583 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d722dfcb-d54f-4c2a-8d17-1c4e0b4bbb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:38.522654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:38.609571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 00:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:38.647714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140098f-c543-46f4-b15b-522183220982 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:38.650267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0140098f-c543-46f4-b15b-522183220982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:38.764650 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140098f-c543-46f4-b15b-522183220982 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:38.835293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:38.843711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbf6d9-1a65-4f17-8d77-981b34ceb97d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:38.844356 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbf6d9-1a65-4f17-8d77-981b34ceb97d service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:38.844638 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbf6d9-1a65-4f17-8d77-981b34ceb97d service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:38.844910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbf6d9-1a65-4f17-8d77-981b34ceb97d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:38.846541 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ffcbf6d9-1a65-4f17-8d77-981b34ceb97d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:38.969623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbf6d9-1a65-4f17-8d77-981b34ceb97d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:38.971068 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbf6d9-1a65-4f17-8d77-981b34ceb97d service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:38.991860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 725/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:41.042571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e728b-2acf-4aca-961c-630f96b16933 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:41.043140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e728b-2acf-4aca-961c-630f96b16933 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:41.043140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e728b-2acf-4aca-961c-630f96b16933 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:41.044561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 00:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:41.049844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db92c2-3130-49c6-9c12-d2cbc4cb6542 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:41.050236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db92c2-3130-49c6-9c12-d2cbc4cb6542 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:41.050396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db92c2-3130-49c6-9c12-d2cbc4cb6542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:41.118652 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-59db92c2-3130-49c6-9c12-d2cbc4cb6542 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:41.119914 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-59db92c2-3130-49c6-9c12-d2cbc4cb6542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:41.173563 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:41.224020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 00:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:57:41.262480 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e728b-2acf-4aca-961c-630f96b16933 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:41.264061 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-737e728b-2acf-4aca-961c-630f96b16933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:41.369507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e728b-2acf-4aca-961c-630f96b16933 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:41.419821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:41.451290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535af46-0df4-454f-8904-3992b883f4b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:41.451897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535af46-0df4-454f-8904-3992b883f4b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:41.452204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535af46-0df4-454f-8904-3992b883f4b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:41.452477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535af46-0df4-454f-8904-3992b883f4b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:41.454099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c535af46-0df4-454f-8904-3992b883f4b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:41.566049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535af46-0df4-454f-8904-3992b883f4b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:41.567518 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535af46-0df4-454f-8904-3992b883f4b1 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:41.586133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 744/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:57:51.222108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=22 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:51.583928 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=66 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:01.757974 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280999a9-9d6a-4e06-9e27-d942cc927882 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:01.758582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280999a9-9d6a-4e06-9e27-d942cc927882 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:01.758582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280999a9-9d6a-4e06-9e27-d942cc927882 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:01.760156 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 727/1471] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:01.765377 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb1cb7-c468-47a6-80cc-7a5d24ce769d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:01.765857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb1cb7-c468-47a6-80cc-7a5d24ce769d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:01.765972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb1cb7-c468-47a6-80cc-7a5d24ce769d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:01.840126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-64fb1cb7-c468-47a6-80cc-7a5d24ce769d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:01.841387 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-64fb1cb7-c468-47a6-80cc-7a5d24ce769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:01.944422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 745/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:02.035212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e0322-f721-43f5-b215-4d3a2dead32b None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:02.035497 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e0322-f721-43f5-b215-4d3a2dead32b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:02.035796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e0322-f721-43f5-b215-4d3a2dead32b None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:02.037212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 728/1473] 10.222.0.20 () {54 vars in 966 bytes} [Sun Aug 7 00:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:02.043183 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2879e3b-9ff2-4771-a391-dffc4c4411d4 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:02.043473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2879e3b-9ff2-4771-a391-dffc4c4411d4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:02.043750 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2879e3b-9ff2-4771-a391-dffc4c4411d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:02.123540 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e2879e3b-9ff2-4771-a391-dffc4c4411d4 None None] MFA Rules not processed for user `345c25e7dd2341bcb4c53d0a5aa36b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:02.124795 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e2879e3b-9ff2-4771-a391-dffc4c4411d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:02.151145 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:02.219036 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 746/1474] 10.222.0.20 () {58 vars in 1063 bytes} [Sun Aug 7 00:58:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:02.226531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e0322-f721-43f5-b215-4d3a2dead32b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:02.228148 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5f9e0322-f721-43f5-b215-4d3a2dead32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:02.338691 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e0322-f721-43f5-b215-4d3a2dead32b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:02.413899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae02ca-9f69-4ff7-a340-e11c350f1ef1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345c25e7dd2341bcb4c53d0a5aa36b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:02.414517 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae02ca-9f69-4ff7-a340-e11c350f1ef1 service glance] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:02.414801 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae02ca-9f69-4ff7-a340-e11c350f1ef1 service glance] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:02.415077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae02ca-9f69-4ff7-a340-e11c350f1ef1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:02.417314 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-87ae02ca-9f69-4ff7-a340-e11c350f1ef1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:02.472967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:02.533019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae02ca-9f69-4ff7-a340-e11c350f1ef1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:02.534453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae02ca-9f69-4ff7-a340-e11c350f1ef1 service glance] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:02.555624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 729/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:04.688036 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41c6a-21d0-4d05-a18c-520f6c9c382d None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:04.688802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41c6a-21d0-4d05-a18c-520f6c9c382d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:04.688802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef41c6a-21d0-4d05-a18c-520f6c9c382d None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:04.690251 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 747/1476] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:04.696117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969ed33-804c-4b8c-92e9-54051c4fb02f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:04.696665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969ed33-804c-4b8c-92e9-54051c4fb02f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:04.696810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969ed33-804c-4b8c-92e9-54051c4fb02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:04.770898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3969ed33-804c-4b8c-92e9-54051c4fb02f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:04.772172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3969ed33-804c-4b8c-92e9-54051c4fb02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:04.876526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 730/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:04.901552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef41c6a-21d0-4d05-a18c-520f6c9c382d None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:04.902571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3ef41c6a-21d0-4d05-a18c-520f6c9c382d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:05.042364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef41c6a-21d0-4d05-a18c-520f6c9c382d None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:05.096949 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:05.146582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6d549-0905-4d58-96a9-6c9b543bd751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:05.147196 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6d549-0905-4d58-96a9-6c9b543bd751 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:05.147471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6d549-0905-4d58-96a9-6c9b543bd751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:05.147739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6d549-0905-4d58-96a9-6c9b543bd751 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:05.148406 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6d549-0905-4d58-96a9-6c9b543bd751 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:05.150916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: WARNING py.warnings [None req-f5f6d549-0905-4d58-96a9-6c9b543bd751 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 00:58:05.150916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: warnings.warn(msg) Aug 07 00:58:05.150916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: Aug 07 00:58:05.152197 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6d549-0905-4d58-96a9-6c9b543bd751 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:05.173021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 748/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Aug 7 00:58:04 2022] GET /identity/v3/projects => generated 2553 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:58:07.273324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8902ad-4040-4877-95f2-f171786e001d None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:07.273901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8902ad-4040-4877-95f2-f171786e001d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:07.273901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8902ad-4040-4877-95f2-f171786e001d None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:07.275253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 731/1479] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:07.280879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55f002-8021-484d-95c3-e3494ffd9a65 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:07.281348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55f002-8021-484d-95c3-e3494ffd9a65 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:07.281476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55f002-8021-484d-95c3-e3494ffd9a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:07.347606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-ca55f002-8021-484d-95c3-e3494ffd9a65 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:07.348873 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ca55f002-8021-484d-95c3-e3494ffd9a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:07.448529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 749/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:58:07.492104 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8902ad-4040-4877-95f2-f171786e001d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:07.493721 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7c8902ad-4040-4877-95f2-f171786e001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:07.503836 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:07.654348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8902ad-4040-4877-95f2-f171786e001d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:07.744810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:07.778780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c363e1f-5cc5-4b65-be86-aaea0ec988c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:07.779393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c363e1f-5cc5-4b65-be86-aaea0ec988c0 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:07.779622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c363e1f-5cc5-4b65-be86-aaea0ec988c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:07.779893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c363e1f-5cc5-4b65-be86-aaea0ec988c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:07.781546 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1c363e1f-5cc5-4b65-be86-aaea0ec988c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:07.872628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c363e1f-5cc5-4b65-be86-aaea0ec988c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:07.874217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c363e1f-5cc5-4b65-be86-aaea0ec988c0 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:07.892638 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 732/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:10.137552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5fdab-2fef-487b-873a-69deda2a7c16 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.138111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5fdab-2fef-487b-873a-69deda2a7c16 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.138111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5fdab-2fef-487b-873a-69deda2a7c16 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.139441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 750/1482] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:10.144719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7b26e-ee58-4bb6-bc7a-1fe92295cda1 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.145131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7b26e-ee58-4bb6-bc7a-1fe92295cda1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.145277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7b26e-ee58-4bb6-bc7a-1fe92295cda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.214286 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d0c7b26e-ee58-4bb6-bc7a-1fe92295cda1 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:10.215488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d0c7b26e-ee58-4bb6-bc7a-1fe92295cda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:10.262254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:10.314912 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 733/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:10.351968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5fdab-2fef-487b-873a-69deda2a7c16 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:10.353596 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a9a5fdab-2fef-487b-873a-69deda2a7c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:10.377968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:10.461159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5fdab-2fef-487b-873a-69deda2a7c16 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:10.536620 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180c978-5945-405a-818c-8d8ce2ad1f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:10.537160 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180c978-5945-405a-818c-8d8ce2ad1f60 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:10.537438 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180c978-5945-405a-818c-8d8ce2ad1f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:10.537704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180c978-5945-405a-818c-8d8ce2ad1f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:10.539301 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8180c978-5945-405a-818c-8d8ce2ad1f60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:10.625622 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:10.665104 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180c978-5945-405a-818c-8d8ce2ad1f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:10.667184 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180c978-5945-405a-818c-8d8ce2ad1f60 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:10.688040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 751/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:12.761038 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5922d-6379-4275-a624-58b1f42918ae None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:12.761602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5922d-6379-4275-a624-58b1f42918ae None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:12.761602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5922d-6379-4275-a624-58b1f42918ae None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:12.762935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 734/1485] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:58:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:12.768395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd9565-e9ff-4bb2-9db8-909fa37e0448 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:12.768812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd9565-e9ff-4bb2-9db8-909fa37e0448 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:12.768921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd9565-e9ff-4bb2-9db8-909fa37e0448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:12.836892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5cbd9565-e9ff-4bb2-9db8-909fa37e0448 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:12.838664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5cbd9565-e9ff-4bb2-9db8-909fa37e0448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:12.938936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 752/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:12.978313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5922d-6379-4275-a624-58b1f42918ae None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:12.979866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-74d5922d-6379-4275-a624-58b1f42918ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:13.094187 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5922d-6379-4275-a624-58b1f42918ae None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:13.167531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:13.170310 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6dfe8-16e3-4b88-ac3a-769eba1ff69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:13.171233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6dfe8-16e3-4b88-ac3a-769eba1ff69d service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:13.171634 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6dfe8-16e3-4b88-ac3a-769eba1ff69d service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:13.172159 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6dfe8-16e3-4b88-ac3a-769eba1ff69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:13.174033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f8f6dfe8-16e3-4b88-ac3a-769eba1ff69d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:13.288764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6dfe8-16e3-4b88-ac3a-769eba1ff69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:13.290193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6dfe8-16e3-4b88-ac3a-769eba1ff69d service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:13.308544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 735/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:15.450144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c2ab0-c34b-43ad-a75f-7c6f61c77efc None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.450695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c2ab0-c34b-43ad-a75f-7c6f61c77efc None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.450695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c2ab0-c34b-43ad-a75f-7c6f61c77efc None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.452082 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 753/1488] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:15.457362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfed41c-9144-4b6b-b75d-df5d8d1bc996 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.457804 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfed41c-9144-4b6b-b75d-df5d8d1bc996 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.457919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfed41c-9144-4b6b-b75d-df5d8d1bc996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.526246 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6bfed41c-9144-4b6b-b75d-df5d8d1bc996 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:15.527498 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6bfed41c-9144-4b6b-b75d-df5d8d1bc996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:15.582780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:15.629049 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 736/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:15.671261 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c2ab0-c34b-43ad-a75f-7c6f61c77efc None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:15.672836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e15c2ab0-c34b-43ad-a75f-7c6f61c77efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:15.710643 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:15.780158 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c2ab0-c34b-43ad-a75f-7c6f61c77efc None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:15.857729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9355df-f295-4591-9d59-849a11d0bc7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:15.858342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9355df-f295-4591-9d59-849a11d0bc7e service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.858653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9355df-f295-4591-9d59-849a11d0bc7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.858981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9355df-f295-4591-9d59-849a11d0bc7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.860665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4f9355df-f295-4591-9d59-849a11d0bc7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:15.950824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:15.982724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9355df-f295-4591-9d59-849a11d0bc7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:15.984111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9355df-f295-4591-9d59-849a11d0bc7e service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:16.002957 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 754/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:18.240930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bd05-82e2-4558-b788-8ae5f0fb285a None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:18.241499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bd05-82e2-4558-b788-8ae5f0fb285a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:18.241499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bd05-82e2-4558-b788-8ae5f0fb285a None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:18.242826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 737/1491] 10.222.0.20 () {54 vars in 927 bytes} [Sun Aug 7 00:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:18.248429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b610649-7885-4426-8737-1c63f1a2673d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:18.248909 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b610649-7885-4426-8737-1c63f1a2673d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:18.249048 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b610649-7885-4426-8737-1c63f1a2673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:18.319945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-8b610649-7885-4426-8737-1c63f1a2673d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:18.321362 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8b610649-7885-4426-8737-1c63f1a2673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:18.423651 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 755/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:18.463273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28bd05-82e2-4558-b788-8ae5f0fb285a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:18.465030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cf28bd05-82e2-4558-b788-8ae5f0fb285a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:18.570206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28bd05-82e2-4558-b788-8ae5f0fb285a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:18.645761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7b402-f957-46cb-8d39-7fec9d116524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:18.646364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7b402-f957-46cb-8d39-7fec9d116524 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:18.646639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7b402-f957-46cb-8d39-7fec9d116524 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:18.646903 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7b402-f957-46cb-8d39-7fec9d116524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:18.648509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-85b7b402-f957-46cb-8d39-7fec9d116524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:18.659013 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:18.772042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7b402-f957-46cb-8d39-7fec9d116524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:18.773464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7b402-f957-46cb-8d39-7fec9d116524 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:18.792260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 738/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:28.421875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=82 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:28.789798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=50 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:30.346767 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434c488-bb84-4ac5-b07a-15b45430d2c7 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.347378 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434c488-bb84-4ac5-b07a-15b45430d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.347378 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434c488-bb84-4ac5-b07a-15b45430d2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.431459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-7434c488-bb84-4ac5-b07a-15b45430d2c7 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:30.433903 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7434c488-bb84-4ac5-b07a-15b45430d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:30.537727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 756/1494] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 00:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:59:30.546852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bce64-3465-4f28-b8a4-411cf4b8fed6 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.547422 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bce64-3465-4f28-b8a4-411cf4b8fed6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.547422 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bce64-3465-4f28-b8a4-411cf4b8fed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.629883 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1b9bce64-3465-4f28-b8a4-411cf4b8fed6 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:30.631032 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1b9bce64-3465-4f28-b8a4-411cf4b8fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:30.746403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 739/1495] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 00:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:59:30.751347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434c488-bb84-4ac5-b07a-15b45430d2c7 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:30.752611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7434c488-bb84-4ac5-b07a-15b45430d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:30.767174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434c488-bb84-4ac5-b07a-15b45430d2c7 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:30.833681 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:30.879055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291d63b-f155-4033-a543-2fa5290177bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:30.879663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291d63b-f155-4033-a543-2fa5290177bb admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.880019 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291d63b-f155-4033-a543-2fa5290177bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.880234 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291d63b-f155-4033-a543-2fa5290177bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.880881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291d63b-f155-4033-a543-2fa5290177bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:59:30.881287 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291d63b-f155-4033-a543-2fa5290177bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:30.882654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: WARNING py.warnings [None req-5291d63b-f155-4033-a543-2fa5290177bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 00:59:30.882654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: warnings.warn(msg) Aug 07 00:59:30.882654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: Aug 07 00:59:30.883551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291d63b-f155-4033-a543-2fa5290177bb admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:30.897485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 757/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 00:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:59:30.906167 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bce64-3465-4f28-b8a4-411cf4b8fed6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:30.919490 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bce64-3465-4f28-b8a4-411cf4b8fed6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:30.987800 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:31.030207 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e763ee-3d8e-41e2-92d2-b5ab77baa2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.030968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e763ee-3d8e-41e2-92d2-b5ab77baa2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.031321 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e763ee-3d8e-41e2-92d2-b5ab77baa2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.031621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e763ee-3d8e-41e2-92d2-b5ab77baa2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.032564 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e763ee-3d8e-41e2-92d2-b5ab77baa2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.034476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: WARNING py.warnings [None req-74e763ee-3d8e-41e2-92d2-b5ab77baa2e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 00:59:31.034476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: warnings.warn(msg) Aug 07 00:59:31.034476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: Aug 07 00:59:31.036688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e763ee-3d8e-41e2-92d2-b5ab77baa2e4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.100930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 740/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 00:59:30 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:31.105444 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291d63b-f155-4033-a543-2fa5290177bb admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:31.106971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5291d63b-f155-4033-a543-2fa5290177bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:31.146639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291d63b-f155-4033-a543-2fa5290177bb admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.251369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ea27-6170-48ca-90e3-7e6344391c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.251998 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ea27-6170-48ca-90e3-7e6344391c11 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.252277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ea27-6170-48ca-90e3-7e6344391c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.252705 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148ea27-6170-48ca-90e3-7e6344391c11 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.253490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148ea27-6170-48ca-90e3-7e6344391c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.254539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: WARNING py.warnings [None req-d148ea27-6170-48ca-90e3-7e6344391c11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 00:59:31.254539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: warnings.warn(msg) Aug 07 00:59:31.254539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: Aug 07 00:59:31.255732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148ea27-6170-48ca-90e3-7e6344391c11 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.301188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 758/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 00:59:31 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:59:31.308294 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e763ee-3d8e-41e2-92d2-b5ab77baa2e4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:31.309815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-74e763ee-3d8e-41e2-92d2-b5ab77baa2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:31.373481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e763ee-3d8e-41e2-92d2-b5ab77baa2e4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.465919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:31.477536 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1dfef-ea66-483d-b342-b4075f5dfdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.478150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1dfef-ea66-483d-b342-b4075f5dfdfb admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.478426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1dfef-ea66-483d-b342-b4075f5dfdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.478852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1dfef-ea66-483d-b342-b4075f5dfdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.479514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1dfef-ea66-483d-b342-b4075f5dfdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.480634 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: WARNING py.warnings [None req-f0d1dfef-ea66-483d-b342-b4075f5dfdfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 00:59:31.480634 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: warnings.warn(msg) Aug 07 00:59:31.480634 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: Aug 07 00:59:31.481539 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1dfef-ea66-483d-b342-b4075f5dfdfb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.495416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 741/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 00:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:59:31.499828 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ea27-6170-48ca-90e3-7e6344391c11 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:31.501532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d148ea27-6170-48ca-90e3-7e6344391c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:31.513652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148ea27-6170-48ca-90e3-7e6344391c11 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.539455 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:31.612244 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082fa58-2ab0-4a83-a655-12ca870b5851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.612849 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082fa58-2ab0-4a83-a655-12ca870b5851 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.613128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082fa58-2ab0-4a83-a655-12ca870b5851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.613393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082fa58-2ab0-4a83-a655-12ca870b5851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.614034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082fa58-2ab0-4a83-a655-12ca870b5851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.615052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: WARNING py.warnings [None req-7082fa58-2ab0-4a83-a655-12ca870b5851 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 00:59:31.615052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: warnings.warn(msg) Aug 07 00:59:31.615052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: Aug 07 00:59:31.615945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082fa58-2ab0-4a83-a655-12ca870b5851 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.635473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 759/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 00:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:59:31.640032 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1dfef-ea66-483d-b342-b4075f5dfdfb admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:31.641623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f0d1dfef-ea66-483d-b342-b4075f5dfdfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:31.676012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1dfef-ea66-483d-b342-b4075f5dfdfb admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.778492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a764132-7864-4bef-958c-7551419535a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.779211 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a764132-7864-4bef-958c-7551419535a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.779587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a764132-7864-4bef-958c-7551419535a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.780008 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a764132-7864-4bef-958c-7551419535a6 admin admin] PATH_INFO: `/v3/projects/5dd39404f4864219af60f9bff9ad362d/users/cc109ee31dc049418d8cbed30f780f57/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.804313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a764132-7864-4bef-958c-7551419535a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd39404f4864219af60f9bff9ad362d, user_id=cc109ee31dc049418d8cbed30f780f57, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.805378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: WARNING py.warnings [None req-6a764132-7864-4bef-958c-7551419535a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 00:59:31.805378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: warnings.warn(msg) Aug 07 00:59:31.805378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: Aug 07 00:59:31.808051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a764132-7864-4bef-958c-7551419535a6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.835334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 742/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 00:59:31 2022] PUT /identity/v3/projects/5dd39404f4864219af60f9bff9ad362d/users/cc109ee31dc049418d8cbed30f780f57/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:59:31.849159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06105d-66ff-4ead-afef-dfc26359c593 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.849528 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06105d-66ff-4ead-afef-dfc26359c593 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.849833 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06105d-66ff-4ead-afef-dfc26359c593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.915503 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-bf06105d-66ff-4ead-afef-dfc26359c593 None None] MFA Rules not processed for user `cc109ee31dc049418d8cbed30f780f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:31.917942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-bf06105d-66ff-4ead-afef-dfc26359c593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:32.002724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 760/1502] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 00:59:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:59:32.016906 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affbd8d-6551-4923-9e0e-2050ebae84b6 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.017221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affbd8d-6551-4923-9e0e-2050ebae84b6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.017492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affbd8d-6551-4923-9e0e-2050ebae84b6 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.018829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 743/1503] 10.222.0.20 () {54 vars in 964 bytes} [Sun Aug 7 00:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:32.023738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff8917-7f45-40be-8a33-09c0e7fd7a3b None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.024067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff8917-7f45-40be-8a33-09c0e7fd7a3b None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.024342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff8917-7f45-40be-8a33-09c0e7fd7a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.077393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:32.126052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-29ff8917-7f45-40be-8a33-09c0e7fd7a3b None None] MFA Rules not processed for user `803d0ab121784d688b58374aaa6a8e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:32.127279 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-29ff8917-7f45-40be-8a33-09c0e7fd7a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:32.211875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 761/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Sun Aug 7 00:59:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:59:32.220270 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affbd8d-6551-4923-9e0e-2050ebae84b6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:32.221789 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0affbd8d-6551-4923-9e0e-2050ebae84b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:32.274171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:32.333045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affbd8d-6551-4923-9e0e-2050ebae84b6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:32.419893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a4f66-1ff3-47ec-bf1b-856e6a959c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '803d0ab121784d688b58374aaa6a8e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:32.420540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a4f66-1ff3-47ec-bf1b-856e6a959c81 service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.420819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a4f66-1ff3-47ec-bf1b-856e6a959c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.421088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a4f66-1ff3-47ec-bf1b-856e6a959c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.422703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a65a4f66-1ff3-47ec-bf1b-856e6a959c81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:32.527984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a4f66-1ff3-47ec-bf1b-856e6a959c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:32.530077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a4f66-1ff3-47ec-bf1b-856e6a959c81 service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:32.534385 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:32.550150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 744/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:59:32.600502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb46ec-83ec-4c9c-bd3d-69f7c711b25f None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.600997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb46ec-83ec-4c9c-bd3d-69f7c711b25f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.601105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb46ec-83ec-4c9c-bd3d-69f7c711b25f None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.602440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 762/1506] 10.222.0.20 () {52 vars in 830 bytes} [Sun Aug 7 00:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:32.606383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a4f66-1ff3-47ec-bf1b-856e6a959c81 service cinder] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:32.607599 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a65a4f66-1ff3-47ec-bf1b-856e6a959c81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:32.720387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a4f66-1ff3-47ec-bf1b-856e6a959c81 service cinder] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:32.820516 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086be41b-a1f9-4853-8ee7-d9ab422dae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:32.821156 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086be41b-a1f9-4853-8ee7-d9ab422dae36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.821432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086be41b-a1f9-4853-8ee7-d9ab422dae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.821701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086be41b-a1f9-4853-8ee7-d9ab422dae36 admin admin] PATH_INFO: `/v3/users/cc109ee31dc049418d8cbed30f780f57` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.835110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086be41b-a1f9-4853-8ee7-d9ab422dae36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc109ee31dc049418d8cbed30f780f57)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:32.836210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: WARNING py.warnings [None req-086be41b-a1f9-4853-8ee7-d9ab422dae36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 00:59:32.836210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: warnings.warn(msg) Aug 07 00:59:32.836210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: Aug 07 00:59:32.837376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086be41b-a1f9-4853-8ee7-d9ab422dae36 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:32.849492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:32.915483 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-086be41b-a1f9-4853-8ee7-d9ab422dae36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc109ee31dc049418d8cbed30f780f57'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 00:59:32.925942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-086be41b-a1f9-4853-8ee7-d9ab422dae36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc109ee31dc049418d8cbed30f780f57'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 00:59:32.951816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-086be41b-a1f9-4853-8ee7-d9ab422dae36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc109ee31dc049418d8cbed30f780f57'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 00:59:32.966700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-086be41b-a1f9-4853-8ee7-d9ab422dae36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc109ee31dc049418d8cbed30f780f57'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 00:59:32.967176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-086be41b-a1f9-4853-8ee7-d9ab422dae36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc109ee31dc049418d8cbed30f780f57'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 00:59:32.972915 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 745/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 00:59:32 2022] DELETE /identity/v3/users/cc109ee31dc049418d8cbed30f780f57 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:59:32.977444 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8d01a-b76b-493c-8555-609ce55e985d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.977728 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8d01a-b76b-493c-8555-609ce55e985d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.977998 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8d01a-b76b-493c-8555-609ce55e985d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.171086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-b4a8d01a-b76b-493c-8555-609ce55e985d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:33.172277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b4a8d01a-b76b-493c-8555-609ce55e985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:33.257182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:33.271182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 763/1508] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 00:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:59:33.282761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086be41b-a1f9-4853-8ee7-d9ab422dae36 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:33.284029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-086be41b-a1f9-4853-8ee7-d9ab422dae36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:33.389187 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086be41b-a1f9-4853-8ee7-d9ab422dae36 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:33.453966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:33.477714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a19851-8a64-4aa6-96d9-a157f86c2128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:33.478331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a19851-8a64-4aa6-96d9-a157f86c2128 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:33.479579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a19851-8a64-4aa6-96d9-a157f86c2128 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:33.479858 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a19851-8a64-4aa6-96d9-a157f86c2128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.481497 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-39a19851-8a64-4aa6-96d9-a157f86c2128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:33.605747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a19851-8a64-4aa6-96d9-a157f86c2128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:33.607173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a19851-8a64-4aa6-96d9-a157f86c2128 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:33.627375 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 746/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:59:34.034218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8d01a-b76b-493c-8555-609ce55e985d None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:34.035606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b4a8d01a-b76b-493c-8555-609ce55e985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:34.049868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8d01a-b76b-493c-8555-609ce55e985d None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:34.159459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950284e6-c5b5-4ab2-8748-c9213f004a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:34.160113 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950284e6-c5b5-4ab2-8748-c9213f004a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:34.160391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950284e6-c5b5-4ab2-8748-c9213f004a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:34.160729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950284e6-c5b5-4ab2-8748-c9213f004a4e admin admin] PATH_INFO: `/v3/projects/5dd39404f4864219af60f9bff9ad362d` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:34.171615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950284e6-c5b5-4ab2-8748-c9213f004a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd39404f4864219af60f9bff9ad362d)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:34.172807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: WARNING py.warnings [None req-950284e6-c5b5-4ab2-8748-c9213f004a4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 00:59:34.172807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: warnings.warn(msg) Aug 07 00:59:34.172807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: Aug 07 00:59:34.174022 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950284e6-c5b5-4ab2-8748-c9213f004a4e admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:34.234452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-950284e6-c5b5-4ab2-8748-c9213f004a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd39404f4864219af60f9bff9ad362d', 'request_id': 'req-950284e6-c5b5-4ab2-8748-c9213f004a4e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 00:59:34.248246 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-950284e6-c5b5-4ab2-8748-c9213f004a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd39404f4864219af60f9bff9ad362d', 'request_id': 'req-950284e6-c5b5-4ab2-8748-c9213f004a4e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 00:59:34.258264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-950284e6-c5b5-4ab2-8748-c9213f004a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd39404f4864219af60f9bff9ad362d', 'request_id': 'req-950284e6-c5b5-4ab2-8748-c9213f004a4e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 00:59:34.286015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-950284e6-c5b5-4ab2-8748-c9213f004a4e admin admin] The token cache is being invalidate because project 5dd39404f4864219af60f9bff9ad362d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 00:59:34.286226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-950284e6-c5b5-4ab2-8748-c9213f004a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 00:59:34.286729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-950284e6-c5b5-4ab2-8748-c9213f004a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 00:59:34.288087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 764/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 00:59:34 2022] DELETE /identity/v3/projects/5dd39404f4864219af60f9bff9ad362d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:59:43.624761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=62 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:44.283798 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:46.586877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6530b-b888-406c-b2e7-e1a36f75d4b4 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:46.588087 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6530b-b888-406c-b2e7-e1a36f75d4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:46.588087 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6530b-b888-406c-b2e7-e1a36f75d4b4 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:46.589821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:00:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:46.595289 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6146ff-9963-4772-93e2-3d1823dc1482 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:46.596144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6146ff-9963-4772-93e2-3d1823dc1482 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:46.596144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6146ff-9963-4772-93e2-3d1823dc1482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:46.701174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-fc6146ff-9963-4772-93e2-3d1823dc1482 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:46.702547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-fc6146ff-9963-4772-93e2-3d1823dc1482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:46.827109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:00:46.992381 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6530b-b888-406c-b2e7-e1a36f75d4b4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:46.994699 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-19a6530b-b888-406c-b2e7-e1a36f75d4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:47.147072 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6530b-b888-406c-b2e7-e1a36f75d4b4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:47.152698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16ecd2-51e8-4c4a-9abb-3c649ffd0fe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:47.153343 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ecd2-51e8-4c4a-9abb-3c649ffd0fe0 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:47.153621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ecd2-51e8-4c4a-9abb-3c649ffd0fe0 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:47.153890 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ecd2-51e8-4c4a-9abb-3c649ffd0fe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:47.165734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16ecd2-51e8-4c4a-9abb-3c649ffd0fe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:47.165734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16ecd2-51e8-4c4a-9abb-3c649ffd0fe0 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:47.175962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 748/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:48.005779 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433411f-3c6b-424e-a395-b3a13fd930b9 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:48.006352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433411f-3c6b-424e-a395-b3a13fd930b9 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:48.006352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433411f-3c6b-424e-a395-b3a13fd930b9 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:48.007699 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:48.013235 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e494b-e578-4eb7-8ea0-081f5041c37d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:48.013696 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e494b-e578-4eb7-8ea0-081f5041c37d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:48.013819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e494b-e578-4eb7-8ea0-081f5041c37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:48.033167 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0c5e494b-e578-4eb7-8ea0-081f5041c37d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:48.034615 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0c5e494b-e578-4eb7-8ea0-081f5041c37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:48.042574 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:48.194083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433411f-3c6b-424e-a395-b3a13fd930b9 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:48.209124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433411f-3c6b-424e-a395-b3a13fd930b9 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:48.215440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63d4ab-b018-44ff-8228-bd40f09a12d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:48.216098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63d4ab-b018-44ff-8228-bd40f09a12d0 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:48.216371 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63d4ab-b018-44ff-8228-bd40f09a12d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:48.216659 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63d4ab-b018-44ff-8228-bd40f09a12d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:48.225434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63d4ab-b018-44ff-8228-bd40f09a12d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:48.227025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63d4ab-b018-44ff-8228-bd40f09a12d0 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:48.236699 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 767/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:00:53.339711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb737d-643f-4841-97a6-623872a51d03 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:53.340331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb737d-643f-4841-97a6-623872a51d03 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:53.340331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb737d-643f-4841-97a6-623872a51d03 None None] PATH_INFO: `/v3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:53.341592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 750/1517] 10.222.0.33 () {54 vars in 925 bytes} [Sun Aug 7 01:00:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:00:53.371415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc75c38-01bb-448d-831d-b8efcfe376ab None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:53.372035 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc75c38-01bb-448d-831d-b8efcfe376ab None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:53.372165 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc75c38-01bb-448d-831d-b8efcfe376ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:53.437110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-ddc75c38-01bb-448d-831d-b8efcfe376ab None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:53.438333 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ddc75c38-01bb-448d-831d-b8efcfe376ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:53.455727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:53.509695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 768/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Sun Aug 7 01:00:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:57.478402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721f5f6-f783-442e-a88c-85c4539b41ca None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:57.479020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721f5f6-f783-442e-a88c-85c4539b41ca None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:57.479020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721f5f6-f783-442e-a88c-85c4539b41ca None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:57.480205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 751/1519] 10.222.0.20 () {54 vars in 961 bytes} [Sun Aug 7 01:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:57.485119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1be1ad-7460-4531-9ddf-0f296ff6a4b9 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:57.485576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1be1ad-7460-4531-9ddf-0f296ff6a4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:57.485687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1be1ad-7460-4531-9ddf-0f296ff6a4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:57.504619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-2b1be1ad-7460-4531-9ddf-0f296ff6a4b9 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:57.505813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2b1be1ad-7460-4531-9ddf-0f296ff6a4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:57.515255 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 769/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Aug 7 01:00:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:57.522600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721f5f6-f783-442e-a88c-85c4539b41ca None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:57.537115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721f5f6-f783-442e-a88c-85c4539b41ca None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:57.542228 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d3336-3c10-44cb-826c-820e33988608 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:57.542839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d3336-3c10-44cb-826c-820e33988608 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:57.543152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d3336-3c10-44cb-826c-820e33988608 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:57.543425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d3336-3c10-44cb-826c-820e33988608 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:57.552058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d3336-3c10-44cb-826c-820e33988608 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:57.553633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d3336-3c10-44cb-826c-820e33988608 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:57.563669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 752/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:59.483163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfa7a9-ffc4-45a6-99a7-803ec183ed58 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:59.483727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfa7a9-ffc4-45a6-99a7-803ec183ed58 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:59.483727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfa7a9-ffc4-45a6-99a7-803ec183ed58 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:59.485117 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:59.489995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67cc55-7247-40cf-80a6-5a0e82b2c382 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:59.490449 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67cc55-7247-40cf-80a6-5a0e82b2c382 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:59.490550 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67cc55-7247-40cf-80a6-5a0e82b2c382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:59.510621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3f67cc55-7247-40cf-80a6-5a0e82b2c382 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:59.511801 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3f67cc55-7247-40cf-80a6-5a0e82b2c382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:59.520041 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:59.676222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfa7a9-ffc4-45a6-99a7-803ec183ed58 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:59.691559 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfa7a9-ffc4-45a6-99a7-803ec183ed58 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:59.697249 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbcdc9-c6ef-4e0f-8181-ee25a582049c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:59.697901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbcdc9-c6ef-4e0f-8181-ee25a582049c service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:59.698175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbcdc9-c6ef-4e0f-8181-ee25a582049c service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:59.698447 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbcdc9-c6ef-4e0f-8181-ee25a582049c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:59.707512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbcdc9-c6ef-4e0f-8181-ee25a582049c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:59.709158 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbcdc9-c6ef-4e0f-8181-ee25a582049c service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:59.719624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 771/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:01:00.550189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0db08-82c6-4be0-9786-195ddc99b362 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:00.550760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0db08-82c6-4be0-9786-195ddc99b362 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:00.550760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0db08-82c6-4be0-9786-195ddc99b362 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:00.552127 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:01:00.557852 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade6bed-73c7-4574-a9ec-7e0f4d93633e None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:00.558313 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade6bed-73c7-4574-a9ec-7e0f4d93633e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:00.558476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade6bed-73c7-4574-a9ec-7e0f4d93633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:00.578688 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-7ade6bed-73c7-4574-a9ec-7e0f4d93633e None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:01:00.579886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7ade6bed-73c7-4574-a9ec-7e0f4d93633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:00.588041 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:01:00.751605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0db08-82c6-4be0-9786-195ddc99b362 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:01:00.766541 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0db08-82c6-4be0-9786-195ddc99b362 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:01:00.771942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ae77f-9400-41ee-ad96-f1b2c70747da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:01:00.772543 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae77f-9400-41ee-ad96-f1b2c70747da service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:00.772825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae77f-9400-41ee-ad96-f1b2c70747da service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:00.773104 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae77f-9400-41ee-ad96-f1b2c70747da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:00.782036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ae77f-9400-41ee-ad96-f1b2c70747da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:01:00.783614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ae77f-9400-41ee-ad96-f1b2c70747da service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:01:00.794114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 755/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:01:04.839211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0973bf-dcde-4d1a-b4d0-f22977aeac61 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:04.839798 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0973bf-dcde-4d1a-b4d0-f22977aeac61 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:04.839931 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0973bf-dcde-4d1a-b4d0-f22977aeac61 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:04.841319 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:01:04.846442 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918146f-96b7-4880-957c-b3eed90dc284 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:04.846841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918146f-96b7-4880-957c-b3eed90dc284 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:04.846965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918146f-96b7-4880-957c-b3eed90dc284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:04.866444 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7918146f-96b7-4880-957c-b3eed90dc284 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:01:04.867630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7918146f-96b7-4880-957c-b3eed90dc284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:04.875762 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:01:04.957095 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0973bf-dcde-4d1a-b4d0-f22977aeac61 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:01:04.958846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-da0973bf-dcde-4d1a-b4d0-f22977aeac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:05.042156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0973bf-dcde-4d1a-b4d0-f22977aeac61 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:01:05.045874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdfe27-1a75-497d-b505-de6835291281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:01:05.046525 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdfe27-1a75-497d-b505-de6835291281 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:05.046783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdfe27-1a75-497d-b505-de6835291281 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:05.047049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdfe27-1a75-497d-b505-de6835291281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:05.056478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdfe27-1a75-497d-b505-de6835291281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:01:05.058270 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdfe27-1a75-497d-b505-de6835291281 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:01:05.067613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 774/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:01:07.113851 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f454b-821b-487a-875d-1f2a6f45c3fc None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:07.114431 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f454b-821b-487a-875d-1f2a6f45c3fc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:07.114431 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f454b-821b-487a-875d-1f2a6f45c3fc None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:07.115742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:01:07.121877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d912d37-48c0-4f4c-90a1-57919c24a249 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:07.122337 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d912d37-48c0-4f4c-90a1-57919c24a249 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:07.122436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d912d37-48c0-4f4c-90a1-57919c24a249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:07.143358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-6d912d37-48c0-4f4c-90a1-57919c24a249 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:01:07.144599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-6d912d37-48c0-4f4c-90a1-57919c24a249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:07.152554 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:01:07.189640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f454b-821b-487a-875d-1f2a6f45c3fc None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:01:07.191367 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6b0f454b-821b-487a-875d-1f2a6f45c3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:07.205741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f454b-821b-487a-875d-1f2a6f45c3fc None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:01:07.209333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d83307-f68a-44c3-b2cf-1a8f48eab371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:01:07.209938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d83307-f68a-44c3-b2cf-1a8f48eab371 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:07.210334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d83307-f68a-44c3-b2cf-1a8f48eab371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:07.210613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d83307-f68a-44c3-b2cf-1a8f48eab371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:07.220571 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d83307-f68a-44c3-b2cf-1a8f48eab371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:01:07.222007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d83307-f68a-44c3-b2cf-1a8f48eab371 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:01:07.231527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 758/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:01:17.137030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=73 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:17.227251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=80 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:25.713388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9a83e-7d5e-4d01-bd42-a5f76b195580 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:25.714887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9a83e-7d5e-4d01-bd42-a5f76b195580 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:25.714887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9a83e-7d5e-4d01-bd42-a5f76b195580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:25.743020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-a6d9a83e-7d5e-4d01-bd42-a5f76b195580 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:25.744265 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a6d9a83e-7d5e-4d01-bd42-a5f76b195580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:25.762328 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 776/1534] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 07 01:02:25.772238 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb8e7b-73c4-4d2e-b6c1-fc788652d690 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:25.772860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb8e7b-73c4-4d2e-b6c1-fc788652d690 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:25.773650 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb8e7b-73c4-4d2e-b6c1-fc788652d690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:25.807000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3efb8e7b-73c4-4d2e-b6c1-fc788652d690 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:25.808724 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3efb8e7b-73c4-4d2e-b6c1-fc788652d690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:25.824309 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 759/1535] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:02:25.830169 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9a83e-7d5e-4d01-bd42-a5f76b195580 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:25.847742 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9a83e-7d5e-4d01-bd42-a5f76b195580 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:25.855317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05892950-b39a-478e-9769-0fb12c6e2a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:25.855994 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05892950-b39a-478e-9769-0fb12c6e2a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:25.856273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05892950-b39a-478e-9769-0fb12c6e2a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:25.856563 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05892950-b39a-478e-9769-0fb12c6e2a9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:25.857235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05892950-b39a-478e-9769-0fb12c6e2a9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:25.857534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05892950-b39a-478e-9769-0fb12c6e2a9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:25.859183 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05892950-b39a-478e-9769-0fb12c6e2a9c admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:25.878846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 777/1536] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:02:25.888702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb8e7b-73c4-4d2e-b6c1-fc788652d690 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:25.903088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb8e7b-73c4-4d2e-b6c1-fc788652d690 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:25.916286 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba407d48-8288-468f-96e3-581145077b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:25.917389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba407d48-8288-468f-96e3-581145077b71 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:25.917945 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba407d48-8288-468f-96e3-581145077b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:25.918471 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba407d48-8288-468f-96e3-581145077b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:25.919443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba407d48-8288-468f-96e3-581145077b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:25.922318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba407d48-8288-468f-96e3-581145077b71 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:26.032142 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 760/1537] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:25 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:02:26.037293 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05892950-b39a-478e-9769-0fb12c6e2a9c admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:26.053271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05892950-b39a-478e-9769-0fb12c6e2a9c admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:26.143583 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341643ff-171f-4d5d-b8ef-b0c075caef5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:26.144268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341643ff-171f-4d5d-b8ef-b0c075caef5f admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:26.144603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341643ff-171f-4d5d-b8ef-b0c075caef5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:26.144879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341643ff-171f-4d5d-b8ef-b0c075caef5f admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:26.145542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341643ff-171f-4d5d-b8ef-b0c075caef5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:26.147541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341643ff-171f-4d5d-b8ef-b0c075caef5f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:26.182087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 778/1538] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:26 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:26.187752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba407d48-8288-468f-96e3-581145077b71 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:26.216318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba407d48-8288-468f-96e3-581145077b71 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:26.224777 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b9b04-11eb-42ea-8e0b-7fc87098d7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:26.226776 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b9b04-11eb-42ea-8e0b-7fc87098d7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:26.227224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b9b04-11eb-42ea-8e0b-7fc87098d7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:26.227738 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b9b04-11eb-42ea-8e0b-7fc87098d7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:26.233315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b9b04-11eb-42ea-8e0b-7fc87098d7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:26.236975 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b9b04-11eb-42ea-8e0b-7fc87098d7e7 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:26.264220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 761/1539] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:26.268503 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341643ff-171f-4d5d-b8ef-b0c075caef5f admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:26.288216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341643ff-171f-4d5d-b8ef-b0c075caef5f admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:26.297793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a6734-f092-4284-a9d6-99220c2e5ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:26.298433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a6734-f092-4284-a9d6-99220c2e5ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:26.298709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a6734-f092-4284-a9d6-99220c2e5ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:26.298977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a6734-f092-4284-a9d6-99220c2e5ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:26.299861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a6734-f092-4284-a9d6-99220c2e5ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:26.301819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a6734-f092-4284-a9d6-99220c2e5ef2 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:26.322823 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 779/1540] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:26.328000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b9b04-11eb-42ea-8e0b-7fc87098d7e7 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:26.350064 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b9b04-11eb-42ea-8e0b-7fc87098d7e7 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:26.358505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c1ac4-ed2f-459f-83e4-66ffd1d26819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:26.359608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c1ac4-ed2f-459f-83e4-66ffd1d26819 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:26.364576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c1ac4-ed2f-459f-83e4-66ffd1d26819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:26.365188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c1ac4-ed2f-459f-83e4-66ffd1d26819 admin admin] PATH_INFO: `/v3/projects/f19d01eeb6c14947ac9e68216200e707/users/219a6829c2ae4de59af799110590d106/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:26.403813 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c1ac4-ed2f-459f-83e4-66ffd1d26819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19d01eeb6c14947ac9e68216200e707, user_id=219a6829c2ae4de59af799110590d106, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:26.409520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c1ac4-ed2f-459f-83e4-66ffd1d26819 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:26.456644 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 762/1541] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:26 2022] PUT /identity/v3/projects/f19d01eeb6c14947ac9e68216200e707/users/219a6829c2ae4de59af799110590d106/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:26.462666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf899a-6f5f-4fdb-b333-4ce39b7d95f1 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:26.463023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf899a-6f5f-4fdb-b333-4ce39b7d95f1 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:26.463210 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf899a-6f5f-4fdb-b333-4ce39b7d95f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:26.474874 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f05945-8d87-40df-9562-e32d0a7604cd None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:26.475327 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f05945-8d87-40df-9562-e32d0a7604cd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:26.475749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f05945-8d87-40df-9562-e32d0a7604cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:26.500843 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-89bf899a-6f5f-4fdb-b333-4ce39b7d95f1 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:26.502099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-89bf899a-6f5f-4fdb-b333-4ce39b7d95f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:26.517711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d7f05945-8d87-40df-9562-e32d0a7604cd None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:26.519622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d7f05945-8d87-40df-9562-e32d0a7604cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:26.631354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 763/1542] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:02:26.646835 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079de44-d5d6-4490-8291-aa59890c8176 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:26.647495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079de44-d5d6-4490-8291-aa59890c8176 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:26.649235 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079de44-d5d6-4490-8291-aa59890c8176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:26.679971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 780/1543] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:02:26.682617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9079de44-d5d6-4490-8291-aa59890c8176 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:26.684216 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9079de44-d5d6-4490-8291-aa59890c8176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:26.695937 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf899a-6f5f-4fdb-b333-4ce39b7d95f1 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:26.706466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 764/1544] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:26.714560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079de44-d5d6-4490-8291-aa59890c8176 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:26.727982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079de44-d5d6-4490-8291-aa59890c8176 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:26.738851 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f96f52-b77c-4692-b96c-dd9a7934fcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:26.740552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f96f52-b77c-4692-b96c-dd9a7934fcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:26.741147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f96f52-b77c-4692-b96c-dd9a7934fcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:26.741647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f96f52-b77c-4692-b96c-dd9a7934fcd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:26.743278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f96f52-b77c-4692-b96c-dd9a7934fcd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:26.743998 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f96f52-b77c-4692-b96c-dd9a7934fcd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:26.745636 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: WARNING py.warnings [None req-07f96f52-b77c-4692-b96c-dd9a7934fcd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:02:26.745636 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: warnings.warn(msg) Aug 07 01:02:26.745636 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: Aug 07 01:02:26.747029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f96f52-b77c-4692-b96c-dd9a7934fcd6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:26.773665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 765/1545] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:02:26.776083 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19125931-5ae0-402a-80cf-e2ad000780a8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:26.776718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19125931-5ae0-402a-80cf-e2ad000780a8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:26.777530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19125931-5ae0-402a-80cf-e2ad000780a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:26.817722 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-19125931-5ae0-402a-80cf-e2ad000780a8 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:26.819614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-19125931-5ae0-402a-80cf-e2ad000780a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:26.840556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 766/1546] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:26.841723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19125931-5ae0-402a-80cf-e2ad000780a8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:26.859298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19125931-5ae0-402a-80cf-e2ad000780a8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:26.879128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe99cd-3e7f-4c07-a9fd-2073ce84a55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:26.879930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe99cd-3e7f-4c07-a9fd-2073ce84a55f admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:26.880295 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe99cd-3e7f-4c07-a9fd-2073ce84a55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:26.880632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe99cd-3e7f-4c07-a9fd-2073ce84a55f admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:26.881362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe99cd-3e7f-4c07-a9fd-2073ce84a55f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:26.884880 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe99cd-3e7f-4c07-a9fd-2073ce84a55f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:26.890727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf899a-6f5f-4fdb-b333-4ce39b7d95f1 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:26.910431 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9087bc-905a-4a96-b564-4a365fd25ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:26.911708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9087bc-905a-4a96-b564-4a365fd25ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:26.912217 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9087bc-905a-4a96-b564-4a365fd25ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:26.912676 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9087bc-905a-4a96-b564-4a365fd25ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:26.946452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9087bc-905a-4a96-b564-4a365fd25ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:26.948556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 767/1547] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:26 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:26.949100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9087bc-905a-4a96-b564-4a365fd25ce3 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:26.950054 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e765d-2464-489c-a358-be0f937a3752 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:26.950466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e765d-2464-489c-a358-be0f937a3752 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:26.950805 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e765d-2464-489c-a358-be0f937a3752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:26.998384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 781/1548] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:27.027005 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1f1e765d-2464-489c-a358-be0f937a3752 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:27.027005 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1f1e765d-2464-489c-a358-be0f937a3752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:27.036730 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352be7a0-10d3-4226-ab23-26782e3952cf None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.037434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352be7a0-10d3-4226-ab23-26782e3952cf None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.039385 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352be7a0-10d3-4226-ab23-26782e3952cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.087529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:27.109177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:27.147967 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-352be7a0-10d3-4226-ab23-26782e3952cf None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:27.147967 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-352be7a0-10d3-4226-ab23-26782e3952cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:27.160554 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 768/1549] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:27.162508 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e765d-2464-489c-a358-be0f937a3752 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:27.175137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 782/1550] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:27.178200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47ee5f-59a4-491d-90d3-9e8d57068462 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.178768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47ee5f-59a4-491d-90d3-9e8d57068462 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.180477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47ee5f-59a4-491d-90d3-9e8d57068462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.187717 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e765d-2464-489c-a358-be0f937a3752 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:27.195877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d768fc-4596-4364-8c01-ef84dc3c3c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:27.197131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d768fc-4596-4364-8c01-ef84dc3c3c06 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.197512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d768fc-4596-4364-8c01-ef84dc3c3c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.197919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d768fc-4596-4364-8c01-ef84dc3c3c06 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.198998 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d768fc-4596-4364-8c01-ef84dc3c3c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:27.201228 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: WARNING py.warnings [None req-39d768fc-4596-4364-8c01-ef84dc3c3c06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:02:27.201228 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: warnings.warn(msg) Aug 07 01:02:27.201228 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: Aug 07 01:02:27.203176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d768fc-4596-4364-8c01-ef84dc3c3c06 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:27.214667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-cd47ee5f-59a4-491d-90d3-9e8d57068462 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:27.216468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-cd47ee5f-59a4-491d-90d3-9e8d57068462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:27.230703 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 783/1551] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:27.239673 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb7645-4578-4b99-9d2b-6b7c5046adf9 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.240645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb7645-4578-4b99-9d2b-6b7c5046adf9 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.240645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb7645-4578-4b99-9d2b-6b7c5046adf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.250372 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 769/1552] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:27 2022] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:27.251533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbc89e-6aae-4e86-9037-716c778dbcf7 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.251828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbc89e-6aae-4e86-9037-716c778dbcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.252155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbc89e-6aae-4e86-9037-716c778dbcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.268102 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5fcb7645-4578-4b99-9d2b-6b7c5046adf9 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:27.270440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5fcb7645-4578-4b99-9d2b-6b7c5046adf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:27.281786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d2bbc89e-6aae-4e86-9037-716c778dbcf7 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:27.283135 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d2bbc89e-6aae-4e86-9037-716c778dbcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:27.295950 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 784/1553] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:27.295950 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb7645-4578-4b99-9d2b-6b7c5046adf9 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:27.300053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 770/1554] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:27.301521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99fcea-b5d9-4cb2-af1c-77e2cea16510 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.301801 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99fcea-b5d9-4cb2-af1c-77e2cea16510 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.302071 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99fcea-b5d9-4cb2-af1c-77e2cea16510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.313888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb7645-4578-4b99-9d2b-6b7c5046adf9 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:27.322582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73b59e-d10a-460b-8d1c-d0aa15c24ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:27.323686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73b59e-d10a-460b-8d1c-d0aa15c24ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.324102 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73b59e-d10a-460b-8d1c-d0aa15c24ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.324516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73b59e-d10a-460b-8d1c-d0aa15c24ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.325186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73b59e-d10a-460b-8d1c-d0aa15c24ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:27.325500 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73b59e-d10a-460b-8d1c-d0aa15c24ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:27.327312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ab99fcea-b5d9-4cb2-af1c-77e2cea16510 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:27.327638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73b59e-d10a-460b-8d1c-d0aa15c24ca6 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:27.328753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ab99fcea-b5d9-4cb2-af1c-77e2cea16510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:27.337639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 771/1555] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:27.342234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b5e26-58a8-4284-bea1-acbfc54e4d6f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.343170 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b5e26-58a8-4284-bea1-acbfc54e4d6f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.345454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b5e26-58a8-4284-bea1-acbfc54e4d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.348209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 785/1556] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:27.348370 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73b59e-d10a-460b-8d1c-d0aa15c24ca6 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:27.362754 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73b59e-d10a-460b-8d1c-d0aa15c24ca6 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:27.369560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7612cbc-1fa9-4ab6-aa34-7d8497e3e823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:27.370199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7612cbc-1fa9-4ab6-aa34-7d8497e3e823 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.370485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7612cbc-1fa9-4ab6-aa34-7d8497e3e823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.370759 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7612cbc-1fa9-4ab6-aa34-7d8497e3e823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.371674 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7612cbc-1fa9-4ab6-aa34-7d8497e3e823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:27.373143 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7612cbc-1fa9-4ab6-aa34-7d8497e3e823 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:27.381063 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-351b5e26-58a8-4284-bea1-acbfc54e4d6f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:27.382144 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-351b5e26-58a8-4284-bea1-acbfc54e4d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:27.391759 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 786/1557] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:27.393318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b7a94-894a-4cea-ae0a-0ab4313471e6 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.393603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b7a94-894a-4cea-ae0a-0ab4313471e6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.393881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b7a94-894a-4cea-ae0a-0ab4313471e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.406320 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 772/1558] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:27.406320 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b5e26-58a8-4284-bea1-acbfc54e4d6f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:27.410813 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b5e26-58a8-4284-bea1-acbfc54e4d6f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:27.417365 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf033614-b01a-4033-9eef-6d949c0aacb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:27.418015 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf033614-b01a-4033-9eef-6d949c0aacb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.418298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf033614-b01a-4033-9eef-6d949c0aacb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.418540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf033614-b01a-4033-9eef-6d949c0aacb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.419197 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf033614-b01a-4033-9eef-6d949c0aacb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:27.419493 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf033614-b01a-4033-9eef-6d949c0aacb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:27.423262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf033614-b01a-4033-9eef-6d949c0aacb1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:27.440067 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 773/1559] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:27.440067 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f77a3-83a0-4cf6-a6b9-74f5a105ae03 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.440067 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f77a3-83a0-4cf6-a6b9-74f5a105ae03 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.440067 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f77a3-83a0-4cf6-a6b9-74f5a105ae03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.441958 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-b72b7a94-894a-4cea-ae0a-0ab4313471e6 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:27.443491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b72b7a94-894a-4cea-ae0a-0ab4313471e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:27.463772 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 787/1560] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:27.465275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e4a72-5436-4dcd-80d6-fd7a5f8fa682 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.465561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e4a72-5436-4dcd-80d6-fd7a5f8fa682 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.465835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e4a72-5436-4dcd-80d6-fd7a5f8fa682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.472860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ed1f77a3-83a0-4cf6-a6b9-74f5a105ae03 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:27.474225 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ed1f77a3-83a0-4cf6-a6b9-74f5a105ae03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:27.485173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 774/1561] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:27.488295 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f77a3-83a0-4cf6-a6b9-74f5a105ae03 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:27.498829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-ae0e4a72-5436-4dcd-80d6-fd7a5f8fa682 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:27.500245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ae0e4a72-5436-4dcd-80d6-fd7a5f8fa682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:27.501348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f77a3-83a0-4cf6-a6b9-74f5a105ae03 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:27.506476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c00300-9d7f-4d12-b4d4-f87a71112f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:27.508199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c00300-9d7f-4d12-b4d4-f87a71112f09 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.509382 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c00300-9d7f-4d12-b4d4-f87a71112f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.509784 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c00300-9d7f-4d12-b4d4-f87a71112f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.510556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c00300-9d7f-4d12-b4d4-f87a71112f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:27.518462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c00300-9d7f-4d12-b4d4-f87a71112f09 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:27.518647 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 788/1562] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:27.518647 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e4a72-5436-4dcd-80d6-fd7a5f8fa682 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:27.526552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e4a72-5436-4dcd-80d6-fd7a5f8fa682 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:27.538312 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd74ae-fe8b-47da-80f4-051ff94ee1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:27.539503 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd74ae-fe8b-47da-80f4-051ff94ee1bd admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.540055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd74ae-fe8b-47da-80f4-051ff94ee1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.540749 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd74ae-fe8b-47da-80f4-051ff94ee1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.542356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd74ae-fe8b-47da-80f4-051ff94ee1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:27.546939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd74ae-fe8b-47da-80f4-051ff94ee1bd admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:27.563841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 789/1563] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:27.565012 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd74ae-fe8b-47da-80f4-051ff94ee1bd admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:27.577637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd74ae-fe8b-47da-80f4-051ff94ee1bd admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:27.579972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 775/1564] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:27 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:27.581488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c00300-9d7f-4d12-b4d4-f87a71112f09 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:27.684644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a2609-0812-4002-9c32-4ab97e37a5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:27.685448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a2609-0812-4002-9c32-4ab97e37a5fd admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.685855 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a2609-0812-4002-9c32-4ab97e37a5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.687109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a2609-0812-4002-9c32-4ab97e37a5fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.688034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a2609-0812-4002-9c32-4ab97e37a5fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:27.688441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a2609-0812-4002-9c32-4ab97e37a5fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:27.689531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c00300-9d7f-4d12-b4d4-f87a71112f09 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:27.690316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a2609-0812-4002-9c32-4ab97e37a5fd admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:27.699510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd83a2d-d980-4e3a-a9e8-262271a03537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:27.703410 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd83a2d-d980-4e3a-a9e8-262271a03537 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.703700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd83a2d-d980-4e3a-a9e8-262271a03537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.704009 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd83a2d-d980-4e3a-a9e8-262271a03537 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.705524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd83a2d-d980-4e3a-a9e8-262271a03537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:27.709009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 790/1565] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:27.709455 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd83a2d-d980-4e3a-a9e8-262271a03537 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:27.710088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a2609-0812-4002-9c32-4ab97e37a5fd admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:27.734858 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a2609-0812-4002-9c32-4ab97e37a5fd admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:27.746317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9f502-4731-45f4-8694-2d6a2a38f16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:27.746764 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9f502-4731-45f4-8694-2d6a2a38f16f admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.747015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9f502-4731-45f4-8694-2d6a2a38f16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.747282 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9f502-4731-45f4-8694-2d6a2a38f16f admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.748166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9f502-4731-45f4-8694-2d6a2a38f16f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:27.748482 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9f502-4731-45f4-8694-2d6a2a38f16f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:27.750555 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9f502-4731-45f4-8694-2d6a2a38f16f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:27.767542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 791/1566] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:27.769186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 776/1567] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:27 2022] POST /identity/v3/projects => generated 369 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:27.771885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd83a2d-d980-4e3a-a9e8-262271a03537 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:27.772089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d6484-09fa-4264-8006-47fba44e0290 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.772480 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d6484-09fa-4264-8006-47fba44e0290 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.772767 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d6484-09fa-4264-8006-47fba44e0290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.797561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e99d6484-09fa-4264-8006-47fba44e0290 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:27.798903 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e99d6484-09fa-4264-8006-47fba44e0290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:27.879665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:27.920085 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd83a2d-d980-4e3a-a9e8-262271a03537 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:27.924501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 792/1568] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:27.925701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d6484-09fa-4264-8006-47fba44e0290 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:27.932725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df14ac6-023b-4bf3-8db0-f65218589547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:27.934306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df14ac6-023b-4bf3-8db0-f65218589547 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.934885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df14ac6-023b-4bf3-8db0-f65218589547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.935768 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df14ac6-023b-4bf3-8db0-f65218589547 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.937397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df14ac6-023b-4bf3-8db0-f65218589547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:27.938820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df14ac6-023b-4bf3-8db0-f65218589547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:27.942039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df14ac6-023b-4bf3-8db0-f65218589547 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:27.944926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d6484-09fa-4264-8006-47fba44e0290 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:27.953759 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb0183-7905-40a1-8aa5-603c589ed7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:27.955779 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb0183-7905-40a1-8aa5-603c589ed7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.956997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb0183-7905-40a1-8aa5-603c589ed7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.957762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb0183-7905-40a1-8aa5-603c589ed7c9 admin admin] PATH_INFO: `/v3/projects/0ba2637d5962441787ce53702dbcbcc8/users/48938fc8a89547c3a91caeead99f5a81/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.963539 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 777/1569] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:27.964710 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df14ac6-023b-4bf3-8db0-f65218589547 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:27.985324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:27.986633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df14ac6-023b-4bf3-8db0-f65218589547 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:27.994039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd9009-e7ed-4679-b88a-3c640aee7e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:27.994291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb0183-7905-40a1-8aa5-603c589ed7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba2637d5962441787ce53702dbcbcc8, user_id=48938fc8a89547c3a91caeead99f5a81, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:27.994427 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd9009-e7ed-4679-b88a-3c640aee7e13 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:27.994598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd9009-e7ed-4679-b88a-3c640aee7e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:27.994885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd9009-e7ed-4679-b88a-3c640aee7e13 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:27.995705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd9009-e7ed-4679-b88a-3c640aee7e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:27.996218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: WARNING py.warnings [None req-0cdb0183-7905-40a1-8aa5-603c589ed7c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:02:27.996218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: warnings.warn(msg) Aug 07 01:02:27.996218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: Aug 07 01:02:27.997901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd9009-e7ed-4679-b88a-3c640aee7e13 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.001091 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb0183-7905-40a1-8aa5-603c589ed7c9 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.033065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 793/1570] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:27 2022] PUT /identity/v3/projects/0ba2637d5962441787ce53702dbcbcc8/users/48938fc8a89547c3a91caeead99f5a81/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:28.034115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb0183-7905-40a1-8aa5-603c589ed7c9 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.035179 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 778/1571] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:27 2022] POST /identity/v3/users => generated 290 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:28.037816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd9009-e7ed-4679-b88a-3c640aee7e13 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.071500 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd9009-e7ed-4679-b88a-3c640aee7e13 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:28.148608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb0183-7905-40a1-8aa5-603c589ed7c9 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:28.161829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd302375-0e3b-41a9-a953-e0966fdc996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:28.162966 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd302375-0e3b-41a9-a953-e0966fdc996c admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.163441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd302375-0e3b-41a9-a953-e0966fdc996c admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.163991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd302375-0e3b-41a9-a953-e0966fdc996c admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.165453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd302375-0e3b-41a9-a953-e0966fdc996c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:28.167769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: WARNING py.warnings [None req-cd302375-0e3b-41a9-a953-e0966fdc996c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:02:28.167769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: warnings.warn(msg) Aug 07 01:02:28.167769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: Aug 07 01:02:28.170250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd302375-0e3b-41a9-a953-e0966fdc996c admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.190402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2aba6-6fe6-4854-8447-02c9af646dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:28.191587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2aba6-6fe6-4854-8447-02c9af646dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.192024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2aba6-6fe6-4854-8447-02c9af646dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.192300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2aba6-6fe6-4854-8447-02c9af646dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.193089 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2aba6-6fe6-4854-8447-02c9af646dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:28.195834 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2aba6-6fe6-4854-8447-02c9af646dd8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.243747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 779/1572] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:28 2022] POST /identity/v3/users => generated 285 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:28.246071 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2aba6-6fe6-4854-8447-02c9af646dd8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.270241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 794/1573] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:28 2022] POST /identity/v3/projects => generated 389 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:28.270241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd302375-0e3b-41a9-a953-e0966fdc996c admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.276059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2aba6-6fe6-4854-8447-02c9af646dd8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:28.425356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd302375-0e3b-41a9-a953-e0966fdc996c admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:28.430044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467495fe-6ded-487b-b61b-01dd949f0360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:28.431234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467495fe-6ded-487b-b61b-01dd949f0360 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.431778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467495fe-6ded-487b-b61b-01dd949f0360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.432280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467495fe-6ded-487b-b61b-01dd949f0360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.433423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467495fe-6ded-487b-b61b-01dd949f0360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:28.437199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae4804-75c0-4fa0-a98e-df894e0b02a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:28.437378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467495fe-6ded-487b-b61b-01dd949f0360 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.438571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae4804-75c0-4fa0-a98e-df894e0b02a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.439299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae4804-75c0-4fa0-a98e-df894e0b02a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.440016 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae4804-75c0-4fa0-a98e-df894e0b02a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.441795 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae4804-75c0-4fa0-a98e-df894e0b02a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:28.442568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae4804-75c0-4fa0-a98e-df894e0b02a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:28.446725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae4804-75c0-4fa0-a98e-df894e0b02a9 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.491293 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 795/1574] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:28.493402 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae4804-75c0-4fa0-a98e-df894e0b02a9 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.497390 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 780/1575] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:28 2022] POST /identity/v3/projects => generated 369 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:28.499823 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467495fe-6ded-487b-b61b-01dd949f0360 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.512654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae4804-75c0-4fa0-a98e-df894e0b02a9 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:28.583212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:28.612410 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292dc624-b4a5-4687-b4ca-493fe956afa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:28.613369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dc624-b4a5-4687-b4ca-493fe956afa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.613658 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dc624-b4a5-4687-b4ca-493fe956afa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.613976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dc624-b4a5-4687-b4ca-493fe956afa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.614860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292dc624-b4a5-4687-b4ca-493fe956afa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:28.617900 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292dc624-b4a5-4687-b4ca-493fe956afa3 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.634162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467495fe-6ded-487b-b61b-01dd949f0360 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:28.643163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:28.661338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3b246-c0bd-47f9-8945-185ac8ddea20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:28.662231 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b246-c0bd-47f9-8945-185ac8ddea20 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.662819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b246-c0bd-47f9-8945-185ac8ddea20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.664621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b246-c0bd-47f9-8945-185ac8ddea20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.665441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 796/1576] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:28 2022] POST /identity/v3/projects => generated 411 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:28.666302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3b246-c0bd-47f9-8945-185ac8ddea20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:28.667310 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf24fcc-6120-453c-bc61-5c0fc98dd45c None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.667739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf24fcc-6120-453c-bc61-5c0fc98dd45c None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.668172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf24fcc-6120-453c-bc61-5c0fc98dd45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.670280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c3b246-c0bd-47f9-8945-185ac8ddea20 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.702284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 781/1577] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:28.702284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3b246-c0bd-47f9-8945-185ac8ddea20 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.716759 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-edf24fcc-6120-453c-bc61-5c0fc98dd45c None None] MFA Rules not processed for user `48938fc8a89547c3a91caeead99f5a81`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:28.718378 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-edf24fcc-6120-453c-bc61-5c0fc98dd45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:28.721762 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3b246-c0bd-47f9-8945-185ac8ddea20 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:28.820597 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4b17b-6375-45b1-974c-f8e55f82145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:28.821279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4b17b-6375-45b1-974c-f8e55f82145a admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.821598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4b17b-6375-45b1-974c-f8e55f82145a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.822649 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4b17b-6375-45b1-974c-f8e55f82145a admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.823543 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4b17b-6375-45b1-974c-f8e55f82145a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:28.826459 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4b17b-6375-45b1-974c-f8e55f82145a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.843892 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 782/1578] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:28.844661 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4b17b-6375-45b1-974c-f8e55f82145a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.858000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4b17b-6375-45b1-974c-f8e55f82145a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:28.868162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae4bb4-c2e0-43df-97a3-dab3b430ffa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:28.868798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae4bb4-c2e0-43df-97a3-dab3b430ffa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.869078 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae4bb4-c2e0-43df-97a3-dab3b430ffa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.869349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae4bb4-c2e0-43df-97a3-dab3b430ffa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.870063 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae4bb4-c2e0-43df-97a3-dab3b430ffa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:28.871495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 797/1579] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:28.872097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae4bb4-c2e0-43df-97a3-dab3b430ffa6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.873099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf24fcc-6120-453c-bc61-5c0fc98dd45c None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.895974 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf24fcc-6120-453c-bc61-5c0fc98dd45c None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:28.901130 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 783/1580] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:28 2022] POST /identity/v3/users => generated 295 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:28.902086 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae4bb4-c2e0-43df-97a3-dab3b430ffa6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.908999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af1d14-0110-4639-8936-d343a64b93a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:28.910397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af1d14-0110-4639-8936-d343a64b93a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.910614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af1d14-0110-4639-8936-d343a64b93a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.911744 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af1d14-0110-4639-8936-d343a64b93a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.913011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af1d14-0110-4639-8936-d343a64b93a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:28.914091 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae4bb4-c2e0-43df-97a3-dab3b430ffa6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:28.918045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af1d14-0110-4639-8936-d343a64b93a7 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.920969 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c9264-418b-4d38-9105-88ea2a98305e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:28.921616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c9264-418b-4d38-9105-88ea2a98305e admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:28.921940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c9264-418b-4d38-9105-88ea2a98305e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:28.922220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c9264-418b-4d38-9105-88ea2a98305e admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:28.922910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c9264-418b-4d38-9105-88ea2a98305e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:28.925041 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c9264-418b-4d38-9105-88ea2a98305e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:28.965503 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 798/1581] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:28 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:28.966450 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af1d14-0110-4639-8936-d343a64b93a7 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:28.973524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 784/1582] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:28 2022] POST /identity/v3/users => generated 285 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:28.973524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c9264-418b-4d38-9105-88ea2a98305e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.000293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c9264-418b-4d38-9105-88ea2a98305e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.062927 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af1d14-0110-4639-8936-d343a64b93a7 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.073022 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6d0ad-9da4-4483-93b3-8bcd1555c61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.073805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6d0ad-9da4-4483-93b3-8bcd1555c61f admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.074084 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6d0ad-9da4-4483-93b3-8bcd1555c61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.074388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6d0ad-9da4-4483-93b3-8bcd1555c61f admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.076105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6d0ad-9da4-4483-93b3-8bcd1555c61f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.078997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6d0ad-9da4-4483-93b3-8bcd1555c61f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.116376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 799/1583] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:28 2022] POST /identity/v3/users => generated 306 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:29.119968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6d0ad-9da4-4483-93b3-8bcd1555c61f admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.137376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6d0ad-9da4-4483-93b3-8bcd1555c61f admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.144594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b80999-8fd0-424f-8eab-452ae32bf81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.145386 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b80999-8fd0-424f-8eab-452ae32bf81d admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.145740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b80999-8fd0-424f-8eab-452ae32bf81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.146218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b80999-8fd0-424f-8eab-452ae32bf81d admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.146694 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d832e-1d47-4a26-82ce-dcf7ee319a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.147016 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b80999-8fd0-424f-8eab-452ae32bf81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.148159 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d832e-1d47-4a26-82ce-dcf7ee319a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.148891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d832e-1d47-4a26-82ce-dcf7ee319a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.149182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b80999-8fd0-424f-8eab-452ae32bf81d admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.150471 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d832e-1d47-4a26-82ce-dcf7ee319a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.152597 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d832e-1d47-4a26-82ce-dcf7ee319a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.156867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d832e-1d47-4a26-82ce-dcf7ee319a4d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.165373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 800/1584] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:29.171345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b80999-8fd0-424f-8eab-452ae32bf81d admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.186135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b80999-8fd0-424f-8eab-452ae32bf81d admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.196738 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 785/1585] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:29.198124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d832e-1d47-4a26-82ce-dcf7ee319a4d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.199293 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e70d35-b6ad-495c-9bed-9f58a5f838d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.200451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e70d35-b6ad-495c-9bed-9f58a5f838d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.200827 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e70d35-b6ad-495c-9bed-9f58a5f838d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.201082 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e70d35-b6ad-495c-9bed-9f58a5f838d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.202125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e70d35-b6ad-495c-9bed-9f58a5f838d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.204869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e70d35-b6ad-495c-9bed-9f58a5f838d5 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.225394 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d832e-1d47-4a26-82ce-dcf7ee319a4d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.238402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a98ba-3e27-456a-a90d-58c28c8defac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.238850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a98ba-3e27-456a-a90d-58c28c8defac admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.239150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a98ba-3e27-456a-a90d-58c28c8defac admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.239416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a98ba-3e27-456a-a90d-58c28c8defac admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.242448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a98ba-3e27-456a-a90d-58c28c8defac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.246149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a98ba-3e27-456a-a90d-58c28c8defac admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.259310 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 801/1586] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:29 2022] POST /identity/v3/projects => generated 367 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:29.259896 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e70d35-b6ad-495c-9bed-9f58a5f838d5 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.272962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 786/1587] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:29.275095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a98ba-3e27-456a-a90d-58c28c8defac admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.292286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:29.301444 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a98ba-3e27-456a-a90d-58c28c8defac admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.350523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:29.394936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e70d35-b6ad-495c-9bed-9f58a5f838d5 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.403175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a9882-5645-4d50-8a17-3ead072bfcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.405037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a9882-5645-4d50-8a17-3ead072bfcbc admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.405427 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a9882-5645-4d50-8a17-3ead072bfcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.405836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a9882-5645-4d50-8a17-3ead072bfcbc admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.406605 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a9882-5645-4d50-8a17-3ead072bfcbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.411616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a9882-5645-4d50-8a17-3ead072bfcbc admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.450538 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 802/1588] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:29 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:29.454642 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a9882-5645-4d50-8a17-3ead072bfcbc admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.475261 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a9882-5645-4d50-8a17-3ead072bfcbc admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.494973 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ca72a-f2f4-41a8-b370-93b1dc7ffa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.496894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ca72a-f2f4-41a8-b370-93b1dc7ffa06 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.497639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ca72a-f2f4-41a8-b370-93b1dc7ffa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.497903 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b5bc3-44e6-4c72-8b12-10ad7beff325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.498259 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ca72a-f2f4-41a8-b370-93b1dc7ffa06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.498870 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b5bc3-44e6-4c72-8b12-10ad7beff325 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.499161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ca72a-f2f4-41a8-b370-93b1dc7ffa06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.499455 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b5bc3-44e6-4c72-8b12-10ad7beff325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.499869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b5bc3-44e6-4c72-8b12-10ad7beff325 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.500736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b5bc3-44e6-4c72-8b12-10ad7beff325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.501999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ca72a-f2f4-41a8-b370-93b1dc7ffa06 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.502516 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b5bc3-44e6-4c72-8b12-10ad7beff325 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.519288 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 803/1589] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:29.520636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ca72a-f2f4-41a8-b370-93b1dc7ffa06 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.529024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 787/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:29.529024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b5bc3-44e6-4c72-8b12-10ad7beff325 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.535221 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ca72a-f2f4-41a8-b370-93b1dc7ffa06 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.541918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b5bc3-44e6-4c72-8b12-10ad7beff325 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.543356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed44b98-ef6b-47be-9e68-2e1923bbbaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.545315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed44b98-ef6b-47be-9e68-2e1923bbbaef admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.545659 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed44b98-ef6b-47be-9e68-2e1923bbbaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.545940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed44b98-ef6b-47be-9e68-2e1923bbbaef admin admin] PATH_INFO: `/v3/projects/1525346c41d845eaaeb50da3db3bb36d/users/3bb7fa6ec32e43d981c333ef7331a758/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.548800 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a37fbb-c532-4fae-b6a8-161500f62ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.549574 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a37fbb-c532-4fae-b6a8-161500f62ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.549924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a37fbb-c532-4fae-b6a8-161500f62ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.550269 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a37fbb-c532-4fae-b6a8-161500f62ed7 admin admin] PATH_INFO: `/v3/projects/b14fa476ccaa46858631f2e568f3b08c/users/d75986e659174d50881e14a275adeb76/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.567732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed44b98-ef6b-47be-9e68-2e1923bbbaef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1525346c41d845eaaeb50da3db3bb36d, user_id=3bb7fa6ec32e43d981c333ef7331a758, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.569769 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a37fbb-c532-4fae-b6a8-161500f62ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14fa476ccaa46858631f2e568f3b08c, user_id=d75986e659174d50881e14a275adeb76, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.572172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed44b98-ef6b-47be-9e68-2e1923bbbaef admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.573006 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a37fbb-c532-4fae-b6a8-161500f62ed7 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.592169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 788/1591] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:29 2022] PUT /identity/v3/projects/b14fa476ccaa46858631f2e568f3b08c/users/d75986e659174d50881e14a275adeb76/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:29.593119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a37fbb-c532-4fae-b6a8-161500f62ed7 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.609555 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 804/1592] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:29 2022] PUT /identity/v3/projects/1525346c41d845eaaeb50da3db3bb36d/users/3bb7fa6ec32e43d981c333ef7331a758/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:29.612184 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed44b98-ef6b-47be-9e68-2e1923bbbaef admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.762821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a37fbb-c532-4fae-b6a8-161500f62ed7 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.770267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603d423-7a91-41bd-a364-494a34bdf968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.770490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed44b98-ef6b-47be-9e68-2e1923bbbaef admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.770640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603d423-7a91-41bd-a364-494a34bdf968 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.771987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603d423-7a91-41bd-a364-494a34bdf968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.771987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603d423-7a91-41bd-a364-494a34bdf968 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.772392 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603d423-7a91-41bd-a364-494a34bdf968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.776191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603d423-7a91-41bd-a364-494a34bdf968 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.796332 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de32206-5e6d-4a4c-a4fb-cad2cee1ffcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.797668 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de32206-5e6d-4a4c-a4fb-cad2cee1ffcd admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.798411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de32206-5e6d-4a4c-a4fb-cad2cee1ffcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.798980 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de32206-5e6d-4a4c-a4fb-cad2cee1ffcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.800386 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de32206-5e6d-4a4c-a4fb-cad2cee1ffcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.803936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de32206-5e6d-4a4c-a4fb-cad2cee1ffcd admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.813271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 789/1593] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:29 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:29.815048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603d423-7a91-41bd-a364-494a34bdf968 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.831941 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 805/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:29.833249 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de32206-5e6d-4a4c-a4fb-cad2cee1ffcd admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.834846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603d423-7a91-41bd-a364-494a34bdf968 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.844134 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1030c-c2c2-49c8-a2a7-029b77fd8ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.845149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1030c-c2c2-49c8-a2a7-029b77fd8ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.845743 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1030c-c2c2-49c8-a2a7-029b77fd8ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.845860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de32206-5e6d-4a4c-a4fb-cad2cee1ffcd admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.846284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1030c-c2c2-49c8-a2a7-029b77fd8ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.847441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1030c-c2c2-49c8-a2a7-029b77fd8ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.856824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1030c-c2c2-49c8-a2a7-029b77fd8ecc admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.871121 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4052f67-2dd4-44a0-a46e-8b1dad328c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.871816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4052f67-2dd4-44a0-a46e-8b1dad328c14 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.872591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4052f67-2dd4-44a0-a46e-8b1dad328c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.873005 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4052f67-2dd4-44a0-a46e-8b1dad328c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.873927 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4052f67-2dd4-44a0-a46e-8b1dad328c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.877435 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4052f67-2dd4-44a0-a46e-8b1dad328c14 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.892536 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 790/1595] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:29.892536 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1030c-c2c2-49c8-a2a7-029b77fd8ecc admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.897902 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 806/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:29.899398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f2bd9-6987-456d-898f-1b0f501c72e4 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.899737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f2bd9-6987-456d-898f-1b0f501c72e4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.900068 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f2bd9-6987-456d-898f-1b0f501c72e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.915492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1030c-c2c2-49c8-a2a7-029b77fd8ecc admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.924875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-071f2bd9-6987-456d-898f-1b0f501c72e4 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:29.926332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0c3d9-f9c7-4756-9233-8498951c5fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:29.926525 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-071f2bd9-6987-456d-898f-1b0f501c72e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:29.927349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0c3d9-f9c7-4756-9233-8498951c5fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.927863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0c3d9-f9c7-4756-9233-8498951c5fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.928416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0c3d9-f9c7-4756-9233-8498951c5fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.929977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0c3d9-f9c7-4756-9233-8498951c5fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:29.933073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0c3d9-f9c7-4756-9233-8498951c5fb0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:29.935582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 807/1597] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:29.937399 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407202b-aacc-45d9-ac46-6596b2d5e1e2 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:29.937683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407202b-aacc-45d9-ac46-6596b2d5e1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:29.937984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407202b-aacc-45d9-ac46-6596b2d5e1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:29.967407 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 791/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:29.968944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0c3d9-f9c7-4756-9233-8498951c5fb0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:29.995245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0c3d9-f9c7-4756-9233-8498951c5fb0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:29.997090 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-2407202b-aacc-45d9-ac46-6596b2d5e1e2 None None] MFA Rules not processed for user `3bb7fa6ec32e43d981c333ef7331a758`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:29.999963 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2407202b-aacc-45d9-ac46-6596b2d5e1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:30.000354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af759059-b023-420e-bb28-507ffcb4a4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:30.001000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af759059-b023-420e-bb28-507ffcb4a4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:30.001280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af759059-b023-420e-bb28-507ffcb4a4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:30.001554 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af759059-b023-420e-bb28-507ffcb4a4f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:30.002214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af759059-b023-420e-bb28-507ffcb4a4f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:30.003842 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af759059-b023-420e-bb28-507ffcb4a4f9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:30.017082 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 792/1599] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:30.017991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af759059-b023-420e-bb28-507ffcb4a4f9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:30.032080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af759059-b023-420e-bb28-507ffcb4a4f9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:30.037655 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdcb1a-bcd1-482d-8a21-4fb1d6f1ef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:30.038415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdcb1a-bcd1-482d-8a21-4fb1d6f1ef51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:30.039430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdcb1a-bcd1-482d-8a21-4fb1d6f1ef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:30.039761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdcb1a-bcd1-482d-8a21-4fb1d6f1ef51 admin admin] PATH_INFO: `/v3/projects/3a1838912d7d4c198f58ff2b8087ce21/users/a5e1412b6a8c4552aa60266f82135351/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:30.059803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdcb1a-bcd1-482d-8a21-4fb1d6f1ef51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1838912d7d4c198f58ff2b8087ce21, user_id=a5e1412b6a8c4552aa60266f82135351, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:30.062912 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdcb1a-bcd1-482d-8a21-4fb1d6f1ef51 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:30.085064 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 793/1600] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:30 2022] PUT /identity/v3/projects/3a1838912d7d4c198f58ff2b8087ce21/users/a5e1412b6a8c4552aa60266f82135351/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:30.087127 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdcb1a-bcd1-482d-8a21-4fb1d6f1ef51 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:30.111883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:30.146051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:30.151959 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 808/1601] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:30.153220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407202b-aacc-45d9-ac46-6596b2d5e1e2 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:30.173240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407202b-aacc-45d9-ac46-6596b2d5e1e2 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:30.260261 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdcb1a-bcd1-482d-8a21-4fb1d6f1ef51 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:30.275004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8fbb6-b1df-4355-93ce-9091d60aad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:30.277448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8fbb6-b1df-4355-93ce-9091d60aad11 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:30.278006 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8fbb6-b1df-4355-93ce-9091d60aad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:30.278617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8fbb6-b1df-4355-93ce-9091d60aad11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:30.280399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8fbb6-b1df-4355-93ce-9091d60aad11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:30.286705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8fbb6-b1df-4355-93ce-9091d60aad11 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:30.316118 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 794/1602] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:30.316382 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f512c-490d-42da-84b5-49e13d1e3315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:30.317147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8fbb6-b1df-4355-93ce-9091d60aad11 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:30.317968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f512c-490d-42da-84b5-49e13d1e3315 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:30.319092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f512c-490d-42da-84b5-49e13d1e3315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:30.319711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f512c-490d-42da-84b5-49e13d1e3315 admin admin] PATH_INFO: `/v3/projects/9dc88202a3da4d7c88bc162a4dccc1d1/users/46a8bec265f549f4a4f4efa44582bf57/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:30.356803 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f512c-490d-42da-84b5-49e13d1e3315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc88202a3da4d7c88bc162a4dccc1d1, user_id=46a8bec265f549f4a4f4efa44582bf57, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:30.360328 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f512c-490d-42da-84b5-49e13d1e3315 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:30.381251 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 809/1603] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:30 2022] PUT /identity/v3/projects/9dc88202a3da4d7c88bc162a4dccc1d1/users/46a8bec265f549f4a4f4efa44582bf57/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:30.382637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f512c-490d-42da-84b5-49e13d1e3315 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:30.448752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8fbb6-b1df-4355-93ce-9091d60aad11 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:30.547402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff23ff-7f9e-4432-85a4-0cb2fcd87d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:30.548093 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff23ff-7f9e-4432-85a4-0cb2fcd87d47 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:30.548381 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff23ff-7f9e-4432-85a4-0cb2fcd87d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:30.548659 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff23ff-7f9e-4432-85a4-0cb2fcd87d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:30.556975 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f512c-490d-42da-84b5-49e13d1e3315 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:30.560729 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff23ff-7f9e-4432-85a4-0cb2fcd87d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:30.562389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff23ff-7f9e-4432-85a4-0cb2fcd87d47 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:30.569654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be171a-3c7c-48e4-a00a-0042600f21e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:30.571798 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be171a-3c7c-48e4-a00a-0042600f21e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:30.572414 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be171a-3c7c-48e4-a00a-0042600f21e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:30.573062 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be171a-3c7c-48e4-a00a-0042600f21e9 admin admin] PATH_INFO: `/v3/projects/0a50d865f8ee434f9311bd911c1c43d7/users/9917479b51b54bc9861e4db4aa0157aa/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:30.576765 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 795/1604] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:30.577701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff23ff-7f9e-4432-85a4-0cb2fcd87d47 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:30.590029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff23ff-7f9e-4432-85a4-0cb2fcd87d47 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:30.597452 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86d32c-494b-4a0e-b6f8-ccfcdec6d0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:30.598205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86d32c-494b-4a0e-b6f8-ccfcdec6d0fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:30.598537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86d32c-494b-4a0e-b6f8-ccfcdec6d0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:30.598807 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86d32c-494b-4a0e-b6f8-ccfcdec6d0fd admin admin] PATH_INFO: `/v3/projects/913dd11fdf254b3ebb975bc4491a8940/users/eed4445a42de4e17b5e3f0e1e0909a38/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:30.621028 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be171a-3c7c-48e4-a00a-0042600f21e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a50d865f8ee434f9311bd911c1c43d7, user_id=9917479b51b54bc9861e4db4aa0157aa, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:30.624431 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86d32c-494b-4a0e-b6f8-ccfcdec6d0fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=913dd11fdf254b3ebb975bc4491a8940, user_id=eed4445a42de4e17b5e3f0e1e0909a38, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:30.629150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86d32c-494b-4a0e-b6f8-ccfcdec6d0fd admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:30.640384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be171a-3c7c-48e4-a00a-0042600f21e9 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:30.664624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 796/1605] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:30 2022] PUT /identity/v3/projects/913dd11fdf254b3ebb975bc4491a8940/users/eed4445a42de4e17b5e3f0e1e0909a38/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:30.664624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaed8e-32c8-4169-9726-5e1e8dc7239e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:30.664624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaed8e-32c8-4169-9726-5e1e8dc7239e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:30.664624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaed8e-32c8-4169-9726-5e1e8dc7239e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:30.681251 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 810/1606] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:30 2022] PUT /identity/v3/projects/0a50d865f8ee434f9311bd911c1c43d7/users/9917479b51b54bc9861e4db4aa0157aa/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:30.682127 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be171a-3c7c-48e4-a00a-0042600f21e9 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:30.749095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-93aaed8e-32c8-4169-9726-5e1e8dc7239e None None] MFA Rules not processed for user `a5e1412b6a8c4552aa60266f82135351`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:30.752568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-93aaed8e-32c8-4169-9726-5e1e8dc7239e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:30.891188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:30.946919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:30.954242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be171a-3c7c-48e4-a00a-0042600f21e9 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:30.965274 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679764b0-9aee-441e-970c-8c22e30c14a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:30.967098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679764b0-9aee-441e-970c-8c22e30c14a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:30.967456 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679764b0-9aee-441e-970c-8c22e30c14a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:30.968013 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679764b0-9aee-441e-970c-8c22e30c14a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:30.969075 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679764b0-9aee-441e-970c-8c22e30c14a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:30.972753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679764b0-9aee-441e-970c-8c22e30c14a8 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:31.022095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 797/1607] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:31.027520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaed8e-32c8-4169-9726-5e1e8dc7239e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:31.070312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaed8e-32c8-4169-9726-5e1e8dc7239e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:31.074304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 811/1608] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:30 2022] POST /identity/v3/projects => generated 365 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:31.075972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a5e51-97bb-4887-b066-5212ee779fb6 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:31.076302 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a5e51-97bb-4887-b066-5212ee779fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:31.076600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a5e51-97bb-4887-b066-5212ee779fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:31.122368 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e81a5e51-97bb-4887-b066-5212ee779fb6 None None] MFA Rules not processed for user `46a8bec265f549f4a4f4efa44582bf57`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:31.124379 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e81a5e51-97bb-4887-b066-5212ee779fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:31.247095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef08d3e-1aac-4555-900f-5285850efbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:31.249936 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef08d3e-1aac-4555-900f-5285850efbc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:31.250640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef08d3e-1aac-4555-900f-5285850efbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:31.251151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef08d3e-1aac-4555-900f-5285850efbc7 admin admin] PATH_INFO: `/v3/projects/8baa89c5ef0a4ae6b6732960ef00712a/users/2b963f39a6204ab8b96aa54de6dbb1ef/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:31.295683 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef08d3e-1aac-4555-900f-5285850efbc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8baa89c5ef0a4ae6b6732960ef00712a, user_id=2b963f39a6204ab8b96aa54de6dbb1ef, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:31.300217 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 812/1609] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:31 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:31.304110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a5e51-97bb-4887-b066-5212ee779fb6 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:31.304355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef08d3e-1aac-4555-900f-5285850efbc7 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:31.321273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a5e51-97bb-4887-b066-5212ee779fb6 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:31.327502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e18253-611c-48ad-81db-0459d7cb81b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:31.328223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e18253-611c-48ad-81db-0459d7cb81b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:31.328501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e18253-611c-48ad-81db-0459d7cb81b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:31.328824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e18253-611c-48ad-81db-0459d7cb81b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:31.329516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e18253-611c-48ad-81db-0459d7cb81b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:31.331453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e18253-611c-48ad-81db-0459d7cb81b0 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:31.346100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 798/1610] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:31 2022] PUT /identity/v3/projects/8baa89c5ef0a4ae6b6732960ef00712a/users/2b963f39a6204ab8b96aa54de6dbb1ef/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:31.347673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d07240-9991-4a0a-8559-543eb392243d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:31.348002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d07240-9991-4a0a-8559-543eb392243d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:31.348331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d07240-9991-4a0a-8559-543eb392243d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:31.357182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 813/1611] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:31.357890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e18253-611c-48ad-81db-0459d7cb81b0 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:31.373395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e18253-611c-48ad-81db-0459d7cb81b0 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:31.432737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a0d07240-9991-4a0a-8559-543eb392243d None None] MFA Rules not processed for user `9917479b51b54bc9861e4db4aa0157aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:31.438848 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a0d07240-9991-4a0a-8559-543eb392243d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:31.532428 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0ed8a-ea12-4ad4-aecc-f529ee834332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:31.535039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0ed8a-ea12-4ad4-aecc-f529ee834332 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:31.535720 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0ed8a-ea12-4ad4-aecc-f529ee834332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:31.536636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0ed8a-ea12-4ad4-aecc-f529ee834332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:31.538075 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0ed8a-ea12-4ad4-aecc-f529ee834332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:31.545166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0ed8a-ea12-4ad4-aecc-f529ee834332 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:31.628609 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 814/1612] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:31 2022] POST /identity/v3/projects => generated 389 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:31.629744 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0ed8a-ea12-4ad4-aecc-f529ee834332 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:31.636966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 799/1613] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:31.639154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d07240-9991-4a0a-8559-543eb392243d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:31.670214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d07240-9991-4a0a-8559-543eb392243d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:31.763275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:31.808226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0ed8a-ea12-4ad4-aecc-f529ee834332 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:31.817618 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b7cb0-a0a4-4fed-aa4f-f1e7c5e6fe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:31.819100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b7cb0-a0a4-4fed-aa4f-f1e7c5e6fe34 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:31.819702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b7cb0-a0a4-4fed-aa4f-f1e7c5e6fe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:31.821439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b7cb0-a0a4-4fed-aa4f-f1e7c5e6fe34 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:31.823103 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b7cb0-a0a4-4fed-aa4f-f1e7c5e6fe34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:31.828300 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019b7cb0-a0a4-4fed-aa4f-f1e7c5e6fe34 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:31.842499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:31.868343 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292d423-a2ab-401c-9690-83b09d815d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:31.869443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d423-a2ab-401c-9690-83b09d815d97 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:31.869931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d423-a2ab-401c-9690-83b09d815d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:31.870451 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292d423-a2ab-401c-9690-83b09d815d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:31.871664 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292d423-a2ab-401c-9690-83b09d815d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:31.881112 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292d423-a2ab-401c-9690-83b09d815d97 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:31.888350 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 815/1614] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:31 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:31.894411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df578747-87c8-4993-aee5-8112eaa0c41e None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:31.894708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df578747-87c8-4993-aee5-8112eaa0c41e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:31.894981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df578747-87c8-4993-aee5-8112eaa0c41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:31.953286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-df578747-87c8-4993-aee5-8112eaa0c41e None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:31.959158 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-df578747-87c8-4993-aee5-8112eaa0c41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:31.993694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 816/1615] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:31.996604 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df578747-87c8-4993-aee5-8112eaa0c41e None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.005169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 800/1616] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:31 2022] POST /identity/v3/projects => generated 409 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:32.006734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292d423-a2ab-401c-9690-83b09d815d97 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.022484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df578747-87c8-4993-aee5-8112eaa0c41e None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:32.193095 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7144dc-df2d-4f1c-9a63-8212f8bd18c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:32.194040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7144dc-df2d-4f1c-9a63-8212f8bd18c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.199003 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7144dc-df2d-4f1c-9a63-8212f8bd18c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.199242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7144dc-df2d-4f1c-9a63-8212f8bd18c6 admin admin] PATH_INFO: `/v3/projects/913dd11fdf254b3ebb975bc4491a8940/users/eed4445a42de4e17b5e3f0e1e0909a38/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.203651 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7144dc-df2d-4f1c-9a63-8212f8bd18c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=913dd11fdf254b3ebb975bc4491a8940, user_id=eed4445a42de4e17b5e3f0e1e0909a38, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:32.215285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7144dc-df2d-4f1c-9a63-8212f8bd18c6 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:32.223073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292d423-a2ab-401c-9690-83b09d815d97 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:32.240176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6279cc0-c2dc-4598-9a02-e14854f1b0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:32.240906 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6279cc0-c2dc-4598-9a02-e14854f1b0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.241197 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6279cc0-c2dc-4598-9a02-e14854f1b0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.241473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6279cc0-c2dc-4598-9a02-e14854f1b0c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.242251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6279cc0-c2dc-4598-9a02-e14854f1b0c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:32.246148 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6279cc0-c2dc-4598-9a02-e14854f1b0c7 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:32.277420 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 817/1617] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:31 2022] PUT /identity/v3/projects/913dd11fdf254b3ebb975bc4491a8940/users/eed4445a42de4e17b5e3f0e1e0909a38/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:32.286086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7144dc-df2d-4f1c-9a63-8212f8bd18c6 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.309244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 801/1618] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:32 2022] POST /identity/v3/users => generated 301 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:32.313511 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6279cc0-c2dc-4598-9a02-e14854f1b0c7 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.332786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6279cc0-c2dc-4598-9a02-e14854f1b0c7 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:32.449888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999baae-c9b3-4625-bf1a-04d8a5258d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:32.450913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999baae-c9b3-4625-bf1a-04d8a5258d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.451401 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999baae-c9b3-4625-bf1a-04d8a5258d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.451872 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999baae-c9b3-4625-bf1a-04d8a5258d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.452845 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999baae-c9b3-4625-bf1a-04d8a5258d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:32.455413 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999baae-c9b3-4625-bf1a-04d8a5258d66 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:32.468563 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7144dc-df2d-4f1c-9a63-8212f8bd18c6 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:32.473632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 802/1619] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:32.475168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999baae-c9b3-4625-bf1a-04d8a5258d66 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.480382 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2172e-a738-41ee-9e02-fc431664251e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:32.481132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2172e-a738-41ee-9e02-fc431664251e service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.481414 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2172e-a738-41ee-9e02-fc431664251e service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.481684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2172e-a738-41ee-9e02-fc431664251e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.489411 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999baae-c9b3-4625-bf1a-04d8a5258d66 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:32.498074 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fba465-0ca9-43f4-a5eb-ecb5b901877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:32.498833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fba465-0ca9-43f4-a5eb-ecb5b901877b admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.499224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fba465-0ca9-43f4-a5eb-ecb5b901877b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.499579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fba465-0ca9-43f4-a5eb-ecb5b901877b admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.501234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fba465-0ca9-43f4-a5eb-ecb5b901877b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:32.504997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fba465-0ca9-43f4-a5eb-ecb5b901877b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:32.544679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 803/1620] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:32 2022] POST /identity/v3/users => generated 311 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:32.547598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fba465-0ca9-43f4-a5eb-ecb5b901877b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.562976 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fba465-0ca9-43f4-a5eb-ecb5b901877b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:32.569246 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ace0c-717f-4520-85b7-98b1b241f273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:32.570593 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ace0c-717f-4520-85b7-98b1b241f273 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.571347 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ace0c-717f-4520-85b7-98b1b241f273 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.571770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ace0c-717f-4520-85b7-98b1b241f273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.587660 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ace0c-717f-4520-85b7-98b1b241f273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:32.590703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ace0c-717f-4520-85b7-98b1b241f273 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:32.609236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 804/1621] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:32.611845 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96d177-dce4-4e34-856b-2a9cd1714699 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.612290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96d177-dce4-4e34-856b-2a9cd1714699 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.612576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96d177-dce4-4e34-856b-2a9cd1714699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.620207 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2172e-a738-41ee-9e02-fc431664251e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:32.621748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2172e-a738-41ee-9e02-fc431664251e service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:32.652047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 818/1622] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:32.652956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2172e-a738-41ee-9e02-fc431664251e service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.662590 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ac96d177-dce4-4e34-856b-2a9cd1714699 None None] MFA Rules not processed for user `eed4445a42de4e17b5e3f0e1e0909a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:32.664193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ac96d177-dce4-4e34-856b-2a9cd1714699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:32.677939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2172e-a738-41ee-9e02-fc431664251e service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:32.696133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bbdce-9bbe-4572-a500-59e67e2809c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:32.696362 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bbdce-9bbe-4572-a500-59e67e2809c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.696598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bbdce-9bbe-4572-a500-59e67e2809c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.696880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bbdce-9bbe-4572-a500-59e67e2809c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.697575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bbdce-9bbe-4572-a500-59e67e2809c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:32.700021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bbdce-9bbe-4572-a500-59e67e2809c8 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:32.707271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:32.733025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 819/1623] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:32.733727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bbdce-9bbe-4572-a500-59e67e2809c8 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.751987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:32.756386 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bbdce-9bbe-4572-a500-59e67e2809c8 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:32.776364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e68a0f-a3ec-45cf-ab4f-9aa2d300e5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:32.777414 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e68a0f-a3ec-45cf-ab4f-9aa2d300e5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.777998 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e68a0f-a3ec-45cf-ab4f-9aa2d300e5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.778460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e68a0f-a3ec-45cf-ab4f-9aa2d300e5eb admin admin] PATH_INFO: `/v3/projects/2d3cd37c6a504fe29cb8901386a2c862/users/5a3b4022b0a14a6796c40e9dd5ec7851/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.815550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e68a0f-a3ec-45cf-ab4f-9aa2d300e5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3cd37c6a504fe29cb8901386a2c862, user_id=5a3b4022b0a14a6796c40e9dd5ec7851, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:32.820525 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 805/1624] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:32.821925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96d177-dce4-4e34-856b-2a9cd1714699 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.822188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e68a0f-a3ec-45cf-ab4f-9aa2d300e5eb admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:32.853843 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96d177-dce4-4e34-856b-2a9cd1714699 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:32.856801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 820/1625] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:32 2022] PUT /identity/v3/projects/2d3cd37c6a504fe29cb8901386a2c862/users/5a3b4022b0a14a6796c40e9dd5ec7851/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:32.857756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e68a0f-a3ec-45cf-ab4f-9aa2d300e5eb admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:32.939710 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c526663-904f-4b5e-bf74-c0155554df51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:32.940493 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c526663-904f-4b5e-bf74-c0155554df51 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:32.940704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c526663-904f-4b5e-bf74-c0155554df51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:32.940932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c526663-904f-4b5e-bf74-c0155554df51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:32.941622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c526663-904f-4b5e-bf74-c0155554df51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:32.943328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c526663-904f-4b5e-bf74-c0155554df51 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:32.957057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 806/1626] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:32.958068 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c526663-904f-4b5e-bf74-c0155554df51 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:33.018636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e68a0f-a3ec-45cf-ab4f-9aa2d300e5eb admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:33.042754 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff02c2f-29b8-4028-b3dc-dafa9b140d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:33.043563 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff02c2f-29b8-4028-b3dc-dafa9b140d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:33.043845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff02c2f-29b8-4028-b3dc-dafa9b140d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:33.044144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff02c2f-29b8-4028-b3dc-dafa9b140d1a admin admin] PATH_INFO: `/v3/projects/5a75d2ec24c7423f971b0c28de0c2abf/users/315b6b543043481298c09beda2e7729e/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:33.076812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff02c2f-29b8-4028-b3dc-dafa9b140d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a75d2ec24c7423f971b0c28de0c2abf, user_id=315b6b543043481298c09beda2e7729e, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:33.081270 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff02c2f-29b8-4028-b3dc-dafa9b140d1a admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:33.100637 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c526663-904f-4b5e-bf74-c0155554df51 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:33.119628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 821/1627] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:32 2022] PUT /identity/v3/projects/5a75d2ec24c7423f971b0c28de0c2abf/users/315b6b543043481298c09beda2e7729e/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:33.121792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff02c2f-29b8-4028-b3dc-dafa9b140d1a admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:33.224850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e7e44-0c6a-41f5-9baa-602cb8de2e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:33.225873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e7e44-0c6a-41f5-9baa-602cb8de2e30 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:33.226542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e7e44-0c6a-41f5-9baa-602cb8de2e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:33.227035 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e7e44-0c6a-41f5-9baa-602cb8de2e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:33.273700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff02c2f-29b8-4028-b3dc-dafa9b140d1a admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:33.282478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c830de-7b23-4b81-a527-ce2fe4bdc01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:33.283128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c830de-7b23-4b81-a527-ce2fe4bdc01c admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:33.283467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c830de-7b23-4b81-a527-ce2fe4bdc01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:33.283974 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c830de-7b23-4b81-a527-ce2fe4bdc01c admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:33.284657 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c830de-7b23-4b81-a527-ce2fe4bdc01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:33.287710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c830de-7b23-4b81-a527-ce2fe4bdc01c admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:33.304722 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:33.305737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 822/1628] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:33.307009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c830de-7b23-4b81-a527-ce2fe4bdc01c admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:33.326654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c830de-7b23-4b81-a527-ce2fe4bdc01c admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:33.334752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b8cc4-9d11-4012-9116-da0d3e8bf492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:33.336020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b8cc4-9d11-4012-9116-da0d3e8bf492 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:33.336302 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b8cc4-9d11-4012-9116-da0d3e8bf492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:33.336575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b8cc4-9d11-4012-9116-da0d3e8bf492 admin admin] PATH_INFO: `/v3/projects/cfb20c8478c948b3b8570270f8a78a50/users/c764763b32c34504b543211492c1fd44/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:33.361753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b8cc4-9d11-4012-9116-da0d3e8bf492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb20c8478c948b3b8570270f8a78a50, user_id=c764763b32c34504b543211492c1fd44, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:33.366453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b8cc4-9d11-4012-9116-da0d3e8bf492 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:33.388257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e7e44-0c6a-41f5-9baa-602cb8de2e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:33.390173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e7e44-0c6a-41f5-9baa-602cb8de2e30 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:33.393858 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 823/1629] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:33 2022] PUT /identity/v3/projects/cfb20c8478c948b3b8570270f8a78a50/users/c764763b32c34504b543211492c1fd44/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:33.395153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b8cc4-9d11-4012-9116-da0d3e8bf492 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:33.451424 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 807/1630] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:33.453314 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e7e44-0c6a-41f5-9baa-602cb8de2e30 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:33.476724 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e7e44-0c6a-41f5-9baa-602cb8de2e30 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:33.502101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:33.578291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b8cc4-9d11-4012-9116-da0d3e8bf492 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:33.581374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e746a-9c9a-46d5-8e00-b512efd3007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:33.582612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e746a-9c9a-46d5-8e00-b512efd3007b admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:33.584768 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e746a-9c9a-46d5-8e00-b512efd3007b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:33.586009 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e746a-9c9a-46d5-8e00-b512efd3007b admin admin] PATH_INFO: `/v3/projects/2d3cd37c6a504fe29cb8901386a2c862/users/5a3b4022b0a14a6796c40e9dd5ec7851/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:33.589068 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e746a-9c9a-46d5-8e00-b512efd3007b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3cd37c6a504fe29cb8901386a2c862, user_id=5a3b4022b0a14a6796c40e9dd5ec7851, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:33.591819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e746a-9c9a-46d5-8e00-b512efd3007b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:33.593880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dc1c1-74ea-44a6-9f8e-5d430d196cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:33.594507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dc1c1-74ea-44a6-9f8e-5d430d196cbe admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:33.595193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dc1c1-74ea-44a6-9f8e-5d430d196cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:33.595316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dc1c1-74ea-44a6-9f8e-5d430d196cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:33.596021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dc1c1-74ea-44a6-9f8e-5d430d196cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:33.597709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dc1c1-74ea-44a6-9f8e-5d430d196cbe admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:33.622633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 808/1631] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:33 2022] PUT /identity/v3/projects/2d3cd37c6a504fe29cb8901386a2c862/users/5a3b4022b0a14a6796c40e9dd5ec7851/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:33.623553 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e746a-9c9a-46d5-8e00-b512efd3007b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:33.624260 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 824/1632] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:33.625191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dc1c1-74ea-44a6-9f8e-5d430d196cbe admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:33.665067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dc1c1-74ea-44a6-9f8e-5d430d196cbe admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:33.735737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e746a-9c9a-46d5-8e00-b512efd3007b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:33.745377 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e956421-5356-4f76-8614-4887aa713503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:33.746333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e956421-5356-4f76-8614-4887aa713503 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:33.746860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e956421-5356-4f76-8614-4887aa713503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:33.747622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e956421-5356-4f76-8614-4887aa713503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:33.749185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e956421-5356-4f76-8614-4887aa713503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:33.753442 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e956421-5356-4f76-8614-4887aa713503 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:33.771989 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 809/1633] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:33.773695 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a96e-5aef-4b43-8467-16eff840cf79 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:33.774053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a96e-5aef-4b43-8467-16eff840cf79 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:33.774360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a96e-5aef-4b43-8467-16eff840cf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:33.835206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a72eee-fcc1-40e6-96b8-bb1aa6fd5821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:33.836661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a72eee-fcc1-40e6-96b8-bb1aa6fd5821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:33.837094 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a72eee-fcc1-40e6-96b8-bb1aa6fd5821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:33.837377 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a72eee-fcc1-40e6-96b8-bb1aa6fd5821 admin admin] PATH_INFO: `/v3/projects/5a75d2ec24c7423f971b0c28de0c2abf/users/315b6b543043481298c09beda2e7729e/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:33.839979 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a72eee-fcc1-40e6-96b8-bb1aa6fd5821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a75d2ec24c7423f971b0c28de0c2abf, user_id=315b6b543043481298c09beda2e7729e, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:33.843858 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a72eee-fcc1-40e6-96b8-bb1aa6fd5821 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:33.846112 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-76e1a96e-5aef-4b43-8467-16eff840cf79 None None] MFA Rules not processed for user `5a3b4022b0a14a6796c40e9dd5ec7851`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:33.849011 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-76e1a96e-5aef-4b43-8467-16eff840cf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:33.857082 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 825/1634] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:33 2022] PUT /identity/v3/projects/5a75d2ec24c7423f971b0c28de0c2abf/users/315b6b543043481298c09beda2e7729e/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:33.858265 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a72eee-fcc1-40e6-96b8-bb1aa6fd5821 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:33.988221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:34.004303 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a72eee-fcc1-40e6-96b8-bb1aa6fd5821 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:34.021886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaeec21-1415-4f75-997f-4b5c9c54612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:34.023561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeec21-1415-4f75-997f-4b5c9c54612b admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:34.024014 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeec21-1415-4f75-997f-4b5c9c54612b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:34.024540 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaeec21-1415-4f75-997f-4b5c9c54612b admin admin] PATH_INFO: `/v3/projects/cfb20c8478c948b3b8570270f8a78a50/users/c764763b32c34504b543211492c1fd44/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:34.028738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeec21-1415-4f75-997f-4b5c9c54612b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb20c8478c948b3b8570270f8a78a50, user_id=c764763b32c34504b543211492c1fd44, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:34.035017 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaeec21-1415-4f75-997f-4b5c9c54612b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:34.067031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 826/1635] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:33 2022] PUT /identity/v3/projects/cfb20c8478c948b3b8570270f8a78a50/users/c764763b32c34504b543211492c1fd44/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:34.069144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc77b2-fac5-46c0-9c6b-2b8ed2a0d203 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:34.069654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc77b2-fac5-46c0-9c6b-2b8ed2a0d203 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:34.070165 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc77b2-fac5-46c0-9c6b-2b8ed2a0d203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:34.086640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 810/1636] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:34.088022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121c129-694a-41c8-b80a-3c09356821df None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:34.088318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121c129-694a-41c8-b80a-3c09356821df None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:34.088587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121c129-694a-41c8-b80a-3c09356821df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:34.137320 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-70bc77b2-fac5-46c0-9c6b-2b8ed2a0d203 None None] MFA Rules not processed for user `315b6b543043481298c09beda2e7729e`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:34.138932 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-70bc77b2-fac5-46c0-9c6b-2b8ed2a0d203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:34.186430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1121c129-694a-41c8-b80a-3c09356821df None None] MFA Rules not processed for user `c764763b32c34504b543211492c1fd44`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:34.188049 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1121c129-694a-41c8-b80a-3c09356821df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:34.280736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:34.353384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 827/1637] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:34 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:34.354624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc77b2-fac5-46c0-9c6b-2b8ed2a0d203 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:34.397783 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 811/1638] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:34 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:34.417236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121c129-694a-41c8-b80a-3c09356821df None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:34.510773 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc77b2-fac5-46c0-9c6b-2b8ed2a0d203 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:34.526364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef39cb-effb-4399-ac39-8c98659d149c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:34.527789 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef39cb-effb-4399-ac39-8c98659d149c service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:34.533323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef39cb-effb-4399-ac39-8c98659d149c service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:34.533323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef39cb-effb-4399-ac39-8c98659d149c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:34.581361 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121c129-694a-41c8-b80a-3c09356821df None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:34.594820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c35d6-836b-4287-ba8a-583ba23452e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:34.595471 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c35d6-836b-4287-ba8a-583ba23452e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:34.595752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c35d6-836b-4287-ba8a-583ba23452e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:34.596050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c35d6-836b-4287-ba8a-583ba23452e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:34.716858 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef39cb-effb-4399-ac39-8c98659d149c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:34.722468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef39cb-effb-4399-ac39-8c98659d149c service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:34.729856 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c35d6-836b-4287-ba8a-583ba23452e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:34.731667 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c35d6-836b-4287-ba8a-583ba23452e5 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:34.761107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 828/1639] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:34.762327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef39cb-effb-4399-ac39-8c98659d149c service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:34.774963 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef39cb-effb-4399-ac39-8c98659d149c service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:34.783197 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d669db-c2e2-49fe-bfb3-a04c7ca90097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:34.784066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d669db-c2e2-49fe-bfb3-a04c7ca90097 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:34.784066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d669db-c2e2-49fe-bfb3-a04c7ca90097 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:34.784306 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d669db-c2e2-49fe-bfb3-a04c7ca90097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:34.796404 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 812/1640] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:02:34.810773 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d669db-c2e2-49fe-bfb3-a04c7ca90097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:34.814618 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d669db-c2e2-49fe-bfb3-a04c7ca90097 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:34.838189 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 829/1641] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:34 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:39.214001 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5388197-4286-42d2-b87e-31db3f4d85f5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:39.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5388197-4286-42d2-b87e-31db3f4d85f5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:39.215391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5388197-4286-42d2-b87e-31db3f4d85f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:39.378754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f5388197-4286-42d2-b87e-31db3f4d85f5 None None] MFA Rules not processed for user `219a6829c2ae4de59af799110590d106`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:39.381013 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f5388197-4286-42d2-b87e-31db3f4d85f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:39.415622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:39.683617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 813/1642] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:39.791568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd570d2f-5445-4d39-bc5e-84cb6f217550 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:39.792788 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd570d2f-5445-4d39-bc5e-84cb6f217550 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:39.793349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd570d2f-5445-4d39-bc5e-84cb6f217550 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:39.805080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 830/1643] 10.222.0.20 () {54 vars in 962 bytes} [Sun Aug 7 01:02:39 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:39.850607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d34c2b-ff03-4a12-9099-05cf045d6c2f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:39.851030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d34c2b-ff03-4a12-9099-05cf045d6c2f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:39.851432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d34c2b-ff03-4a12-9099-05cf045d6c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:39.989152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e6d34c2b-ff03-4a12-9099-05cf045d6c2f None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:39.992319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e6d34c2b-ff03-4a12-9099-05cf045d6c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:40.248805 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 814/1644] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Aug 7 01:02:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:40.256032 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd570d2f-5445-4d39-bc5e-84cb6f217550 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:40.333916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd570d2f-5445-4d39-bc5e-84cb6f217550 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:40.358627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcb52a-ae6a-48fc-bd7f-818da9bccbbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:40.359663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcb52a-ae6a-48fc-bd7f-818da9bccbbe service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:40.360198 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcb52a-ae6a-48fc-bd7f-818da9bccbbe service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:40.361086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcb52a-ae6a-48fc-bd7f-818da9bccbbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:40.414294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcb52a-ae6a-48fc-bd7f-818da9bccbbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:40.420138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcb52a-ae6a-48fc-bd7f-818da9bccbbe service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:40.467403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 831/1645] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:02:43.135859 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d34c2b-ff03-4a12-9099-05cf045d6c2f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:43.363793 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d34c2b-ff03-4a12-9099-05cf045d6c2f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:43.369425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ec4a2-68ce-45e8-9a80-cb37132741ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:43.370101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ec4a2-68ce-45e8-9a80-cb37132741ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:43.370707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ec4a2-68ce-45e8-9a80-cb37132741ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:43.371495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ec4a2-68ce-45e8-9a80-cb37132741ce admin admin] PATH_INFO: `/v3/users/46a8bec265f549f4a4f4efa44582bf57` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:43.374436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ec4a2-68ce-45e8-9a80-cb37132741ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a8bec265f549f4a4f4efa44582bf57)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:43.376919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ec4a2-68ce-45e8-9a80-cb37132741ce admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:43.515241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:43.536226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcb52a-ae6a-48fc-bd7f-818da9bccbbe service nova] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:43.596899 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcb52a-ae6a-48fc-bd7f-818da9bccbbe service nova] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:43.610765 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9e7ec4a2-68ce-45e8-9a80-cb37132741ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a8bec265f549f4a4f4efa44582bf57'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:43.614026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874c749-b930-4baf-bb92-2e3bd04023cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:43.615718 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874c749-b930-4baf-bb92-2e3bd04023cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:43.618656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874c749-b930-4baf-bb92-2e3bd04023cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:43.619181 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874c749-b930-4baf-bb92-2e3bd04023cd admin admin] PATH_INFO: `/v3/users/3bb7fa6ec32e43d981c333ef7331a758` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:43.622142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874c749-b930-4baf-bb92-2e3bd04023cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb7fa6ec32e43d981c333ef7331a758)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:43.624478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: WARNING py.warnings [None req-7874c749-b930-4baf-bb92-2e3bd04023cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:02:43.624478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: warnings.warn(msg) Aug 07 01:02:43.624478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: Aug 07 01:02:43.627047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874c749-b930-4baf-bb92-2e3bd04023cd admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:43.640806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9e7ec4a2-68ce-45e8-9a80-cb37132741ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a8bec265f549f4a4f4efa44582bf57'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:43.677125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9e7ec4a2-68ce-45e8-9a80-cb37132741ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a8bec265f549f4a4f4efa44582bf57'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:43.696304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9e7ec4a2-68ce-45e8-9a80-cb37132741ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a8bec265f549f4a4f4efa44582bf57'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:43.697091 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9e7ec4a2-68ce-45e8-9a80-cb37132741ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a8bec265f549f4a4f4efa44582bf57'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:43.716823 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 815/1646] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:02:43 2022] DELETE /identity/v3/users/46a8bec265f549f4a4f4efa44582bf57 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:43.718441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eab4dd-226a-4641-8bdf-d1fef642880d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:43.724061 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eab4dd-226a-4641-8bdf-d1fef642880d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:43.724454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eab4dd-226a-4641-8bdf-d1fef642880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:43.768208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e6eab4dd-226a-4641-8bdf-d1fef642880d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:43.769570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e6eab4dd-226a-4641-8bdf-d1fef642880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:43.913510 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7874c749-b930-4baf-bb92-2e3bd04023cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb7fa6ec32e43d981c333ef7331a758'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:43.937062 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7874c749-b930-4baf-bb92-2e3bd04023cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb7fa6ec32e43d981c333ef7331a758'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:43.956818 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:43.986396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 816/1647] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:44.004560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7874c749-b930-4baf-bb92-2e3bd04023cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb7fa6ec32e43d981c333ef7331a758'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:44.006734 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7874c749-b930-4baf-bb92-2e3bd04023cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb7fa6ec32e43d981c333ef7331a758'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:44.008718 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7874c749-b930-4baf-bb92-2e3bd04023cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb7fa6ec32e43d981c333ef7331a758'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:44.030415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eab4dd-226a-4641-8bdf-d1fef642880d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:44.032241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e6eab4dd-226a-4641-8bdf-d1fef642880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:44.048811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 832/1648] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:02:43 2022] DELETE /identity/v3/users/3bb7fa6ec32e43d981c333ef7331a758 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:44.054454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d0819-b27f-4866-bb27-04d5ecd19f9a None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:44.056103 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d0819-b27f-4866-bb27-04d5ecd19f9a None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:44.056666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d0819-b27f-4866-bb27-04d5ecd19f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:44.096491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-884d0819-b27f-4866-bb27-04d5ecd19f9a None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:44.098125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-884d0819-b27f-4866-bb27-04d5ecd19f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:44.157158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eab4dd-226a-4641-8bdf-d1fef642880d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:44.262914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 833/1649] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:02:44.274797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5862e81-abd0-442c-9c97-769749d5d521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:44.276193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5862e81-abd0-442c-9c97-769749d5d521 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:44.277111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5862e81-abd0-442c-9c97-769749d5d521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:44.277640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5862e81-abd0-442c-9c97-769749d5d521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:44.281812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a5862e81-abd0-442c-9c97-769749d5d521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:44.291462 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d0819-b27f-4866-bb27-04d5ecd19f9a None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:44.295129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-884d0819-b27f-4866-bb27-04d5ecd19f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:44.305989 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5862e81-abd0-442c-9c97-769749d5d521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:44.308102 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5862e81-abd0-442c-9c97-769749d5d521 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:44.324101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 817/1650] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:02:44.337507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d0819-b27f-4866-bb27-04d5ecd19f9a None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:44.343831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd459c3-8b04-408b-a331-41b949d610b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:44.344501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd459c3-8b04-408b-a331-41b949d610b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:44.344786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd459c3-8b04-408b-a331-41b949d610b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:44.345077 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd459c3-8b04-408b-a331-41b949d610b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:44.355771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd459c3-8b04-408b-a331-41b949d610b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:44.358118 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd459c3-8b04-408b-a331-41b949d610b6 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:44.374097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 834/1651] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:45.564935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c31a78-29d6-4be4-939b-1638e1fef943 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:45.565941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c31a78-29d6-4be4-939b-1638e1fef943 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:45.566445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c31a78-29d6-4be4-939b-1638e1fef943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:45.582950 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:45.613431 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d1c31a78-29d6-4be4-939b-1638e1fef943 None None] MFA Rules not processed for user `d75986e659174d50881e14a275adeb76`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:45.618846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d1c31a78-29d6-4be4-939b-1638e1fef943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:45.804371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 818/1652] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:45.845133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a01870-3d01-4594-a5f8-40c9ab0b3011 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:45.845133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a01870-3d01-4594-a5f8-40c9ab0b3011 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:45.845133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a01870-3d01-4594-a5f8-40c9ab0b3011 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:45.846134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 835/1653] 10.222.0.20 () {54 vars in 962 bytes} [Sun Aug 7 01:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:45.855278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de95bdf-f7af-4b60-ae31-72a3ae618bb8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:45.855794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de95bdf-f7af-4b60-ae31-72a3ae618bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:45.856268 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de95bdf-f7af-4b60-ae31-72a3ae618bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:45.906263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1de95bdf-f7af-4b60-ae31-72a3ae618bb8 None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:45.908979 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1de95bdf-f7af-4b60-ae31-72a3ae618bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:46.059012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 819/1654] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Aug 7 01:02:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:46.080864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a01870-3d01-4594-a5f8-40c9ab0b3011 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:46.132626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a01870-3d01-4594-a5f8-40c9ab0b3011 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:46.154919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467161cf-22ba-4c92-adbd-4a76b23f6e8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:46.156323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467161cf-22ba-4c92-adbd-4a76b23f6e8b service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:46.157009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467161cf-22ba-4c92-adbd-4a76b23f6e8b service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:46.157679 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467161cf-22ba-4c92-adbd-4a76b23f6e8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:46.211335 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467161cf-22ba-4c92-adbd-4a76b23f6e8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:46.221432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de95bdf-f7af-4b60-ae31-72a3ae618bb8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:46.221615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467161cf-22ba-4c92-adbd-4a76b23f6e8b service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:46.223986 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1de95bdf-f7af-4b60-ae31-72a3ae618bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:46.256254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de95bdf-f7af-4b60-ae31-72a3ae618bb8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:46.269645 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:46.273007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:46.273503 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:46.273902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] PATH_INFO: `/v3/projects/9dc88202a3da4d7c88bc162a4dccc1d1` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:46.275621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc88202a3da4d7c88bc162a4dccc1d1)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:46.277812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: WARNING py.warnings [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:02:46.277812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: warnings.warn(msg) Aug 07 01:02:46.277812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: Aug 07 01:02:46.280742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:46.293642 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 836/1655] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:46.458859 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc88202a3da4d7c88bc162a4dccc1d1', 'request_id': 'req-8583882f-c252-4278-8242-8aff1ec94b3f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:46.509822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc88202a3da4d7c88bc162a4dccc1d1', 'request_id': 'req-8583882f-c252-4278-8242-8aff1ec94b3f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:46.528431 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc88202a3da4d7c88bc162a4dccc1d1', 'request_id': 'req-8583882f-c252-4278-8242-8aff1ec94b3f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:46.563660 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] The token cache is being invalidate because project 9dc88202a3da4d7c88bc162a4dccc1d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:02:46.563996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:46.564796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:46.567151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 820/1656] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:02:46 2022] DELETE /identity/v3/projects/9dc88202a3da4d7c88bc162a4dccc1d1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:02:46.573135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467161cf-22ba-4c92-adbd-4a76b23f6e8b service nova] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:46.587159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467161cf-22ba-4c92-adbd-4a76b23f6e8b service nova] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:46.671528 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1854fd6-cbcb-4145-88f2-843747227185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:46.672396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1854fd6-cbcb-4145-88f2-843747227185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:46.672787 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1854fd6-cbcb-4145-88f2-843747227185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:46.673171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1854fd6-cbcb-4145-88f2-843747227185 admin admin] PATH_INFO: `/v3/users/c764763b32c34504b543211492c1fd44` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:46.674766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1854fd6-cbcb-4145-88f2-843747227185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c764763b32c34504b543211492c1fd44)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:46.676997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1854fd6-cbcb-4145-88f2-843747227185 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:46.747448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b1854fd6-cbcb-4145-88f2-843747227185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c764763b32c34504b543211492c1fd44'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:46.751773 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:46.761476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b1854fd6-cbcb-4145-88f2-843747227185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c764763b32c34504b543211492c1fd44'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:46.780447 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b1854fd6-cbcb-4145-88f2-843747227185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c764763b32c34504b543211492c1fd44'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:46.781390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b1854fd6-cbcb-4145-88f2-843747227185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c764763b32c34504b543211492c1fd44'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:46.782132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b1854fd6-cbcb-4145-88f2-843747227185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c764763b32c34504b543211492c1fd44'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:46.800613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 837/1657] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:02:46 2022] DELETE /identity/v3/users/c764763b32c34504b543211492c1fd44 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:02:47.088416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:47.091646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:47.127058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583882f-c252-4278-8242-8aff1ec94b3f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:47.140017 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:47.249207 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:47.252522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:47.252835 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:47.254680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484 admin admin] PATH_INFO: `/v3/projects/1525346c41d845eaaeb50da3db3bb36d` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:47.261391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1525346c41d845eaaeb50da3db3bb36d)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:47.263578 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:47.349006 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1525346c41d845eaaeb50da3db3bb36d', 'request_id': 'req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:47.358459 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1525346c41d845eaaeb50da3db3bb36d', 'request_id': 'req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:47.378192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1525346c41d845eaaeb50da3db3bb36d', 'request_id': 'req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:47.396274 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484 admin admin] The token cache is being invalidate because project 1525346c41d845eaaeb50da3db3bb36d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:02:47.397110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:47.398821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:47.400763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 821/1658] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:02:47 2022] DELETE /identity/v3/projects/1525346c41d845eaaeb50da3db3bb36d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:47.405903 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1854fd6-cbcb-4145-88f2-843747227185 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:47.408606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b1854fd6-cbcb-4145-88f2-843747227185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:47.448858 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1854fd6-cbcb-4145-88f2-843747227185 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:47.457624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:47.459423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:47.646081 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd2a0c-54a3-4878-ae2c-c2c28b8eb484 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:47.661090 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1aa60-8258-4a79-b757-a6d792b51919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:47.664881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1aa60-8258-4a79-b757-a6d792b51919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:47.665661 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1aa60-8258-4a79-b757-a6d792b51919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:47.667889 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1aa60-8258-4a79-b757-a6d792b51919 admin admin] PATH_INFO: `/v3/projects/cfb20c8478c948b3b8570270f8a78a50` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:47.672940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1aa60-8258-4a79-b757-a6d792b51919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfb20c8478c948b3b8570270f8a78a50)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:47.685850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fecae9-a6aa-4299-8bfe-7b185d818fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:47.688023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fecae9-a6aa-4299-8bfe-7b185d818fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:47.688531 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fecae9-a6aa-4299-8bfe-7b185d818fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:47.688945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fecae9-a6aa-4299-8bfe-7b185d818fb3 admin admin] PATH_INFO: `/v3/users/5a3b4022b0a14a6796c40e9dd5ec7851` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:47.694175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fecae9-a6aa-4299-8bfe-7b185d818fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3b4022b0a14a6796c40e9dd5ec7851)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:47.700496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1aa60-8258-4a79-b757-a6d792b51919 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:47.701905 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fecae9-a6aa-4299-8bfe-7b185d818fb3 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:47.833730 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:47.839932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e4c1aa60-8258-4a79-b757-a6d792b51919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfb20c8478c948b3b8570270f8a78a50', 'request_id': 'req-e4c1aa60-8258-4a79-b757-a6d792b51919'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:47.852150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e4c1aa60-8258-4a79-b757-a6d792b51919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfb20c8478c948b3b8570270f8a78a50', 'request_id': 'req-e4c1aa60-8258-4a79-b757-a6d792b51919'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:47.855309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-47fecae9-a6aa-4299-8bfe-7b185d818fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3b4022b0a14a6796c40e9dd5ec7851'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:47.880516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-47fecae9-a6aa-4299-8bfe-7b185d818fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3b4022b0a14a6796c40e9dd5ec7851'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:47.900595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e4c1aa60-8258-4a79-b757-a6d792b51919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfb20c8478c948b3b8570270f8a78a50', 'request_id': 'req-e4c1aa60-8258-4a79-b757-a6d792b51919'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:47.945150 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-47fecae9-a6aa-4299-8bfe-7b185d818fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3b4022b0a14a6796c40e9dd5ec7851'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:47.949411 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e4c1aa60-8258-4a79-b757-a6d792b51919 admin admin] The token cache is being invalidate because project cfb20c8478c948b3b8570270f8a78a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:02:47.950465 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-47fecae9-a6aa-4299-8bfe-7b185d818fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3b4022b0a14a6796c40e9dd5ec7851'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:47.952005 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e4c1aa60-8258-4a79-b757-a6d792b51919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:47.952660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-47fecae9-a6aa-4299-8bfe-7b185d818fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3b4022b0a14a6796c40e9dd5ec7851'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:47.957151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e4c1aa60-8258-4a79-b757-a6d792b51919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:47.970264 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 822/1659] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:02:47 2022] DELETE /identity/v3/projects/cfb20c8478c948b3b8570270f8a78a50 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:47.977264 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a147fe-8206-452f-a6db-9fb57f019867 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:47.977969 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a147fe-8206-452f-a6db-9fb57f019867 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:47.978647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a147fe-8206-452f-a6db-9fb57f019867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:47.999109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 838/1660] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:02:47 2022] DELETE /identity/v3/users/5a3b4022b0a14a6796c40e9dd5ec7851 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:48.031328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d4a147fe-8206-452f-a6db-9fb57f019867 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:48.041565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d4a147fe-8206-452f-a6db-9fb57f019867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:48.182342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 823/1661] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:48.190703 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49ea96-d39f-45b7-b214-1bce5c69c772 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:48.191285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49ea96-d39f-45b7-b214-1bce5c69c772 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:48.191760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49ea96-d39f-45b7-b214-1bce5c69c772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:48.239304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-bd49ea96-d39f-45b7-b214-1bce5c69c772 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:48.241213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-bd49ea96-d39f-45b7-b214-1bce5c69c772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:48.279425 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 839/1662] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:02:48.284028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a147fe-8206-452f-a6db-9fb57f019867 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:48.302100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a147fe-8206-452f-a6db-9fb57f019867 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:48.309610 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63394c-6bc4-44ea-96e6-80cb15606363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:48.310265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63394c-6bc4-44ea-96e6-80cb15606363 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:48.310550 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63394c-6bc4-44ea-96e6-80cb15606363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:48.310826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63394c-6bc4-44ea-96e6-80cb15606363 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:48.311515 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63394c-6bc4-44ea-96e6-80cb15606363 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:48.312370 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63394c-6bc4-44ea-96e6-80cb15606363 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:48.314184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63394c-6bc4-44ea-96e6-80cb15606363 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:48.354195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 824/1663] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:02:48.356019 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49ea96-d39f-45b7-b214-1bce5c69c772 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:48.376485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49ea96-d39f-45b7-b214-1bce5c69c772 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:48.385343 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c5466-8e7b-4298-b572-dc36aacc605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:48.386268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c5466-8e7b-4298-b572-dc36aacc605d admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:48.386765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c5466-8e7b-4298-b572-dc36aacc605d admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:48.387185 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c5466-8e7b-4298-b572-dc36aacc605d admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:48.389388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c5466-8e7b-4298-b572-dc36aacc605d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:48.392462 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c5466-8e7b-4298-b572-dc36aacc605d admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:48.448812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 840/1664] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:48 2022] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:48.453430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63394c-6bc4-44ea-96e6-80cb15606363 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:48.479506 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63394c-6bc4-44ea-96e6-80cb15606363 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:48.589235 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdda74-616b-4f80-b9e1-7cc5c4158696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:48.590231 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdda74-616b-4f80-b9e1-7cc5c4158696 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:48.590681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdda74-616b-4f80-b9e1-7cc5c4158696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:48.591241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdda74-616b-4f80-b9e1-7cc5c4158696 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:48.592432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdda74-616b-4f80-b9e1-7cc5c4158696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:48.594773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdda74-616b-4f80-b9e1-7cc5c4158696 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:48.667022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 825/1665] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:48 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:48.669523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c5466-8e7b-4298-b572-dc36aacc605d admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:48.696586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c5466-8e7b-4298-b572-dc36aacc605d admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:48.714279 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723f011-6351-444a-8455-e73b774d595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:48.716183 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f011-6351-444a-8455-e73b774d595f admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:48.717216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f011-6351-444a-8455-e73b774d595f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:48.721072 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723f011-6351-444a-8455-e73b774d595f admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:48.722193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723f011-6351-444a-8455-e73b774d595f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:48.727017 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723f011-6351-444a-8455-e73b774d595f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:48.766213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 841/1666] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:48.769285 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdda74-616b-4f80-b9e1-7cc5c4158696 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:48.787114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdda74-616b-4f80-b9e1-7cc5c4158696 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:48.805560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde126e-c9c5-48ca-9499-8b64093b82cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:48.806198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde126e-c9c5-48ca-9499-8b64093b82cd admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:48.806626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde126e-c9c5-48ca-9499-8b64093b82cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:48.806900 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde126e-c9c5-48ca-9499-8b64093b82cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:48.807560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde126e-c9c5-48ca-9499-8b64093b82cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:48.811380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde126e-c9c5-48ca-9499-8b64093b82cd admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:48.864773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 826/1667] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:02:48.866076 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723f011-6351-444a-8455-e73b774d595f admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:48.891064 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde126e-c9c5-48ca-9499-8b64093b82cd admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:48.893635 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3dde126e-c9c5-48ca-9499-8b64093b82cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:48.918756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723f011-6351-444a-8455-e73b774d595f admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:48.923501 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde126e-c9c5-48ca-9499-8b64093b82cd admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:48.926767 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20da3b-6ef6-4ea0-a25f-8d7c01689ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:48.927768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20da3b-6ef6-4ea0-a25f-8d7c01689ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:48.928191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20da3b-6ef6-4ea0-a25f-8d7c01689ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:48.928543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20da3b-6ef6-4ea0-a25f-8d7c01689ba9 admin admin] PATH_INFO: `/v3/projects/d6a4f0819a464bd7b420ee3d9ab37ac6/users/7e7a7efae23d41dba9894c64cd5315f6/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:48.933933 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410984a-8d9f-4c22-8b2e-e869e0cecc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:48.934973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410984a-8d9f-4c22-8b2e-e869e0cecc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:48.935260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410984a-8d9f-4c22-8b2e-e869e0cecc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:48.935528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410984a-8d9f-4c22-8b2e-e869e0cecc84 admin admin] PATH_INFO: `/v3/projects/2d3cd37c6a504fe29cb8901386a2c862` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:48.938878 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410984a-8d9f-4c22-8b2e-e869e0cecc84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d3cd37c6a504fe29cb8901386a2c862)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:48.939568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:48.941973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410984a-8d9f-4c22-8b2e-e869e0cecc84 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:48.982729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20da3b-6ef6-4ea0-a25f-8d7c01689ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a4f0819a464bd7b420ee3d9ab37ac6, user_id=7e7a7efae23d41dba9894c64cd5315f6, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:48.989652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20da3b-6ef6-4ea0-a25f-8d7c01689ba9 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:49.016513 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 842/1668] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:48 2022] PUT /identity/v3/projects/d6a4f0819a464bd7b420ee3d9ab37ac6/users/7e7a7efae23d41dba9894c64cd5315f6/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:49.039859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa525c-5ba0-41da-ae00-5e0020a11035 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:49.040393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa525c-5ba0-41da-ae00-5e0020a11035 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:49.041440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa525c-5ba0-41da-ae00-5e0020a11035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:49.066277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:49.107234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0410984a-8d9f-4c22-8b2e-e869e0cecc84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d3cd37c6a504fe29cb8901386a2c862', 'request_id': 'req-0410984a-8d9f-4c22-8b2e-e869e0cecc84'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:49.126183 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-35fa525c-5ba0-41da-ae00-5e0020a11035 None None] MFA Rules not processed for user `7e7a7efae23d41dba9894c64cd5315f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:49.127526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-35fa525c-5ba0-41da-ae00-5e0020a11035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:49.136169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0410984a-8d9f-4c22-8b2e-e869e0cecc84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d3cd37c6a504fe29cb8901386a2c862', 'request_id': 'req-0410984a-8d9f-4c22-8b2e-e869e0cecc84'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:49.186090 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0410984a-8d9f-4c22-8b2e-e869e0cecc84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d3cd37c6a504fe29cb8901386a2c862', 'request_id': 'req-0410984a-8d9f-4c22-8b2e-e869e0cecc84'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:49.216177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0410984a-8d9f-4c22-8b2e-e869e0cecc84 admin admin] The token cache is being invalidate because project 2d3cd37c6a504fe29cb8901386a2c862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:02:49.216638 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0410984a-8d9f-4c22-8b2e-e869e0cecc84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:49.218798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-0410984a-8d9f-4c22-8b2e-e869e0cecc84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:02:49.227528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 827/1669] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:02:48 2022] DELETE /identity/v3/projects/2d3cd37c6a504fe29cb8901386a2c862 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:49.230174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb08f4a-bea8-4249-9e4a-45cf03a7f57d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:49.230633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb08f4a-bea8-4249-9e4a-45cf03a7f57d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:49.231202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb08f4a-bea8-4249-9e4a-45cf03a7f57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:49.287262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-8eb08f4a-bea8-4249-9e4a-45cf03a7f57d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:49.289302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8eb08f4a-bea8-4249-9e4a-45cf03a7f57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:49.332504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 843/1670] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:49.333655 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa525c-5ba0-41da-ae00-5e0020a11035 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:49.335559 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-35fa525c-5ba0-41da-ae00-5e0020a11035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:49.443488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 828/1671] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:49.452185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bcd1f-f48d-44d7-b83f-e97f61d646fd None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:49.453524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bcd1f-f48d-44d7-b83f-e97f61d646fd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:49.453976 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bcd1f-f48d-44d7-b83f-e97f61d646fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:49.502241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-006bcd1f-f48d-44d7-b83f-e97f61d646fd None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:49.505631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-006bcd1f-f48d-44d7-b83f-e97f61d646fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:49.508509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa525c-5ba0-41da-ae00-5e0020a11035 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:49.520774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f95cf8-85ec-435c-a973-0d9a7993f743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:49.522358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f95cf8-85ec-435c-a973-0d9a7993f743 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:49.524214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f95cf8-85ec-435c-a973-0d9a7993f743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:49.524586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f95cf8-85ec-435c-a973-0d9a7993f743 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:49.525383 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f95cf8-85ec-435c-a973-0d9a7993f743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:49.529850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f95cf8-85ec-435c-a973-0d9a7993f743 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:49.534296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 829/1672] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:49.539794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bcd1f-f48d-44d7-b83f-e97f61d646fd None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:49.560979 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bcd1f-f48d-44d7-b83f-e97f61d646fd None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:49.574143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55da11-607e-44cb-97f5-948adf7cc25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:49.574782 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55da11-607e-44cb-97f5-948adf7cc25e admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:49.575056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55da11-607e-44cb-97f5-948adf7cc25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:49.575454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55da11-607e-44cb-97f5-948adf7cc25e admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:49.576144 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55da11-607e-44cb-97f5-948adf7cc25e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:02:49.577915 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55da11-607e-44cb-97f5-948adf7cc25e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:49.583201 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55da11-607e-44cb-97f5-948adf7cc25e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:49.596031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 844/1673] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:49 2022] POST /identity/v3/projects => generated 393 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:49.600099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f95cf8-85ec-435c-a973-0d9a7993f743 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:49.613485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 830/1674] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:02:49.619298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55da11-607e-44cb-97f5-948adf7cc25e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:49.645356 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55da11-607e-44cb-97f5-948adf7cc25e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:49.736714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:49.746628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f95cf8-85ec-435c-a973-0d9a7993f743 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:49.764378 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214e85-51b6-496f-a47c-aa3ec143c055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:49.765029 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214e85-51b6-496f-a47c-aa3ec143c055 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:49.765310 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214e85-51b6-496f-a47c-aa3ec143c055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:49.765581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214e85-51b6-496f-a47c-aa3ec143c055 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:49.766220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf214e85-51b6-496f-a47c-aa3ec143c055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:49.769086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf214e85-51b6-496f-a47c-aa3ec143c055 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:49.799299 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9defbc-e2ff-4a70-8efd-5caaab4c109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:49.802043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9defbc-e2ff-4a70-8efd-5caaab4c109f admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:49.803591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9defbc-e2ff-4a70-8efd-5caaab4c109f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:49.804593 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9defbc-e2ff-4a70-8efd-5caaab4c109f admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:49.808015 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9defbc-e2ff-4a70-8efd-5caaab4c109f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:49.809713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 845/1675] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:49 2022] POST /identity/v3/users => generated 303 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:49.810452 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9defbc-e2ff-4a70-8efd-5caaab4c109f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:49.814163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214e85-51b6-496f-a47c-aa3ec143c055 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:49.833593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214e85-51b6-496f-a47c-aa3ec143c055 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:49.847374 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3067c9d-7e65-4f3f-be0a-ca241aca642b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:49.848709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3067c9d-7e65-4f3f-be0a-ca241aca642b admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:49.849003 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3067c9d-7e65-4f3f-be0a-ca241aca642b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:49.849282 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3067c9d-7e65-4f3f-be0a-ca241aca642b admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:49.850076 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3067c9d-7e65-4f3f-be0a-ca241aca642b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:49.852532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3067c9d-7e65-4f3f-be0a-ca241aca642b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:49.870178 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 831/1676] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:49 2022] POST /identity/v3/projects => generated 397 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:49.876115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9defbc-e2ff-4a70-8efd-5caaab4c109f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:49.883709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 846/1677] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:49.887009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3067c9d-7e65-4f3f-be0a-ca241aca642b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:49.909875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3067c9d-7e65-4f3f-be0a-ca241aca642b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:49.948213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:50.023220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9defbc-e2ff-4a70-8efd-5caaab4c109f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:50.034618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2f6ef-8673-43ab-b1e0-db97165fde23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:50.035273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2f6ef-8673-43ab-b1e0-db97165fde23 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:50.036160 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2f6ef-8673-43ab-b1e0-db97165fde23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:50.036704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2f6ef-8673-43ab-b1e0-db97165fde23 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:50.037368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2f6ef-8673-43ab-b1e0-db97165fde23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:50.043444 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2f6ef-8673-43ab-b1e0-db97165fde23 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:50.044454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88a5b7-bd03-4c13-aa2f-69554ffa9fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:50.045416 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88a5b7-bd03-4c13-aa2f-69554ffa9fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:50.045708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88a5b7-bd03-4c13-aa2f-69554ffa9fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:50.045974 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88a5b7-bd03-4c13-aa2f-69554ffa9fc4 admin admin] PATH_INFO: `/v3/projects/f86923530bf742c69d7399bd185dc8f0/users/0faa75f54ee544c79b2575c001d8c587/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:50.074648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88a5b7-bd03-4c13-aa2f-69554ffa9fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86923530bf742c69d7399bd185dc8f0, user_id=0faa75f54ee544c79b2575c001d8c587, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:50.081671 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88a5b7-bd03-4c13-aa2f-69554ffa9fc4 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:50.091679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 832/1678] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:49 2022] POST /identity/v3/users => generated 299 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:50.092784 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2f6ef-8673-43ab-b1e0-db97165fde23 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:50.114135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 847/1679] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:49 2022] PUT /identity/v3/projects/f86923530bf742c69d7399bd185dc8f0/users/0faa75f54ee544c79b2575c001d8c587/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:50.117365 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2f6ef-8673-43ab-b1e0-db97165fde23 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:50.119424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88a5b7-bd03-4c13-aa2f-69554ffa9fc4 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:50.228048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098edf2-83be-44e5-a5c4-fd7a1b5f34f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:50.229737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098edf2-83be-44e5-a5c4-fd7a1b5f34f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:50.230049 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098edf2-83be-44e5-a5c4-fd7a1b5f34f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:50.230632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098edf2-83be-44e5-a5c4-fd7a1b5f34f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:50.231361 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098edf2-83be-44e5-a5c4-fd7a1b5f34f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:50.233241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098edf2-83be-44e5-a5c4-fd7a1b5f34f3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:50.250557 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 833/1680] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:50.255388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098edf2-83be-44e5-a5c4-fd7a1b5f34f3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:50.273981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098edf2-83be-44e5-a5c4-fd7a1b5f34f3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:50.285883 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d272fd9-7fd7-4c9b-b63b-a848bc5953df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:50.287925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d272fd9-7fd7-4c9b-b63b-a848bc5953df admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:50.289029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d272fd9-7fd7-4c9b-b63b-a848bc5953df admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:50.289543 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d272fd9-7fd7-4c9b-b63b-a848bc5953df admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:50.292712 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d272fd9-7fd7-4c9b-b63b-a848bc5953df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:50.295147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d272fd9-7fd7-4c9b-b63b-a848bc5953df admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:50.316530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 834/1681] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:50.316793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88a5b7-bd03-4c13-aa2f-69554ffa9fc4 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:50.321458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d272fd9-7fd7-4c9b-b63b-a848bc5953df admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:50.332094 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09472d-2fc0-449b-9cee-d19550c2347b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:50.334089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09472d-2fc0-449b-9cee-d19550c2347b admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:50.334419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09472d-2fc0-449b-9cee-d19550c2347b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:50.336946 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09472d-2fc0-449b-9cee-d19550c2347b admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:50.337987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09472d-2fc0-449b-9cee-d19550c2347b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:50.344213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09472d-2fc0-449b-9cee-d19550c2347b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:50.347599 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d272fd9-7fd7-4c9b-b63b-a848bc5953df admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:50.354583 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9b1b0-9b63-480e-a767-cab1816333c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:50.355730 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9b1b0-9b63-480e-a767-cab1816333c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:50.356436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9b1b0-9b63-480e-a767-cab1816333c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:50.356853 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9b1b0-9b63-480e-a767-cab1816333c5 admin admin] PATH_INFO: `/v3/projects/fea3cee8bc1e4aaeb530c99ee07a2365/users/ffd5a656772345d38b3cebc7054c291c/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:50.373822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 848/1682] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:50.378324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09472d-2fc0-449b-9cee-d19550c2347b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:50.382005 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9b1b0-9b63-480e-a767-cab1816333c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea3cee8bc1e4aaeb530c99ee07a2365, user_id=ffd5a656772345d38b3cebc7054c291c, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:50.385972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9b1b0-9b63-480e-a767-cab1816333c5 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:50.402289 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09472d-2fc0-449b-9cee-d19550c2347b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:50.407025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ffedc-02b3-4b02-aa16-36f43d7b9a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:50.407853 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ffedc-02b3-4b02-aa16-36f43d7b9a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:50.408290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ffedc-02b3-4b02-aa16-36f43d7b9a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:50.408662 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ffedc-02b3-4b02-aa16-36f43d7b9a54 admin admin] PATH_INFO: `/v3/projects/f86923530bf742c69d7399bd185dc8f0/users/0faa75f54ee544c79b2575c001d8c587/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:50.412061 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ffedc-02b3-4b02-aa16-36f43d7b9a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86923530bf742c69d7399bd185dc8f0, user_id=0faa75f54ee544c79b2575c001d8c587, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:50.416120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ffedc-02b3-4b02-aa16-36f43d7b9a54 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:50.432085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 849/1684] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:50 2022] PUT /identity/v3/projects/f86923530bf742c69d7399bd185dc8f0/users/0faa75f54ee544c79b2575c001d8c587/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:02:50.433107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab75e5-8cb2-4b4e-9ce2-86d36ce9fb71 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:50.433378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 835/1684] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:50 2022] PUT /identity/v3/projects/fea3cee8bc1e4aaeb530c99ee07a2365/users/ffd5a656772345d38b3cebc7054c291c/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:02:50.434037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab75e5-8cb2-4b4e-9ce2-86d36ce9fb71 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:50.434418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab75e5-8cb2-4b4e-9ce2-86d36ce9fb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:50.437605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd36a94-7a1b-43e3-a270-20a80d230fd4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:50.445818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd36a94-7a1b-43e3-a270-20a80d230fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:50.446314 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd36a94-7a1b-43e3-a270-20a80d230fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:50.463863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-f2ab75e5-8cb2-4b4e-9ce2-86d36ce9fb71 None None] MFA Rules not processed for user `219a6829c2ae4de59af799110590d106`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:50.465460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f2ab75e5-8cb2-4b4e-9ce2-86d36ce9fb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:50.525244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ecd36a94-7a1b-43e3-a270-20a80d230fd4 None None] MFA Rules not processed for user `ffd5a656772345d38b3cebc7054c291c`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:50.527606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ecd36a94-7a1b-43e3-a270-20a80d230fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:50.531407 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:50.557899 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 850/1685] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:50.557899 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cc292-3144-4884-81f1-7b33024a1806 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:50.557899 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cc292-3144-4884-81f1-7b33024a1806 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:50.557899 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cc292-3144-4884-81f1-7b33024a1806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:50.615873 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-615cc292-3144-4884-81f1-7b33024a1806 None None] MFA Rules not processed for user `0faa75f54ee544c79b2575c001d8c587`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:50.619891 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-615cc292-3144-4884-81f1-7b33024a1806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:50.723818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 836/1686] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:50.723818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a07e5-0426-490d-adbb-bfd1ee19c4f5 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:50.723818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a07e5-0426-490d-adbb-bfd1ee19c4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:50.723818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a07e5-0426-490d-adbb-bfd1ee19c4f5 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:50.728525 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 837/1687] 10.222.0.20 () {54 vars in 912 bytes} [Sun Aug 7 01:02:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:50.730700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a07e5-0426-490d-adbb-bfd1ee19c4f5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:50.751266 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:50.815322 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 851/1688] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:50.823041 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8dd2e-93c5-437f-bd47-8b44fde8a3c2 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:50.823337 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8dd2e-93c5-437f-bd47-8b44fde8a3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:50.823623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8dd2e-93c5-437f-bd47-8b44fde8a3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:50.890999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a07e5-0426-490d-adbb-bfd1ee19c4f5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:50.895695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-85e8dd2e-93c5-437f-bd47-8b44fde8a3c2 None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:50.896659 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7b92a-1419-4a4c-8db7-b06ecc4edc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:50.897230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-85e8dd2e-93c5-437f-bd47-8b44fde8a3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:50.897394 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7b92a-1419-4a4c-8db7-b06ecc4edc36 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:50.897814 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7b92a-1419-4a4c-8db7-b06ecc4edc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:50.898838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7b92a-1419-4a4c-8db7-b06ecc4edc36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:50.899556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7b92a-1419-4a4c-8db7-b06ecc4edc36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:50.902155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7b92a-1419-4a4c-8db7-b06ecc4edc36 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:50.949771 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 838/1689] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:02:50 2022] POST /identity/v3/projects => generated 397 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:50.950697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7b92a-1419-4a4c-8db7-b06ecc4edc36 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:50.954171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f3b7b92a-1419-4a4c-8db7-b06ecc4edc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:51.140940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 852/1690] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:51.160271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8dd2e-93c5-437f-bd47-8b44fde8a3c2 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:51.164281 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7b92a-1419-4a4c-8db7-b06ecc4edc36 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:51.176122 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee69f4e-88b6-4ebc-ab04-5d02c5d73e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:51.176918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee69f4e-88b6-4ebc-ab04-5d02c5d73e0d service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:51.177303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee69f4e-88b6-4ebc-ab04-5d02c5d73e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:51.177859 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee69f4e-88b6-4ebc-ab04-5d02c5d73e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:51.184933 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8dd2e-93c5-437f-bd47-8b44fde8a3c2 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:51.367953 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee69f4e-88b6-4ebc-ab04-5d02c5d73e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:51.374925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a383d-78e8-43ad-96b7-59d720cddcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:51.375894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a383d-78e8-43ad-96b7-59d720cddcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:51.376234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee69f4e-88b6-4ebc-ab04-5d02c5d73e0d service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:51.384348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a383d-78e8-43ad-96b7-59d720cddcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:51.384639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a383d-78e8-43ad-96b7-59d720cddcc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:51.385344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a383d-78e8-43ad-96b7-59d720cddcc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:51.387549 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a383d-78e8-43ad-96b7-59d720cddcc7 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:51.422966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 839/1691] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:51.427233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:51.427471 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee69f4e-88b6-4ebc-ab04-5d02c5d73e0d service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:51.430725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bee69f4e-88b6-4ebc-ab04-5d02c5d73e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:51.454427 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 853/1692] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:02:51 2022] POST /identity/v3/users => generated 305 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:02:51.458252 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a383d-78e8-43ad-96b7-59d720cddcc7 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:51.474713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a383d-78e8-43ad-96b7-59d720cddcc7 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:51.483171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbe0db-fc03-456e-b917-858d0a0b7528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:51.484127 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbe0db-fc03-456e-b917-858d0a0b7528 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:51.484576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbe0db-fc03-456e-b917-858d0a0b7528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:51.485013 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbe0db-fc03-456e-b917-858d0a0b7528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:51.486051 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbe0db-fc03-456e-b917-858d0a0b7528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:51.488393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbe0db-fc03-456e-b917-858d0a0b7528 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:51.510754 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 854/1693] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:02:51.520177 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbe0db-fc03-456e-b917-858d0a0b7528 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:51.547028 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbe0db-fc03-456e-b917-858d0a0b7528 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:51.562312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:51.563600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec632733-afe0-4d83-9d94-96a64de21321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:51.565687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec632733-afe0-4d83-9d94-96a64de21321 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:51.566043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec632733-afe0-4d83-9d94-96a64de21321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:51.566331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec632733-afe0-4d83-9d94-96a64de21321 admin admin] PATH_INFO: `/v3/projects/3efe4c4c87fc4fcea11d94662e0fc766/users/2044432bea754a47abc6396eb9ed1cf4/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:51.611193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec632733-afe0-4d83-9d94-96a64de21321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efe4c4c87fc4fcea11d94662e0fc766, user_id=2044432bea754a47abc6396eb9ed1cf4, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:51.616539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec632733-afe0-4d83-9d94-96a64de21321 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:51.663962 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 855/1694] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:51 2022] PUT /identity/v3/projects/3efe4c4c87fc4fcea11d94662e0fc766/users/2044432bea754a47abc6396eb9ed1cf4/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:51.665746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee69f4e-88b6-4ebc-ab04-5d02c5d73e0d service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:51.667582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec632733-afe0-4d83-9d94-96a64de21321 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:51.801954 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5ee53-d965-417a-809d-6d29ca34d590 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345c25e7dd2341bcb4c53d0a5aa36b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:51.802755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5ee53-d965-417a-809d-6d29ca34d590 service glance] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:51.803928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5ee53-d965-417a-809d-6d29ca34d590 service glance] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:51.804792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5ee53-d965-417a-809d-6d29ca34d590 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:51.863933 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec632733-afe0-4d83-9d94-96a64de21321 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:51.881263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e541ab-3ce3-47ba-914e-75be0fca43e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:51.882168 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e541ab-3ce3-47ba-914e-75be0fca43e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:51.882558 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e541ab-3ce3-47ba-914e-75be0fca43e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:51.886908 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e541ab-3ce3-47ba-914e-75be0fca43e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:51.887984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e541ab-3ce3-47ba-914e-75be0fca43e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:51.889826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e541ab-3ce3-47ba-914e-75be0fca43e1 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:51.935203 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 856/1695] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:02:51.939820 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e541ab-3ce3-47ba-914e-75be0fca43e1 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:52.004140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e541ab-3ce3-47ba-914e-75be0fca43e1 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:52.030612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917d736-c98f-4692-bdb5-62f243daa8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:52.035515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917d736-c98f-4692-bdb5-62f243daa8e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:52.035806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917d736-c98f-4692-bdb5-62f243daa8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:52.036111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917d736-c98f-4692-bdb5-62f243daa8e5 admin admin] PATH_INFO: `/v3/projects/3efe4c4c87fc4fcea11d94662e0fc766/users/2044432bea754a47abc6396eb9ed1cf4/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:52.044616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917d736-c98f-4692-bdb5-62f243daa8e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efe4c4c87fc4fcea11d94662e0fc766, user_id=2044432bea754a47abc6396eb9ed1cf4, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:52.052467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917d736-c98f-4692-bdb5-62f243daa8e5 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:52.092619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 857/1696] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:02:51 2022] PUT /identity/v3/projects/3efe4c4c87fc4fcea11d94662e0fc766/users/2044432bea754a47abc6396eb9ed1cf4/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:02:52.100385 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d804098-0cbe-468e-94a9-ec18b1adfea4 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:52.100645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d804098-0cbe-468e-94a9-ec18b1adfea4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:52.101352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d804098-0cbe-468e-94a9-ec18b1adfea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:52.104940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5ee53-d965-417a-809d-6d29ca34d590 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:52.110493 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5ee53-d965-417a-809d-6d29ca34d590 service glance] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:52.158270 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 840/1697] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:52.190639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5d804098-0cbe-468e-94a9-ec18b1adfea4 None None] MFA Rules not processed for user `2044432bea754a47abc6396eb9ed1cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:52.196545 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5d804098-0cbe-468e-94a9-ec18b1adfea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:52.414458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 858/1698] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:52 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:52.506255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5ee53-d965-417a-809d-6d29ca34d590 service glance] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:52.542574 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d804098-0cbe-468e-94a9-ec18b1adfea4 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:52.631101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:52.642020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5ee53-d965-417a-809d-6d29ca34d590 service glance] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:52.726031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d804098-0cbe-468e-94a9-ec18b1adfea4 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:52.742906 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:52.746988 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d551b3-906f-4865-a166-8872278d23e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:52.747801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d551b3-906f-4865-a166-8872278d23e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:52.748299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d551b3-906f-4865-a166-8872278d23e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:52.748644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d551b3-906f-4865-a166-8872278d23e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:52.750756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-97d551b3-906f-4865-a166-8872278d23e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:52.795592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffdb0e-0522-49d4-a801-c8289e3d0cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:52.799064 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffdb0e-0522-49d4-a801-c8289e3d0cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:52.799357 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffdb0e-0522-49d4-a801-c8289e3d0cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:52.799871 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffdb0e-0522-49d4-a801-c8289e3d0cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:52.946288 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffdb0e-0522-49d4-a801-c8289e3d0cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:52.949640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffdb0e-0522-49d4-a801-c8289e3d0cd6 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:52.970977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 841/1699] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:52 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:53.011080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d551b3-906f-4865-a166-8872278d23e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:53.021601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d551b3-906f-4865-a166-8872278d23e5 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:53.052663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 859/1700] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:52 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:02:53.885712 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1823dc-e561-490c-867d-3b32b87cfb95 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:53.886302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1823dc-e561-490c-867d-3b32b87cfb95 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:53.886302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1823dc-e561-490c-867d-3b32b87cfb95 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:53.888298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 842/1701] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:54.198194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33fc5-0aba-4acd-b7f1-925b00c7fb84 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:54.199058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33fc5-0aba-4acd-b7f1-925b00c7fb84 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:54.199058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e33fc5-0aba-4acd-b7f1-925b00c7fb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:54.222400 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-85e33fc5-0aba-4acd-b7f1-925b00c7fb84 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:54.224270 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-85e33fc5-0aba-4acd-b7f1-925b00c7fb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:54.324621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 860/1702] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:54.379561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1823dc-e561-490c-867d-3b32b87cfb95 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:54.384805 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8d1823dc-e561-490c-867d-3b32b87cfb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:54.432851 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1823dc-e561-490c-867d-3b32b87cfb95 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:54.433299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b2fb0-53f7-4454-829e-859e8f730749 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:54.433942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b2fb0-53f7-4454-829e-859e8f730749 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:54.434371 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b2fb0-53f7-4454-829e-859e8f730749 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:54.436616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 861/1703] 10.222.0.20 () {54 vars in 912 bytes} [Sun Aug 7 01:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:54.447421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04c783-8402-4e3d-bf1a-24a14a044c1c None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:54.447973 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04c783-8402-4e3d-bf1a-24a14a044c1c None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:54.448411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04c783-8402-4e3d-bf1a-24a14a044c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:54.461334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09ef18-03d9-442d-9a6c-4e9f54b0cc62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:54.462100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09ef18-03d9-442d-9a6c-4e9f54b0cc62 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:54.465651 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09ef18-03d9-442d-9a6c-4e9f54b0cc62 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:54.467357 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09ef18-03d9-442d-9a6c-4e9f54b0cc62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:54.504832 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09ef18-03d9-442d-9a6c-4e9f54b0cc62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:54.510543 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09ef18-03d9-442d-9a6c-4e9f54b0cc62 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:54.539801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-1d04c783-8402-4e3d-bf1a-24a14a044c1c None None] MFA Rules not processed for user `e393d9c50bbb4f69a48ae635d13b1197`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:54.541100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1d04c783-8402-4e3d-bf1a-24a14a044c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:54.553449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 862/1704] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:02:54.563881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 843/1705] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:54.579640 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04c783-8402-4e3d-bf1a-24a14a044c1c None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:54.581236 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1d04c783-8402-4e3d-bf1a-24a14a044c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:54.604390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04c783-8402-4e3d-bf1a-24a14a044c1c None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:54.609131 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8f8af-b016-4cb2-9e2f-1097d407e856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:54.609789 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8f8af-b016-4cb2-9e2f-1097d407e856 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:54.610070 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8f8af-b016-4cb2-9e2f-1097d407e856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:54.610343 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8f8af-b016-4cb2-9e2f-1097d407e856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:54.645286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8f8af-b016-4cb2-9e2f-1097d407e856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:54.648478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8f8af-b016-4cb2-9e2f-1097d407e856 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:54.666803 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 863/1706] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:55.967489 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972d118-47c0-43fe-91d5-669193e3424c None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:55.967989 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972d118-47c0-43fe-91d5-669193e3424c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:55.968341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972d118-47c0-43fe-91d5-669193e3424c None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:55.970456 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 844/1707] 10.222.0.20 () {54 vars in 961 bytes} [Sun Aug 7 01:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:02:55.976826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ee4c9-e5e4-40e0-889c-17cb5d67ba0b None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:55.977369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ee4c9-e5e4-40e0-889c-17cb5d67ba0b None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:55.977603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ee4c9-e5e4-40e0-889c-17cb5d67ba0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:56.015662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ab6c8-3f6c-44b6-a3c7-943ee563c09e None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:56.016119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ab6c8-3f6c-44b6-a3c7-943ee563c09e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:56.016499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ab6c8-3f6c-44b6-a3c7-943ee563c09e None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:56.019406 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 845/1708] 10.222.0.20 () {54 vars in 912 bytes} [Sun Aug 7 01:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:02:56.026413 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec2225-502a-4fcb-b8a1-b0ae8f20dca4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:56.026848 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec2225-502a-4fcb-b8a1-b0ae8f20dca4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:56.027230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec2225-502a-4fcb-b8a1-b0ae8f20dca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:56.045547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c34ee4c9-e5e4-40e0-889c-17cb5d67ba0b None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:56.058407 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c34ee4c9-e5e4-40e0-889c-17cb5d67ba0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:56.112131 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 864/1709] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Aug 7 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:56.114932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4dec2225-502a-4fcb-b8a1-b0ae8f20dca4 None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:56.120469 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4dec2225-502a-4fcb-b8a1-b0ae8f20dca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:56.129054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ee4c9-e5e4-40e0-889c-17cb5d67ba0b None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:56.156985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ee4c9-e5e4-40e0-889c-17cb5d67ba0b None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:56.189491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c8f9e-00af-4bc0-8472-b51cb57d74b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:56.190154 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c8f9e-00af-4bc0-8472-b51cb57d74b1 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:56.192522 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c8f9e-00af-4bc0-8472-b51cb57d74b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:56.193362 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c8f9e-00af-4bc0-8472-b51cb57d74b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:56.198386 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-531c8f9e-00af-4bc0-8472-b51cb57d74b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:56.225682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c8f9e-00af-4bc0-8472-b51cb57d74b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:56.228865 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c8f9e-00af-4bc0-8472-b51cb57d74b1 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:56.252208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 865/1710] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:56.321930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 846/1711] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 01:02:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:56.372632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c8f9e-00af-4bc0-8472-b51cb57d74b1 service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:56.388936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c8f9e-00af-4bc0-8472-b51cb57d74b1 service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:56.393348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e56286-3d72-4a16-b0bb-dce74ced4064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:56.394130 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56286-3d72-4a16-b0bb-dce74ced4064 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:56.394264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56286-3d72-4a16-b0bb-dce74ced4064 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:56.394514 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56286-3d72-4a16-b0bb-dce74ced4064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:56.418386 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e56286-3d72-4a16-b0bb-dce74ced4064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:56.419874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e56286-3d72-4a16-b0bb-dce74ced4064 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:56.447794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 866/1712] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:56.529764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec2225-502a-4fcb-b8a1-b0ae8f20dca4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:56.531401 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4dec2225-502a-4fcb-b8a1-b0ae8f20dca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:56.567520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec2225-502a-4fcb-b8a1-b0ae8f20dca4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:56.580798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9ff46-9c3e-4f49-ab96-ad5a76a5e0c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:56.581520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9ff46-9c3e-4f49-ab96-ad5a76a5e0c0 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:56.581801 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9ff46-9c3e-4f49-ab96-ad5a76a5e0c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:56.582095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9ff46-9c3e-4f49-ab96-ad5a76a5e0c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:56.597245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9ff46-9c3e-4f49-ab96-ad5a76a5e0c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:56.599093 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9ff46-9c3e-4f49-ab96-ad5a76a5e0c0 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:56.628759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 847/1713] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:56 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:56.688499 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01265f-54aa-4a11-a153-0e64e3560301 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:56.689125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01265f-54aa-4a11-a153-0e64e3560301 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:56.689599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01265f-54aa-4a11-a153-0e64e3560301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:56.715323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:56.728323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-1e01265f-54aa-4a11-a153-0e64e3560301 None None] MFA Rules not processed for user `d75986e659174d50881e14a275adeb76`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:56.734272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1e01265f-54aa-4a11-a153-0e64e3560301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:56.883104 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 867/1714] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:02:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:59.421163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9a6b4-1281-4480-8dd9-3a1f5e841424 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:59.421808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9a6b4-1281-4480-8dd9-3a1f5e841424 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:59.423020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9a6b4-1281-4480-8dd9-3a1f5e841424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:59.563399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f1e9a6b4-1281-4480-8dd9-3a1f5e841424 None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:59.564898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f1e9a6b4-1281-4480-8dd9-3a1f5e841424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:59.605572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:59.741725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 848/1715] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:00.011546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01265f-54aa-4a11-a153-0e64e3560301 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:00.013119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1e01265f-54aa-4a11-a153-0e64e3560301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:00.265227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01265f-54aa-4a11-a153-0e64e3560301 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:00.277727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead836f7-32df-4d40-842e-796252d1b835 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:00.278958 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead836f7-32df-4d40-842e-796252d1b835 service swift] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:00.278958 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead836f7-32df-4d40-842e-796252d1b835 service swift] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:00.278958 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead836f7-32df-4d40-842e-796252d1b835 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:00.292195 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead836f7-32df-4d40-842e-796252d1b835 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:00.293913 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead836f7-32df-4d40-842e-796252d1b835 service swift] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:00.306616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 868/1716] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 01:03:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:03:00.477305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d8a74-738b-44c2-a9c8-5c9de6a871a8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:00.482609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d8a74-738b-44c2-a9c8-5c9de6a871a8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:00.482609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d8a74-738b-44c2-a9c8-5c9de6a871a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:00.628873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1d3d8a74-738b-44c2-a9c8-5c9de6a871a8 None None] MFA Rules not processed for user `2b963f39a6204ab8b96aa54de6dbb1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:00.630383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1d3d8a74-738b-44c2-a9c8-5c9de6a871a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:00.980220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 849/1717] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:00.997961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead836f7-32df-4d40-842e-796252d1b835 service swift] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:00.999473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ead836f7-32df-4d40-842e-796252d1b835 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:01.054507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead836f7-32df-4d40-842e-796252d1b835 service swift] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:01.083799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf9a9f-4f9d-4488-a181-31bc4658f3e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:01.085865 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9a9f-4f9d-4488-a181-31bc4658f3e6 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:01.086152 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9a9f-4f9d-4488-a181-31bc4658f3e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:01.088939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf9a9f-4f9d-4488-a181-31bc4658f3e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:01.152731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf9a9f-4f9d-4488-a181-31bc4658f3e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:01.154664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf9a9f-4f9d-4488-a181-31bc4658f3e6 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:01.171269 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 869/1718] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:03:02.916309 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a692a5-14c9-4903-811f-2c5bbb0a1e2b None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:02.916906 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a692a5-14c9-4903-811f-2c5bbb0a1e2b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:02.917129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a692a5-14c9-4903-811f-2c5bbb0a1e2b None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:02.918927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 850/1719] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:03:02.978861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b815c-26d0-4589-bafa-b4e4eedba533 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:02.979446 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b815c-26d0-4589-bafa-b4e4eedba533 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:02.979679 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b815c-26d0-4589-bafa-b4e4eedba533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:03.046808 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-ef6b815c-26d0-4589-bafa-b4e4eedba533 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:03.058706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ef6b815c-26d0-4589-bafa-b4e4eedba533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:03.104282 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 870/1720] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:03.158062 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a692a5-14c9-4903-811f-2c5bbb0a1e2b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:03.188190 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a692a5-14c9-4903-811f-2c5bbb0a1e2b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:03.201899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29b7e7-67de-4212-8a30-a1b58c0a3bfe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:03.202643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29b7e7-67de-4212-8a30-a1b58c0a3bfe service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:03.202926 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29b7e7-67de-4212-8a30-a1b58c0a3bfe service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:03.204473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29b7e7-67de-4212-8a30-a1b58c0a3bfe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:03.228385 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29b7e7-67de-4212-8a30-a1b58c0a3bfe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:03.231298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29b7e7-67de-4212-8a30-a1b58c0a3bfe service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:03.268629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 851/1721] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:03:03.424361 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b815c-26d0-4589-bafa-b4e4eedba533 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:03.432832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ef6b815c-26d0-4589-bafa-b4e4eedba533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:03.646258 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b815c-26d0-4589-bafa-b4e4eedba533 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:03.660986 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cde38-6992-4ad4-82c8-0d6ac2bbf01d tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed4445a42de4e17b5e3f0e1e0909a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '913dd11fdf254b3ebb975bc4491a8940', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:03.662174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cde38-6992-4ad4-82c8-0d6ac2bbf01d tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:03.663683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cde38-6992-4ad4-82c8-0d6ac2bbf01d tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:03.664228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cde38-6992-4ad4-82c8-0d6ac2bbf01d tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:03.666530 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cde38-6992-4ad4-82c8-0d6ac2bbf01d tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:03:03.667325 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cde38-6992-4ad4-82c8-0d6ac2bbf01d tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:03.671723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cde38-6992-4ad4-82c8-0d6ac2bbf01d tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:03.682815 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:03.713295 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b8d42-0d7e-4257-aa4b-ce62838817ea None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:03.713582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b8d42-0d7e-4257-aa4b-ce62838817ea None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:03.713867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b8d42-0d7e-4257-aa4b-ce62838817ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:03.718902 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 871/1722] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:03:03.723045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cde38-6992-4ad4-82c8-0d6ac2bbf01d tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:03.750464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cde38-6992-4ad4-82c8-0d6ac2bbf01d tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:03.766234 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a7054-93d8-4590-bdb1-ec182279667f tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed4445a42de4e17b5e3f0e1e0909a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '913dd11fdf254b3ebb975bc4491a8940', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:03.766909 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a7054-93d8-4590-bdb1-ec182279667f tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:03.767196 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a7054-93d8-4590-bdb1-ec182279667f tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:03.770013 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a7054-93d8-4590-bdb1-ec182279667f tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:03.773877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a7054-93d8-4590-bdb1-ec182279667f tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:03.776662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7c8b8d42-0d7e-4257-aa4b-ce62838817ea None None] MFA Rules not processed for user `e393d9c50bbb4f69a48ae635d13b1197`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:03.777457 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a7054-93d8-4590-bdb1-ec182279667f tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:03.780117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7c8b8d42-0d7e-4257-aa4b-ce62838817ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:03.801265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 852/1723] 10.222.0.33 () {58 vars in 1015 bytes} [Sun Aug 7 01:03:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:03:03.852366 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 872/1724] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:03:03 2022] POST /identity/v3/projects => generated 347 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:03:03.856344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b8d42-0d7e-4257-aa4b-ce62838817ea None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:03.873842 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b8d42-0d7e-4257-aa4b-ce62838817ea None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:03.968791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a7054-93d8-4590-bdb1-ec182279667f tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:04.129740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63f80b-080e-4171-b358-a3c0faf191a2 tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed4445a42de4e17b5e3f0e1e0909a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '913dd11fdf254b3ebb975bc4491a8940', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:04.147856 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63f80b-080e-4171-b358-a3c0faf191a2 tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:04.148740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63f80b-080e-4171-b358-a3c0faf191a2 tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:04.150296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63f80b-080e-4171-b358-a3c0faf191a2 tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:04.157403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63f80b-080e-4171-b358-a3c0faf191a2 tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:03:04.159733 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63f80b-080e-4171-b358-a3c0faf191a2 tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:04.162139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63f80b-080e-4171-b358-a3c0faf191a2 tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:04.211258 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 853/1725] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:03:04.222482 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a7054-93d8-4590-bdb1-ec182279667f tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:04.232201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77802f-7152-475d-a813-0689cf4ce539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:04.233835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77802f-7152-475d-a813-0689cf4ce539 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:04.234726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77802f-7152-475d-a813-0689cf4ce539 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:04.235731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77802f-7152-475d-a813-0689cf4ce539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:04.249748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77802f-7152-475d-a813-0689cf4ce539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:04.252501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77802f-7152-475d-a813-0689cf4ce539 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:04.264634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 873/1726] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:03:05.503247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63f80b-080e-4171-b358-a3c0faf191a2 tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:05.672558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:05.805526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63f80b-080e-4171-b358-a3c0faf191a2 tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:05.821301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff61d9-2efa-4c48-8267-98caa67dbe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:05.821996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff61d9-2efa-4c48-8267-98caa67dbe24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:05.822319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff61d9-2efa-4c48-8267-98caa67dbe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:05.822593 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff61d9-2efa-4c48-8267-98caa67dbe24 admin admin] PATH_INFO: `/v3/users/7e7a7efae23d41dba9894c64cd5315f6` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:05.826237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff61d9-2efa-4c48-8267-98caa67dbe24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7a7efae23d41dba9894c64cd5315f6)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:05.828217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff61d9-2efa-4c48-8267-98caa67dbe24 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:06.003397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bfff61d9-2efa-4c48-8267-98caa67dbe24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7a7efae23d41dba9894c64cd5315f6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:06.039846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bfff61d9-2efa-4c48-8267-98caa67dbe24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7a7efae23d41dba9894c64cd5315f6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:06.070947 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bfff61d9-2efa-4c48-8267-98caa67dbe24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7a7efae23d41dba9894c64cd5315f6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:06.092946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bfff61d9-2efa-4c48-8267-98caa67dbe24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7a7efae23d41dba9894c64cd5315f6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:06.096428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bfff61d9-2efa-4c48-8267-98caa67dbe24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7a7efae23d41dba9894c64cd5315f6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:06.113321 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 854/1727] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:03:05 2022] DELETE /identity/v3/users/7e7a7efae23d41dba9894c64cd5315f6 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:06.117838 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ac428-f984-42ca-8926-bd6bb9db84db None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:06.118381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ac428-f984-42ca-8926-bd6bb9db84db None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:06.118381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ac428-f984-42ca-8926-bd6bb9db84db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:06.165276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-501ac428-f984-42ca-8926-bd6bb9db84db None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:06.166554 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-501ac428-f984-42ca-8926-bd6bb9db84db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:06.410906 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 874/1728] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:06.558164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff61d9-2efa-4c48-8267-98caa67dbe24 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:06.559775 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bfff61d9-2efa-4c48-8267-98caa67dbe24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:06.763557 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff61d9-2efa-4c48-8267-98caa67dbe24 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:06.802432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7de728-be00-4a89-b2b9-ccc6820a875e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:06.806000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7de728-be00-4a89-b2b9-ccc6820a875e service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:06.806307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7de728-be00-4a89-b2b9-ccc6820a875e service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:06.808333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7de728-be00-4a89-b2b9-ccc6820a875e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:06.848135 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7de728-be00-4a89-b2b9-ccc6820a875e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:06.852630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7de728-be00-4a89-b2b9-ccc6820a875e service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:06.893983 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 855/1729] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:03:07.227075 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ac428-f984-42ca-8926-bd6bb9db84db None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:07.229012 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-501ac428-f984-42ca-8926-bd6bb9db84db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:07.482691 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ac428-f984-42ca-8926-bd6bb9db84db None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:07.489491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570e77c-f156-4ec4-b718-028cbb8b12fe tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eed4445a42de4e17b5e3f0e1e0909a38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '913dd11fdf254b3ebb975bc4491a8940', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:07.490452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570e77c-f156-4ec4-b718-028cbb8b12fe tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:07.491430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570e77c-f156-4ec4-b718-028cbb8b12fe tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:07.492181 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570e77c-f156-4ec4-b718-028cbb8b12fe tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] PATH_INFO: `/v3/projects/f4bfddde9bdf4489b0c39a7e70229fd1` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:07.493918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570e77c-f156-4ec4-b718-028cbb8b12fe tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f4bfddde9bdf4489b0c39a7e70229fd1)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:07.496429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570e77c-f156-4ec4-b718-028cbb8b12fe tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:07.561109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:07.630002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c570e77c-f156-4ec4-b718-028cbb8b12fe tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4bfddde9bdf4489b0c39a7e70229fd1', 'request_id': 'req-c570e77c-f156-4ec4-b718-028cbb8b12fe'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:07.645025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c570e77c-f156-4ec4-b718-028cbb8b12fe tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4bfddde9bdf4489b0c39a7e70229fd1', 'request_id': 'req-c570e77c-f156-4ec4-b718-028cbb8b12fe'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:07.664162 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c570e77c-f156-4ec4-b718-028cbb8b12fe tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4bfddde9bdf4489b0c39a7e70229fd1', 'request_id': 'req-c570e77c-f156-4ec4-b718-028cbb8b12fe'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:07.696999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c570e77c-f156-4ec4-b718-028cbb8b12fe tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] The token cache is being invalidate because project f4bfddde9bdf4489b0c39a7e70229fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:03:07.697291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c570e77c-f156-4ec4-b718-028cbb8b12fe tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:07.700466 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c570e77c-f156-4ec4-b718-028cbb8b12fe tempest-RoutersAdminTest-692066948 tempest-RoutersAdminTest-692066948-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:07.706045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 875/1730] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:03:07 2022] DELETE /identity/v3/projects/f4bfddde9bdf4489b0c39a7e70229fd1 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:07.763251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7de728-be00-4a89-b2b9-ccc6820a875e service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:07.766189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9f7de728-be00-4a89-b2b9-ccc6820a875e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:07.785619 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7de728-be00-4a89-b2b9-ccc6820a875e service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:07.902038 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d5681-efb6-4c46-a24c-4ad7ed8084b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:07.904290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d5681-efb6-4c46-a24c-4ad7ed8084b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:07.905320 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d5681-efb6-4c46-a24c-4ad7ed8084b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:07.905756 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d5681-efb6-4c46-a24c-4ad7ed8084b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:07.914032 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-268d5681-efb6-4c46-a24c-4ad7ed8084b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:07.932729 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:08.171571 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d5681-efb6-4c46-a24c-4ad7ed8084b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:08.173390 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d5681-efb6-4c46-a24c-4ad7ed8084b0 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:08.203840 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 856/1731] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:03:09.034472 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bd62a-1b46-4fca-a91a-10930eea64c5 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:09.035001 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bd62a-1b46-4fca-a91a-10930eea64c5 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:09.035001 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bd62a-1b46-4fca-a91a-10930eea64c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:09.072870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-744bd62a-1b46-4fca-a91a-10930eea64c5 None None] MFA Rules not processed for user `2b963f39a6204ab8b96aa54de6dbb1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:09.074141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-744bd62a-1b46-4fca-a91a-10930eea64c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:09.293064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 876/1732] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:11.293430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6370ea-3ece-48d5-bd7f-04a47107a871 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:11.294702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6370ea-3ece-48d5-bd7f-04a47107a871 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:11.294702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6370ea-3ece-48d5-bd7f-04a47107a871 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:11.298263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 857/1733] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:03:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:03:11.355343 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd1d15-707a-4e74-ab3b-ab31de0ac6b5 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:11.356301 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd1d15-707a-4e74-ab3b-ab31de0ac6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:11.356755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd1d15-707a-4e74-ab3b-ab31de0ac6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:11.402659 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-9cfd1d15-707a-4e74-ab3b-ab31de0ac6b5 None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:11.404087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9cfd1d15-707a-4e74-ab3b-ab31de0ac6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:11.578777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 877/1734] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:03:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:11.980427 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6370ea-3ece-48d5-bd7f-04a47107a871 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:11.983256 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4f6370ea-3ece-48d5-bd7f-04a47107a871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:12.233219 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6370ea-3ece-48d5-bd7f-04a47107a871 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:12.249146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:12.250096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:12.250720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:12.251772 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5 admin admin] PATH_INFO: `/v3/projects/d6a4f0819a464bd7b420ee3d9ab37ac6` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:12.258124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a4f0819a464bd7b420ee3d9ab37ac6)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:12.260447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:12.427234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a4f0819a464bd7b420ee3d9ab37ac6', 'request_id': 'req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:12.437911 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a4f0819a464bd7b420ee3d9ab37ac6', 'request_id': 'req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:12.464652 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a4f0819a464bd7b420ee3d9ab37ac6', 'request_id': 'req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:12.492387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5 admin admin] The token cache is being invalidate because project d6a4f0819a464bd7b420ee3d9ab37ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:03:12.492794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:12.493586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:12.497354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 858/1735] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:03:11 2022] DELETE /identity/v3/projects/d6a4f0819a464bd7b420ee3d9ab37ac6 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:12.506100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd1d15-707a-4e74-ab3b-ab31de0ac6b5 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:12.531956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd1d15-707a-4e74-ab3b-ab31de0ac6b5 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:12.707607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:12.771778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68750f10-d444-4ae1-8546-b3d10eb2166b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:12.773019 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68750f10-d444-4ae1-8546-b3d10eb2166b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:12.773567 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68750f10-d444-4ae1-8546-b3d10eb2166b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:12.774044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68750f10-d444-4ae1-8546-b3d10eb2166b admin admin] PATH_INFO: `/v3/users/0faa75f54ee544c79b2575c001d8c587` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:12.777864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68750f10-d444-4ae1-8546-b3d10eb2166b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0faa75f54ee544c79b2575c001d8c587)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:12.784885 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68750f10-d444-4ae1-8546-b3d10eb2166b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:12.919205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-68750f10-d444-4ae1-8546-b3d10eb2166b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0faa75f54ee544c79b2575c001d8c587'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:12.946291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-68750f10-d444-4ae1-8546-b3d10eb2166b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0faa75f54ee544c79b2575c001d8c587'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:12.991963 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-68750f10-d444-4ae1-8546-b3d10eb2166b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0faa75f54ee544c79b2575c001d8c587'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:12.993049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-68750f10-d444-4ae1-8546-b3d10eb2166b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0faa75f54ee544c79b2575c001d8c587'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:12.994031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-68750f10-d444-4ae1-8546-b3d10eb2166b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0faa75f54ee544c79b2575c001d8c587'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:13.023284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 878/1736] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:03:12 2022] DELETE /identity/v3/users/0faa75f54ee544c79b2575c001d8c587 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:13.209645 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:13.212246 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:13.237142 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7f09a-5195-43d7-b23e-97568a7cf9d5 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:13.309536 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:13.361461 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9de0ab-6241-4172-9644-d33f71b75174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:13.362605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9de0ab-6241-4172-9644-d33f71b75174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:13.363510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9de0ab-6241-4172-9644-d33f71b75174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:13.364063 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9de0ab-6241-4172-9644-d33f71b75174 admin admin] PATH_INFO: `/v3/users/a5e1412b6a8c4552aa60266f82135351` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:13.367106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9de0ab-6241-4172-9644-d33f71b75174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e1412b6a8c4552aa60266f82135351)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:13.372053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9de0ab-6241-4172-9644-d33f71b75174 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:13.453231 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8f9de0ab-6241-4172-9644-d33f71b75174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e1412b6a8c4552aa60266f82135351'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:13.468625 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8f9de0ab-6241-4172-9644-d33f71b75174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e1412b6a8c4552aa60266f82135351'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:13.488390 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8f9de0ab-6241-4172-9644-d33f71b75174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e1412b6a8c4552aa60266f82135351'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:13.505210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8f9de0ab-6241-4172-9644-d33f71b75174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e1412b6a8c4552aa60266f82135351'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:13.506924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8f9de0ab-6241-4172-9644-d33f71b75174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e1412b6a8c4552aa60266f82135351'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:13.520775 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 859/1737] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:03:13 2022] DELETE /identity/v3/users/a5e1412b6a8c4552aa60266f82135351 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:13.526567 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676bac0-6e71-4a48-9346-b993d968c245 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:13.527787 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676bac0-6e71-4a48-9346-b993d968c245 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:13.530957 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676bac0-6e71-4a48-9346-b993d968c245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:13.561404 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-1676bac0-6e71-4a48-9346-b993d968c245 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:13.563596 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1676bac0-6e71-4a48-9346-b993d968c245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:13.680397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9de0ab-6241-4172-9644-d33f71b75174 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:13.684113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8f9de0ab-6241-4172-9644-d33f71b75174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:13.716590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 879/1738] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:03:13.739475 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9de0ab-6241-4172-9644-d33f71b75174 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:13.749138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db116fe5-bc54-4535-96bc-17bf4e5fc038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:13.749138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db116fe5-bc54-4535-96bc-17bf4e5fc038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:13.750135 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db116fe5-bc54-4535-96bc-17bf4e5fc038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:13.750805 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db116fe5-bc54-4535-96bc-17bf4e5fc038 admin admin] PATH_INFO: `/v3/projects/f86923530bf742c69d7399bd185dc8f0` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:13.753361 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db116fe5-bc54-4535-96bc-17bf4e5fc038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f86923530bf742c69d7399bd185dc8f0)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:13.755997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db116fe5-bc54-4535-96bc-17bf4e5fc038 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:13.758841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676bac0-6e71-4a48-9346-b993d968c245 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:13.765085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1676bac0-6e71-4a48-9346-b993d968c245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:13.879875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-db116fe5-bc54-4535-96bc-17bf4e5fc038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f86923530bf742c69d7399bd185dc8f0', 'request_id': 'req-db116fe5-bc54-4535-96bc-17bf4e5fc038'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:13.886313 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676bac0-6e71-4a48-9346-b993d968c245 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:13.888876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-db116fe5-bc54-4535-96bc-17bf4e5fc038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f86923530bf742c69d7399bd185dc8f0', 'request_id': 'req-db116fe5-bc54-4535-96bc-17bf4e5fc038'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:13.914650 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-db116fe5-bc54-4535-96bc-17bf4e5fc038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f86923530bf742c69d7399bd185dc8f0', 'request_id': 'req-db116fe5-bc54-4535-96bc-17bf4e5fc038'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:13.917394 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:13.938020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-db116fe5-bc54-4535-96bc-17bf4e5fc038 admin admin] The token cache is being invalidate because project f86923530bf742c69d7399bd185dc8f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:03:13.938464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-db116fe5-bc54-4535-96bc-17bf4e5fc038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:13.939579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-db116fe5-bc54-4535-96bc-17bf4e5fc038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:13.941785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 860/1739] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:03:13 2022] DELETE /identity/v3/projects/f86923530bf742c69d7399bd185dc8f0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:13.943352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db116fe5-bc54-4535-96bc-17bf4e5fc038 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:13.947491 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-db116fe5-bc54-4535-96bc-17bf4e5fc038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:14.008839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33410495-621c-4deb-8f2c-fc778c557587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:14.011575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33410495-621c-4deb-8f2c-fc778c557587 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:14.011955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33410495-621c-4deb-8f2c-fc778c557587 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:14.012423 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33410495-621c-4deb-8f2c-fc778c557587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:14.016490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-33410495-621c-4deb-8f2c-fc778c557587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:14.023474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:14.079489 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db116fe5-bc54-4535-96bc-17bf4e5fc038 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:14.087538 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98920e3d-2747-4815-be07-066e76140426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:14.088310 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98920e3d-2747-4815-be07-066e76140426 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:14.088662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98920e3d-2747-4815-be07-066e76140426 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:14.089029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98920e3d-2747-4815-be07-066e76140426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:14.091261 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-98920e3d-2747-4815-be07-066e76140426 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:14.112643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98920e3d-2747-4815-be07-066e76140426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:14.114582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98920e3d-2747-4815-be07-066e76140426 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:14.142469 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 861/1740] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:03:14.156665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f0ecd-bfcb-4d9d-9f36-22f063473877 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:14.157926 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f0ecd-bfcb-4d9d-9f36-22f063473877 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:14.158294 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f0ecd-bfcb-4d9d-9f36-22f063473877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:14.184268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33410495-621c-4deb-8f2c-fc778c557587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:14.186707 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33410495-621c-4deb-8f2c-fc778c557587 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:14.190809 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4b8f0ecd-bfcb-4d9d-9f36-22f063473877 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:14.192271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4b8f0ecd-bfcb-4d9d-9f36-22f063473877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:14.208105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 862/1741] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:14.222422 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d253e8-c5ac-4dce-925b-f9005f7846ee None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:14.224776 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d253e8-c5ac-4dce-925b-f9005f7846ee None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:14.228209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d253e8-c5ac-4dce-925b-f9005f7846ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:14.240703 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 880/1742] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:03:14.268893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-67d253e8-c5ac-4dce-925b-f9005f7846ee None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:14.271322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-67d253e8-c5ac-4dce-925b-f9005f7846ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:14.288786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 863/1743] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:14.296554 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33410495-621c-4deb-8f2c-fc778c557587 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:14.321811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33410495-621c-4deb-8f2c-fc778c557587 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:14.334216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26abc67-3a3b-4c27-9cb2-c0ce81e1d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:14.336761 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26abc67-3a3b-4c27-9cb2-c0ce81e1d8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:14.337106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26abc67-3a3b-4c27-9cb2-c0ce81e1d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:14.337395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26abc67-3a3b-4c27-9cb2-c0ce81e1d8d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:14.338135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26abc67-3a3b-4c27-9cb2-c0ce81e1d8d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:03:14.338741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26abc67-3a3b-4c27-9cb2-c0ce81e1d8d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:14.341225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26abc67-3a3b-4c27-9cb2-c0ce81e1d8d9 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:14.373949 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 881/1744] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:03:14.377933 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d253e8-c5ac-4dce-925b-f9005f7846ee None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:14.391674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d253e8-c5ac-4dce-925b-f9005f7846ee None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:14.418712 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e0208-b5a7-4f24-943a-717917c1862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:14.420143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e0208-b5a7-4f24-943a-717917c1862e admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:14.421721 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e0208-b5a7-4f24-943a-717917c1862e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:14.424274 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e0208-b5a7-4f24-943a-717917c1862e admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:14.427840 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e0208-b5a7-4f24-943a-717917c1862e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:14.441855 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e0208-b5a7-4f24-943a-717917c1862e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:14.496122 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 864/1745] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:03:14 2022] POST /identity/v3/projects => generated 397 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:03:14.499442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26abc67-3a3b-4c27-9cb2-c0ce81e1d8d9 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:14.515438 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26abc67-3a3b-4c27-9cb2-c0ce81e1d8d9 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:14.633784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46c5b7-aae5-4f98-9206-8e25362e310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:14.634984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46c5b7-aae5-4f98-9206-8e25362e310b admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:14.635469 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46c5b7-aae5-4f98-9206-8e25362e310b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:14.637113 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46c5b7-aae5-4f98-9206-8e25362e310b admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:14.637593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46c5b7-aae5-4f98-9206-8e25362e310b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:14.641081 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46c5b7-aae5-4f98-9206-8e25362e310b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:14.682533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 882/1746] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:03:14 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:03:14.684002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e0208-b5a7-4f24-943a-717917c1862e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:14.701158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e0208-b5a7-4f24-943a-717917c1862e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:14.713025 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf31675-5259-4978-9fbd-0beec3152ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:14.713679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf31675-5259-4978-9fbd-0beec3152ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:14.713961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf31675-5259-4978-9fbd-0beec3152ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:14.714461 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf31675-5259-4978-9fbd-0beec3152ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:14.715192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf31675-5259-4978-9fbd-0beec3152ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:14.717150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf31675-5259-4978-9fbd-0beec3152ac0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:14.736104 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 865/1747] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:03:14.741630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46c5b7-aae5-4f98-9206-8e25362e310b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:14.754678 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46c5b7-aae5-4f98-9206-8e25362e310b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:14.768042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28bcf1-9e50-4f8b-a619-aed3a3858e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:14.769785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28bcf1-9e50-4f8b-a619-aed3a3858e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:14.770092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28bcf1-9e50-4f8b-a619-aed3a3858e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:14.770374 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28bcf1-9e50-4f8b-a619-aed3a3858e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:14.771122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28bcf1-9e50-4f8b-a619-aed3a3858e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:14.774220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28bcf1-9e50-4f8b-a619-aed3a3858e6c admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:14.800584 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 883/1748] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:03:14.806704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf31675-5259-4978-9fbd-0beec3152ac0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:14.822914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28bcf1-9e50-4f8b-a619-aed3a3858e6c admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:14.824838 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9b28bcf1-9e50-4f8b-a619-aed3a3858e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:14.825168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf31675-5259-4978-9fbd-0beec3152ac0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:14.841114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56026ea-a6b1-4838-b5e9-aa93b7b356bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:14.842140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56026ea-a6b1-4838-b5e9-aa93b7b356bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:14.842804 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56026ea-a6b1-4838-b5e9-aa93b7b356bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:14.843573 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56026ea-a6b1-4838-b5e9-aa93b7b356bb admin admin] PATH_INFO: `/v3/projects/375a8a1ab8b6476e81b87479d2db0c4b/users/33e2c3fcec1a43ffa6f582a8ca0d36bf/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:14.845774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28bcf1-9e50-4f8b-a619-aed3a3858e6c admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:14.864872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e7132-ef3c-47e6-bf0f-4c68f3920606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:14.868873 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e7132-ef3c-47e6-bf0f-4c68f3920606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:14.869395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e7132-ef3c-47e6-bf0f-4c68f3920606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:14.869680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e7132-ef3c-47e6-bf0f-4c68f3920606 admin admin] PATH_INFO: `/v3/projects/3a1838912d7d4c198f58ff2b8087ce21` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:14.876103 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e7132-ef3c-47e6-bf0f-4c68f3920606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a1838912d7d4c198f58ff2b8087ce21)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:14.876983 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e7132-ef3c-47e6-bf0f-4c68f3920606 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:14.885259 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56026ea-a6b1-4838-b5e9-aa93b7b356bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=375a8a1ab8b6476e81b87479d2db0c4b, user_id=33e2c3fcec1a43ffa6f582a8ca0d36bf, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:14.889788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56026ea-a6b1-4838-b5e9-aa93b7b356bb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:14.916164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 866/1749] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:03:14 2022] PUT /identity/v3/projects/375a8a1ab8b6476e81b87479d2db0c4b/users/33e2c3fcec1a43ffa6f582a8ca0d36bf/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:14.926487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e159586-15b4-43b5-af8b-bd75de7632f5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:14.926776 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e159586-15b4-43b5-af8b-bd75de7632f5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:14.927061 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e159586-15b4-43b5-af8b-bd75de7632f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:14.954239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:14.992415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3e159586-15b4-43b5-af8b-bd75de7632f5 None None] MFA Rules not processed for user `33e2c3fcec1a43ffa6f582a8ca0d36bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:14.998681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3e159586-15b4-43b5-af8b-bd75de7632f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:15.038540 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-237e7132-ef3c-47e6-bf0f-4c68f3920606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a1838912d7d4c198f58ff2b8087ce21', 'request_id': 'req-237e7132-ef3c-47e6-bf0f-4c68f3920606'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:15.049444 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-237e7132-ef3c-47e6-bf0f-4c68f3920606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a1838912d7d4c198f58ff2b8087ce21', 'request_id': 'req-237e7132-ef3c-47e6-bf0f-4c68f3920606'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:15.064219 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-237e7132-ef3c-47e6-bf0f-4c68f3920606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a1838912d7d4c198f58ff2b8087ce21', 'request_id': 'req-237e7132-ef3c-47e6-bf0f-4c68f3920606'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:15.092873 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-237e7132-ef3c-47e6-bf0f-4c68f3920606 admin admin] The token cache is being invalidate because project 3a1838912d7d4c198f58ff2b8087ce21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:03:15.093173 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-237e7132-ef3c-47e6-bf0f-4c68f3920606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:15.093921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-237e7132-ef3c-47e6-bf0f-4c68f3920606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:15.099755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 884/1750] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:03:14 2022] DELETE /identity/v3/projects/3a1838912d7d4c198f58ff2b8087ce21 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:03:15.103417 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e7132-ef3c-47e6-bf0f-4c68f3920606 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:15.105883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-237e7132-ef3c-47e6-bf0f-4c68f3920606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:15.145016 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 867/1751] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:03:15.162896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e159586-15b4-43b5-af8b-bd75de7632f5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:15.164507 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3e159586-15b4-43b5-af8b-bd75de7632f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:15.279240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e7132-ef3c-47e6-bf0f-4c68f3920606 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:15.294538 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f73ccd-77f0-4ffa-9350-ca9cb192990e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:15.295209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f73ccd-77f0-4ffa-9350-ca9cb192990e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:15.296179 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f73ccd-77f0-4ffa-9350-ca9cb192990e admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:15.296576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f73ccd-77f0-4ffa-9350-ca9cb192990e admin admin] PATH_INFO: `/v3/users/315b6b543043481298c09beda2e7729e` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:15.300115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f73ccd-77f0-4ffa-9350-ca9cb192990e admin admin] RBAC: Authorizing `identity:delete_user(user_id=315b6b543043481298c09beda2e7729e)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:15.305441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f73ccd-77f0-4ffa-9350-ca9cb192990e admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:15.311202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:15.336685 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e159586-15b4-43b5-af8b-bd75de7632f5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:15.345055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647bde6-1c3c-471a-be15-ae9dc3eab456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:15.346410 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647bde6-1c3c-471a-be15-ae9dc3eab456 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:15.346766 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647bde6-1c3c-471a-be15-ae9dc3eab456 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:15.347992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647bde6-1c3c-471a-be15-ae9dc3eab456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:15.373413 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647bde6-1c3c-471a-be15-ae9dc3eab456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:15.375411 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647bde6-1c3c-471a-be15-ae9dc3eab456 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:15.408710 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 868/1752] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:15 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:03:15.418242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f0f73ccd-77f0-4ffa-9350-ca9cb192990e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '315b6b543043481298c09beda2e7729e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:15.432242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f0f73ccd-77f0-4ffa-9350-ca9cb192990e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '315b6b543043481298c09beda2e7729e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:15.453327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f0f73ccd-77f0-4ffa-9350-ca9cb192990e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '315b6b543043481298c09beda2e7729e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:15.456216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f0f73ccd-77f0-4ffa-9350-ca9cb192990e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '315b6b543043481298c09beda2e7729e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:15.458559 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f0f73ccd-77f0-4ffa-9350-ca9cb192990e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '315b6b543043481298c09beda2e7729e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:15.482190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 885/1753] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:03:15 2022] DELETE /identity/v3/users/315b6b543043481298c09beda2e7729e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:03:16.720025 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647bde6-1c3c-471a-be15-ae9dc3eab456 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:16.750372 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647bde6-1c3c-471a-be15-ae9dc3eab456 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:16.833469 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acb7b3-af0a-44b0-b320-ba843470b9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:16.834139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acb7b3-af0a-44b0-b320-ba843470b9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:16.834575 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acb7b3-af0a-44b0-b320-ba843470b9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:16.834922 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acb7b3-af0a-44b0-b320-ba843470b9ab admin admin] PATH_INFO: `/v3/projects/5a75d2ec24c7423f971b0c28de0c2abf` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:16.836479 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acb7b3-af0a-44b0-b320-ba843470b9ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a75d2ec24c7423f971b0c28de0c2abf)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:16.838662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acb7b3-af0a-44b0-b320-ba843470b9ab admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:16.915343 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-71acb7b3-af0a-44b0-b320-ba843470b9ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a75d2ec24c7423f971b0c28de0c2abf', 'request_id': 'req-71acb7b3-af0a-44b0-b320-ba843470b9ab'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:16.922402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-71acb7b3-af0a-44b0-b320-ba843470b9ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a75d2ec24c7423f971b0c28de0c2abf', 'request_id': 'req-71acb7b3-af0a-44b0-b320-ba843470b9ab'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:16.932512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-71acb7b3-af0a-44b0-b320-ba843470b9ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a75d2ec24c7423f971b0c28de0c2abf', 'request_id': 'req-71acb7b3-af0a-44b0-b320-ba843470b9ab'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:16.947268 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-71acb7b3-af0a-44b0-b320-ba843470b9ab admin admin] The token cache is being invalidate because project 5a75d2ec24c7423f971b0c28de0c2abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:03:16.947508 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-71acb7b3-af0a-44b0-b320-ba843470b9ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:16.948506 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-71acb7b3-af0a-44b0-b320-ba843470b9ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:16.950393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 869/1754] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:03:16 2022] DELETE /identity/v3/projects/5a75d2ec24c7423f971b0c28de0c2abf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:16.955614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979e9df-2151-4779-87ad-58ab0066d4c0 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:16.956160 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979e9df-2151-4779-87ad-58ab0066d4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:16.956280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979e9df-2151-4779-87ad-58ab0066d4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:16.982327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-4979e9df-2151-4779-87ad-58ab0066d4c0 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:16.983441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4979e9df-2151-4779-87ad-58ab0066d4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:17.030190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:17.068438 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 886/1755] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:17.077059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349faa7-35aa-43b3-ac8e-53aa736215aa None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:17.077644 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349faa7-35aa-43b3-ac8e-53aa736215aa None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:17.077930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349faa7-35aa-43b3-ac8e-53aa736215aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:17.104714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6349faa7-35aa-43b3-ac8e-53aa736215aa None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:17.106316 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6349faa7-35aa-43b3-ac8e-53aa736215aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:17.119433 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 870/1756] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:17.121093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979e9df-2151-4779-87ad-58ab0066d4c0 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:17.132675 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979e9df-2151-4779-87ad-58ab0066d4c0 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:17.139343 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a5dba-c2a4-48d1-aaa1-786ebedf2f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:17.140123 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a5dba-c2a4-48d1-aaa1-786ebedf2f61 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:17.140476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a5dba-c2a4-48d1-aaa1-786ebedf2f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:17.140907 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a5dba-c2a4-48d1-aaa1-786ebedf2f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:17.141601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a5dba-c2a4-48d1-aaa1-786ebedf2f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:03:17.142120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a5dba-c2a4-48d1-aaa1-786ebedf2f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:17.144076 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a5dba-c2a4-48d1-aaa1-786ebedf2f61 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:17.162941 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 887/1757] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:03:17.165197 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349faa7-35aa-43b3-ac8e-53aa736215aa None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:17.176669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349faa7-35aa-43b3-ac8e-53aa736215aa None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:17.183443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fb893-45fb-4a08-9e36-27dccf985f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:17.184592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fb893-45fb-4a08-9e36-27dccf985f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:17.185155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fb893-45fb-4a08-9e36-27dccf985f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:17.185564 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fb893-45fb-4a08-9e36-27dccf985f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:17.186599 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fb893-45fb-4a08-9e36-27dccf985f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:17.188788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fb893-45fb-4a08-9e36-27dccf985f7a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:17.229220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 871/1758] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:03:17 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:03:17.230313 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a5dba-c2a4-48d1-aaa1-786ebedf2f61 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:17.248233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a5dba-c2a4-48d1-aaa1-786ebedf2f61 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:17.369233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5404f-18e1-4656-a9e2-96c450b5c930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:17.371791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5404f-18e1-4656-a9e2-96c450b5c930 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:17.371791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5404f-18e1-4656-a9e2-96c450b5c930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:17.372235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5404f-18e1-4656-a9e2-96c450b5c930 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:17.373182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5404f-18e1-4656-a9e2-96c450b5c930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:17.376128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5404f-18e1-4656-a9e2-96c450b5c930 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:17.426557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 888/1759] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:03:17 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:03:17.429097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fb893-45fb-4a08-9e36-27dccf985f7a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:17.447267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fb893-45fb-4a08-9e36-27dccf985f7a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:17.468680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6544aba-9bc1-49b0-a227-e3b505dcb75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:17.469569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6544aba-9bc1-49b0-a227-e3b505dcb75f admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:17.470026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6544aba-9bc1-49b0-a227-e3b505dcb75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:17.470461 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6544aba-9bc1-49b0-a227-e3b505dcb75f admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:17.471311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6544aba-9bc1-49b0-a227-e3b505dcb75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:17.473345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6544aba-9bc1-49b0-a227-e3b505dcb75f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:17.498310 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 872/1760] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:03:17.499340 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5404f-18e1-4656-a9e2-96c450b5c930 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:17.520620 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5404f-18e1-4656-a9e2-96c450b5c930 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:17.532701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9030e8-ef98-45da-882e-cb316eafd616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:17.534346 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9030e8-ef98-45da-882e-cb316eafd616 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:17.534792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9030e8-ef98-45da-882e-cb316eafd616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:17.535213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9030e8-ef98-45da-882e-cb316eafd616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:17.536078 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9030e8-ef98-45da-882e-cb316eafd616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:17.538302 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9030e8-ef98-45da-882e-cb316eafd616 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:17.554679 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 889/1761] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:03:17.558869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6544aba-9bc1-49b0-a227-e3b505dcb75f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:17.576809 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6544aba-9bc1-49b0-a227-e3b505dcb75f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:17.582323 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f04009-4bd4-43c0-aead-f961307c5c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:17.583204 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f04009-4bd4-43c0-aead-f961307c5c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:17.583593 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f04009-4bd4-43c0-aead-f961307c5c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:17.584007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f04009-4bd4-43c0-aead-f961307c5c18 admin admin] PATH_INFO: `/v3/projects/0699a5e68e884aa18a9286c60cfe265f/users/5d99b7134fb04e678edea9de3066f737/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:17.606204 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f04009-4bd4-43c0-aead-f961307c5c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0699a5e68e884aa18a9286c60cfe265f, user_id=5d99b7134fb04e678edea9de3066f737, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:17.609464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f04009-4bd4-43c0-aead-f961307c5c18 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:17.629996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 873/1762] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:03:17 2022] PUT /identity/v3/projects/0699a5e68e884aa18a9286c60cfe265f/users/5d99b7134fb04e678edea9de3066f737/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:17.641692 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51587b75-dbc1-4ada-b022-09b574afb518 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:17.641976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51587b75-dbc1-4ada-b022-09b574afb518 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:17.642255 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51587b75-dbc1-4ada-b022-09b574afb518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:17.702728 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-51587b75-dbc1-4ada-b022-09b574afb518 None None] MFA Rules not processed for user `5d99b7134fb04e678edea9de3066f737`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:17.704291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-51587b75-dbc1-4ada-b022-09b574afb518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:17.792250 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f04009-4bd4-43c0-aead-f961307c5c18 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:17.792861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 890/1763] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:17.807573 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:17.884078 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f04009-4bd4-43c0-aead-f961307c5c18 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:17.889474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708e8d6-3366-41b2-937f-42db5cf82960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:17.890112 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708e8d6-3366-41b2-937f-42db5cf82960 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:17.890397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708e8d6-3366-41b2-937f-42db5cf82960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:17.890674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708e8d6-3366-41b2-937f-42db5cf82960 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:17.891331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708e8d6-3366-41b2-937f-42db5cf82960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:17.893468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708e8d6-3366-41b2-937f-42db5cf82960 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:17.946874 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 874/1764] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:03:17 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:03:17.951875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51587b75-dbc1-4ada-b022-09b574afb518 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:17.967329 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51587b75-dbc1-4ada-b022-09b574afb518 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:18.037257 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:18.076753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4af246-ae7c-457e-b777-bc73b4ac754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:18.077647 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4af246-ae7c-457e-b777-bc73b4ac754b admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:18.079646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4af246-ae7c-457e-b777-bc73b4ac754b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:18.080209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4af246-ae7c-457e-b777-bc73b4ac754b admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:18.081428 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4af246-ae7c-457e-b777-bc73b4ac754b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:18.085758 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4af246-ae7c-457e-b777-bc73b4ac754b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:18.132076 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 891/1765] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:03:17 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:03:18.135751 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708e8d6-3366-41b2-937f-42db5cf82960 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:18.150864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708e8d6-3366-41b2-937f-42db5cf82960 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:18.166606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c6919-d5ec-4b02-9c16-c4199b89891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:18.167399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c6919-d5ec-4b02-9c16-c4199b89891f admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:18.167527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c6919-d5ec-4b02-9c16-c4199b89891f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:18.167990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c6919-d5ec-4b02-9c16-c4199b89891f admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:18.168783 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c6919-d5ec-4b02-9c16-c4199b89891f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:18.170415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c6919-d5ec-4b02-9c16-c4199b89891f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:18.202397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 875/1766] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:03:18.208405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4af246-ae7c-457e-b777-bc73b4ac754b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:18.248726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4af246-ae7c-457e-b777-bc73b4ac754b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:18.267098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf9a7e-75ae-42f2-a7e5-65c3b053344a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:18.267726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf9a7e-75ae-42f2-a7e5-65c3b053344a admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:18.268106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf9a7e-75ae-42f2-a7e5-65c3b053344a admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:18.268815 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf9a7e-75ae-42f2-a7e5-65c3b053344a admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:18.269025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf9a7e-75ae-42f2-a7e5-65c3b053344a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:18.271686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf9a7e-75ae-42f2-a7e5-65c3b053344a admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:18.304673 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 892/1767] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:03:18.308059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c6919-d5ec-4b02-9c16-c4199b89891f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:18.323288 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c6919-d5ec-4b02-9c16-c4199b89891f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:18.331413 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83946bad-ab13-4c62-8b10-bd1cf3dd7f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:18.332273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83946bad-ab13-4c62-8b10-bd1cf3dd7f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:18.332560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83946bad-ab13-4c62-8b10-bd1cf3dd7f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:18.332838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83946bad-ab13-4c62-8b10-bd1cf3dd7f49 admin admin] PATH_INFO: `/v3/projects/649f3d14d91d4892aed0e9ec6da31d76/users/3330ab51d0d740589d5f37ce5fc5cd14/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:18.373012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83946bad-ab13-4c62-8b10-bd1cf3dd7f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649f3d14d91d4892aed0e9ec6da31d76, user_id=3330ab51d0d740589d5f37ce5fc5cd14, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:18.375831 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83946bad-ab13-4c62-8b10-bd1cf3dd7f49 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:18.400834 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 876/1768] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:03:18 2022] PUT /identity/v3/projects/649f3d14d91d4892aed0e9ec6da31d76/users/3330ab51d0d740589d5f37ce5fc5cd14/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:18.411048 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97e98a-8d15-4fe3-82f4-f5132e9e6889 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:18.412104 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97e98a-8d15-4fe3-82f4-f5132e9e6889 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:18.413200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97e98a-8d15-4fe3-82f4-f5132e9e6889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:18.497842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3a97e98a-8d15-4fe3-82f4-f5132e9e6889 None None] MFA Rules not processed for user `3330ab51d0d740589d5f37ce5fc5cd14`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:18.499126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3a97e98a-8d15-4fe3-82f4-f5132e9e6889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:18.642673 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 893/1769] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:18.646352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83946bad-ab13-4c62-8b10-bd1cf3dd7f49 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:18.758406 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83946bad-ab13-4c62-8b10-bd1cf3dd7f49 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:18.766385 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950efc3-6d6d-48be-bf0d-584908221907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:18.767959 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950efc3-6d6d-48be-bf0d-584908221907 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:18.768392 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950efc3-6d6d-48be-bf0d-584908221907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:18.768809 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950efc3-6d6d-48be-bf0d-584908221907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:18.769653 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950efc3-6d6d-48be-bf0d-584908221907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:18.774077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950efc3-6d6d-48be-bf0d-584908221907 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:18.821558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 877/1770] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:03:18 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:03:18.825595 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97e98a-8d15-4fe3-82f4-f5132e9e6889 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:18.838799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97e98a-8d15-4fe3-82f4-f5132e9e6889 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:18.972566 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1a6b0-f610-4a91-b2d9-dced216a7839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:18.973474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1a6b0-f610-4a91-b2d9-dced216a7839 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:18.973859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1a6b0-f610-4a91-b2d9-dced216a7839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:18.974259 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1a6b0-f610-4a91-b2d9-dced216a7839 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:18.975120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1a6b0-f610-4a91-b2d9-dced216a7839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:18.978174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1a6b0-f610-4a91-b2d9-dced216a7839 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:19.030375 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 894/1771] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:03:18 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:03:19.031755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950efc3-6d6d-48be-bf0d-584908221907 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:19.048777 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950efc3-6d6d-48be-bf0d-584908221907 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:19.061893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3df610-4c97-443f-8ed8-ed9c413a1ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:19.062536 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3df610-4c97-443f-8ed8-ed9c413a1ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:19.062818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3df610-4c97-443f-8ed8-ed9c413a1ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:19.063096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3df610-4c97-443f-8ed8-ed9c413a1ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:19.063761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3df610-4c97-443f-8ed8-ed9c413a1ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:19.065585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3df610-4c97-443f-8ed8-ed9c413a1ef3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:19.084822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 878/1772] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:03:19.088579 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1a6b0-f610-4a91-b2d9-dced216a7839 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:19.105581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1a6b0-f610-4a91-b2d9-dced216a7839 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:19.119209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd74428-8468-4638-b661-812bbafea2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:19.120348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd74428-8468-4638-b661-812bbafea2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:19.120739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd74428-8468-4638-b661-812bbafea2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:19.122519 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd74428-8468-4638-b661-812bbafea2a0 admin admin] PATH_INFO: `/v3/projects/b9b0aee2cb8949ca8387c2d19bbe793c/users/ff295a11aa8b41f1be8bd7ff3dc8e434/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:19.166551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd74428-8468-4638-b661-812bbafea2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b0aee2cb8949ca8387c2d19bbe793c, user_id=ff295a11aa8b41f1be8bd7ff3dc8e434, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:19.169894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd74428-8468-4638-b661-812bbafea2a0 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:19.197453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 895/1773] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:03:19 2022] PUT /identity/v3/projects/b9b0aee2cb8949ca8387c2d19bbe793c/users/ff295a11aa8b41f1be8bd7ff3dc8e434/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:19.201534 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3df610-4c97-443f-8ed8-ed9c413a1ef3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:19.220957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3df610-4c97-443f-8ed8-ed9c413a1ef3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:19.313384 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:19.389917 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9796b-4f6e-4e1c-a8c4-78bf2aab6137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:19.392504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9796b-4f6e-4e1c-a8c4-78bf2aab6137 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:19.392797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9796b-4f6e-4e1c-a8c4-78bf2aab6137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:19.393075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9796b-4f6e-4e1c-a8c4-78bf2aab6137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:19.393754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9796b-4f6e-4e1c-a8c4-78bf2aab6137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:19.395449 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9796b-4f6e-4e1c-a8c4-78bf2aab6137 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:19.410708 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 879/1774] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:03:19.415599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd74428-8468-4638-b661-812bbafea2a0 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:19.435401 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd74428-8468-4638-b661-812bbafea2a0 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:19.456687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b455bff-f4f9-473e-bed0-245b22bca2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:19.457436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b455bff-f4f9-473e-bed0-245b22bca2d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:19.458355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b455bff-f4f9-473e-bed0-245b22bca2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:19.458641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b455bff-f4f9-473e-bed0-245b22bca2d4 admin admin] PATH_INFO: `/v3/projects/b9b0aee2cb8949ca8387c2d19bbe793c/users/ff295a11aa8b41f1be8bd7ff3dc8e434/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:19.463815 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b455bff-f4f9-473e-bed0-245b22bca2d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b0aee2cb8949ca8387c2d19bbe793c, user_id=ff295a11aa8b41f1be8bd7ff3dc8e434, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:19.473849 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b455bff-f4f9-473e-bed0-245b22bca2d4 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:19.486786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:19.529290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 896/1775] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:03:19 2022] PUT /identity/v3/projects/b9b0aee2cb8949ca8387c2d19bbe793c/users/ff295a11aa8b41f1be8bd7ff3dc8e434/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:19.531213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1999b9-f23d-4cb6-804a-bb8e3c4c27c9 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:19.532317 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1999b9-f23d-4cb6-804a-bb8e3c4c27c9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:19.532317 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1999b9-f23d-4cb6-804a-bb8e3c4c27c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:19.596185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4b1999b9-f23d-4cb6-804a-bb8e3c4c27c9 None None] MFA Rules not processed for user `ff295a11aa8b41f1be8bd7ff3dc8e434`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:19.597887 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4b1999b9-f23d-4cb6-804a-bb8e3c4c27c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:19.713726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 880/1776] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:19.741769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b455bff-f4f9-473e-bed0-245b22bca2d4 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:19.744228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9b455bff-f4f9-473e-bed0-245b22bca2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:19.895588 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b455bff-f4f9-473e-bed0-245b22bca2d4 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:19.907145 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d453d0e-a2c6-4f44-817d-9a987bb6b0c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:19.908124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d453d0e-a2c6-4f44-817d-9a987bb6b0c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:19.908473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d453d0e-a2c6-4f44-817d-9a987bb6b0c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:19.908852 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d453d0e-a2c6-4f44-817d-9a987bb6b0c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:20.003647 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d453d0e-a2c6-4f44-817d-9a987bb6b0c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:20.005351 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d453d0e-a2c6-4f44-817d-9a987bb6b0c7 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:20.019439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 897/1777] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:03:22.870054 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4465a5-f975-4a93-8119-314eb0539fe4 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:22.871066 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4465a5-f975-4a93-8119-314eb0539fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:22.871066 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4465a5-f975-4a93-8119-314eb0539fe4 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:22.879993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 881/1778] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:03:22 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:03:22.916859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc5590-a69b-4e06-a267-1e1ae16d4f79 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:22.917935 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc5590-a69b-4e06-a267-1e1ae16d4f79 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:22.918319 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc5590-a69b-4e06-a267-1e1ae16d4f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:22.972143 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c6dc5590-a69b-4e06-a267-1e1ae16d4f79 None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:22.977342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c6dc5590-a69b-4e06-a267-1e1ae16d4f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:23.245099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 898/1779] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:03:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:24.215155 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4465a5-f975-4a93-8119-314eb0539fe4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:24.217755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ab4465a5-f975-4a93-8119-314eb0539fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:24.281494 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4465a5-f975-4a93-8119-314eb0539fe4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:24.309584 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22797346-fc36-4f23-9c52-74bdbc8966fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:24.310329 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22797346-fc36-4f23-9c52-74bdbc8966fd service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:24.310615 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22797346-fc36-4f23-9c52-74bdbc8966fd service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:24.310886 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22797346-fc36-4f23-9c52-74bdbc8966fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:24.331037 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22797346-fc36-4f23-9c52-74bdbc8966fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:24.338950 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22797346-fc36-4f23-9c52-74bdbc8966fd service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:24.392470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 882/1780] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:03:33.222278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:INSERT=1,keystone:SELECT=81 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:34.377179 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=52 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:35.581992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc5590-a69b-4e06-a267-1e1ae16d4f79 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:35.583543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c6dc5590-a69b-4e06-a267-1e1ae16d4f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:35.711015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc5590-a69b-4e06-a267-1e1ae16d4f79 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:35.717205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605e563-2595-4699-a723-ba8f9325163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:35.717875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605e563-2595-4699-a723-ba8f9325163b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:35.718748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605e563-2595-4699-a723-ba8f9325163b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:35.719032 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605e563-2595-4699-a723-ba8f9325163b admin admin] PATH_INFO: `/v3/users/ffd5a656772345d38b3cebc7054c291c` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:35.721324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605e563-2595-4699-a723-ba8f9325163b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd5a656772345d38b3cebc7054c291c)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:35.724007 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605e563-2595-4699-a723-ba8f9325163b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:35.811114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8605e563-2595-4699-a723-ba8f9325163b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd5a656772345d38b3cebc7054c291c'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:35.826861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8605e563-2595-4699-a723-ba8f9325163b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd5a656772345d38b3cebc7054c291c'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:35.865272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8605e563-2595-4699-a723-ba8f9325163b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd5a656772345d38b3cebc7054c291c'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:35.866692 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8605e563-2595-4699-a723-ba8f9325163b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd5a656772345d38b3cebc7054c291c'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:35.867656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8605e563-2595-4699-a723-ba8f9325163b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd5a656772345d38b3cebc7054c291c'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:35.891848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 899/1781] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:03:35 2022] DELETE /identity/v3/users/ffd5a656772345d38b3cebc7054c291c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:35.893424 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6ac79-c443-4107-a99b-3ddfa6829686 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:35.894513 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6ac79-c443-4107-a99b-3ddfa6829686 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:35.895082 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6ac79-c443-4107-a99b-3ddfa6829686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:35.919789 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d5f6ac79-c443-4107-a99b-3ddfa6829686 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:35.923081 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d5f6ac79-c443-4107-a99b-3ddfa6829686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:36.062795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 883/1782] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:03:36.077760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605e563-2595-4699-a723-ba8f9325163b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:36.079246 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8605e563-2595-4699-a723-ba8f9325163b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:36.160774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605e563-2595-4699-a723-ba8f9325163b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:36.167636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992a047-5d70-4c52-8b6a-9d745d9bb0ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:36.168298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992a047-5d70-4c52-8b6a-9d745d9bb0ff service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:36.168581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992a047-5d70-4c52-8b6a-9d745d9bb0ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:36.168855 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992a047-5d70-4c52-8b6a-9d745d9bb0ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:36.181331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992a047-5d70-4c52-8b6a-9d745d9bb0ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:36.182859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992a047-5d70-4c52-8b6a-9d745d9bb0ff service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:36.201924 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 900/1783] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:03:36.674915 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b472487-4316-487e-ae8e-dcae2bc0068f None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:36.675297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b472487-4316-487e-ae8e-dcae2bc0068f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:36.675653 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b472487-4316-487e-ae8e-dcae2bc0068f None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:36.677331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 884/1784] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:03:36.692913 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e62169-bb7c-4a26-a70a-90791785f38e None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:36.693449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e62169-bb7c-4a26-a70a-90791785f38e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:36.697396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e62169-bb7c-4a26-a70a-90791785f38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:36.757341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-87e62169-bb7c-4a26-a70a-90791785f38e None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:36.758849 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-87e62169-bb7c-4a26-a70a-90791785f38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:36.801937 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:36.998093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 901/1785] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:03:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:37.029232 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b472487-4316-487e-ae8e-dcae2bc0068f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:37.031409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8b472487-4316-487e-ae8e-dcae2bc0068f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:37.083083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e62169-bb7c-4a26-a70a-90791785f38e None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:37.086116 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-87e62169-bb7c-4a26-a70a-90791785f38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:37.086802 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b472487-4316-487e-ae8e-dcae2bc0068f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:37.106543 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea87a9-6e57-425f-9303-b64c200c46a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:37.108965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea87a9-6e57-425f-9303-b64c200c46a7 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:37.109705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea87a9-6e57-425f-9303-b64c200c46a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:37.112012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea87a9-6e57-425f-9303-b64c200c46a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:37.122139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e62169-bb7c-4a26-a70a-90791785f38e None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:37.134812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17e0d7-1f96-48fc-bf64-7f788624a0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:37.135477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17e0d7-1f96-48fc-bf64-7f788624a0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:37.135758 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17e0d7-1f96-48fc-bf64-7f788624a0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:37.136069 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17e0d7-1f96-48fc-bf64-7f788624a0b2 admin admin] PATH_INFO: `/v3/projects/fea3cee8bc1e4aaeb530c99ee07a2365` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:37.138122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17e0d7-1f96-48fc-bf64-7f788624a0b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea3cee8bc1e4aaeb530c99ee07a2365)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:37.141072 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17e0d7-1f96-48fc-bf64-7f788624a0b2 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:37.143649 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea87a9-6e57-425f-9303-b64c200c46a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:37.147567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea87a9-6e57-425f-9303-b64c200c46a7 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:37.189865 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 885/1786] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:03:37.305950 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-be17e0d7-1f96-48fc-bf64-7f788624a0b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea3cee8bc1e4aaeb530c99ee07a2365', 'request_id': 'req-be17e0d7-1f96-48fc-bf64-7f788624a0b2'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:37.315509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-be17e0d7-1f96-48fc-bf64-7f788624a0b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea3cee8bc1e4aaeb530c99ee07a2365', 'request_id': 'req-be17e0d7-1f96-48fc-bf64-7f788624a0b2'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:37.329471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-be17e0d7-1f96-48fc-bf64-7f788624a0b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea3cee8bc1e4aaeb530c99ee07a2365', 'request_id': 'req-be17e0d7-1f96-48fc-bf64-7f788624a0b2'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:37.343413 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-be17e0d7-1f96-48fc-bf64-7f788624a0b2 admin admin] The token cache is being invalidate because project fea3cee8bc1e4aaeb530c99ee07a2365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:03:37.343711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-be17e0d7-1f96-48fc-bf64-7f788624a0b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:37.344434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-be17e0d7-1f96-48fc-bf64-7f788624a0b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:37.346702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 902/1787] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:03:37 2022] DELETE /identity/v3/projects/fea3cee8bc1e4aaeb530c99ee07a2365 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:03:37.350853 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea87a9-6e57-425f-9303-b64c200c46a7 service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:37.364968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea87a9-6e57-425f-9303-b64c200c46a7 service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:37.498463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485daea-e7fe-4a1f-b5c8-27b0080e8053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:37.499160 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485daea-e7fe-4a1f-b5c8-27b0080e8053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:37.499439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485daea-e7fe-4a1f-b5c8-27b0080e8053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:37.499750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485daea-e7fe-4a1f-b5c8-27b0080e8053 admin admin] PATH_INFO: `/v3/users/2044432bea754a47abc6396eb9ed1cf4` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:37.507093 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485daea-e7fe-4a1f-b5c8-27b0080e8053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2044432bea754a47abc6396eb9ed1cf4)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:37.510307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485daea-e7fe-4a1f-b5c8-27b0080e8053 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:37.630169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3485daea-e7fe-4a1f-b5c8-27b0080e8053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2044432bea754a47abc6396eb9ed1cf4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:37.644344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3485daea-e7fe-4a1f-b5c8-27b0080e8053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2044432bea754a47abc6396eb9ed1cf4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:37.675596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3485daea-e7fe-4a1f-b5c8-27b0080e8053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2044432bea754a47abc6396eb9ed1cf4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:37.692068 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3485daea-e7fe-4a1f-b5c8-27b0080e8053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2044432bea754a47abc6396eb9ed1cf4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:37.696546 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3485daea-e7fe-4a1f-b5c8-27b0080e8053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2044432bea754a47abc6396eb9ed1cf4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:37.725701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 886/1788] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:03:37 2022] DELETE /identity/v3/users/2044432bea754a47abc6396eb9ed1cf4 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:38.353610 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17e0d7-1f96-48fc-bf64-7f788624a0b2 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:38.355128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-be17e0d7-1f96-48fc-bf64-7f788624a0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:38.389892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17e0d7-1f96-48fc-bf64-7f788624a0b2 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:38.515615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38daeb1a-755b-4a6e-a2be-61dec572725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:38.516528 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daeb1a-755b-4a6e-a2be-61dec572725d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:38.516959 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daeb1a-755b-4a6e-a2be-61dec572725d admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:38.517545 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38daeb1a-755b-4a6e-a2be-61dec572725d admin admin] PATH_INFO: `/v3/projects/3efe4c4c87fc4fcea11d94662e0fc766` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:38.531576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38daeb1a-755b-4a6e-a2be-61dec572725d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3efe4c4c87fc4fcea11d94662e0fc766)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:38.543480 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38daeb1a-755b-4a6e-a2be-61dec572725d admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:38.640259 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:38.660233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-38daeb1a-755b-4a6e-a2be-61dec572725d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3efe4c4c87fc4fcea11d94662e0fc766', 'request_id': 'req-38daeb1a-755b-4a6e-a2be-61dec572725d'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:38.669165 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-38daeb1a-755b-4a6e-a2be-61dec572725d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3efe4c4c87fc4fcea11d94662e0fc766', 'request_id': 'req-38daeb1a-755b-4a6e-a2be-61dec572725d'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:38.690806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-38daeb1a-755b-4a6e-a2be-61dec572725d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3efe4c4c87fc4fcea11d94662e0fc766', 'request_id': 'req-38daeb1a-755b-4a6e-a2be-61dec572725d'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:38.726921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-38daeb1a-755b-4a6e-a2be-61dec572725d admin admin] The token cache is being invalidate because project 3efe4c4c87fc4fcea11d94662e0fc766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:03:38.726921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-38daeb1a-755b-4a6e-a2be-61dec572725d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:38.726921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-38daeb1a-755b-4a6e-a2be-61dec572725d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:38.727437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf52d3-2d3a-4805-acc4-0f09b258cd81 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:38.727437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf52d3-2d3a-4805-acc4-0f09b258cd81 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:38.727437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf52d3-2d3a-4805-acc4-0f09b258cd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:38.738067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 903/1789] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:03:38 2022] DELETE /identity/v3/projects/3efe4c4c87fc4fcea11d94662e0fc766 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:38.771181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:38.788383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-cfcf52d3-2d3a-4805-acc4-0f09b258cd81 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:38.789630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cfcf52d3-2d3a-4805-acc4-0f09b258cd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:38.989329 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 887/1790] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:03:38.999455 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aeb96-230e-4469-a18c-6a6fee0689bf None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:38.999695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aeb96-230e-4469-a18c-6a6fee0689bf None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:38.999861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aeb96-230e-4469-a18c-6a6fee0689bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:39.048210 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-364aeb96-230e-4469-a18c-6a6fee0689bf None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:39.050698 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-364aeb96-230e-4469-a18c-6a6fee0689bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:39.075743 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 904/1791] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:39.079845 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf52d3-2d3a-4805-acc4-0f09b258cd81 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:39.097530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf52d3-2d3a-4805-acc4-0f09b258cd81 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:39.110080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c21d74-085f-4633-9ff9-1ff0a8ca3979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:39.110974 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c21d74-085f-4633-9ff9-1ff0a8ca3979 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:39.111399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c21d74-085f-4633-9ff9-1ff0a8ca3979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:39.111826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c21d74-085f-4633-9ff9-1ff0a8ca3979 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:39.112655 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c21d74-085f-4633-9ff9-1ff0a8ca3979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:03:39.113096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c21d74-085f-4633-9ff9-1ff0a8ca3979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:39.115455 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c21d74-085f-4633-9ff9-1ff0a8ca3979 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:39.149801 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 888/1792] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:03:39.151741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364aeb96-230e-4469-a18c-6a6fee0689bf None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:39.196574 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364aeb96-230e-4469-a18c-6a6fee0689bf None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:39.202783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecadb0-78de-46d8-9c44-31f5cab7f65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:39.203716 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecadb0-78de-46d8-9c44-31f5cab7f65a admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:39.214148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecadb0-78de-46d8-9c44-31f5cab7f65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:39.214714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecadb0-78de-46d8-9c44-31f5cab7f65a admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:39.215634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecadb0-78de-46d8-9c44-31f5cab7f65a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:39.217940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecadb0-78de-46d8-9c44-31f5cab7f65a admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:39.276788 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 905/1793] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:03:39 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:03:39.280972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c21d74-085f-4633-9ff9-1ff0a8ca3979 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:39.295085 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c21d74-085f-4633-9ff9-1ff0a8ca3979 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:39.386061 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5f47b-13cd-4be2-b205-8a39e6790d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:39.387158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5f47b-13cd-4be2-b205-8a39e6790d94 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:39.387800 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5f47b-13cd-4be2-b205-8a39e6790d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:39.388462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5f47b-13cd-4be2-b205-8a39e6790d94 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:39.389382 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5f47b-13cd-4be2-b205-8a39e6790d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:39.391797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5f47b-13cd-4be2-b205-8a39e6790d94 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:39.423829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 889/1794] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:03:39 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:03:39.427862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecadb0-78de-46d8-9c44-31f5cab7f65a admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:39.442683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecadb0-78de-46d8-9c44-31f5cab7f65a admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:39.448818 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b65743-8f78-43dc-8c2d-c044f603c14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:39.449811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b65743-8f78-43dc-8c2d-c044f603c14a admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:39.450254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b65743-8f78-43dc-8c2d-c044f603c14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:39.450667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b65743-8f78-43dc-8c2d-c044f603c14a admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:39.451799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b65743-8f78-43dc-8c2d-c044f603c14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:39.453726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b65743-8f78-43dc-8c2d-c044f603c14a admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:39.469652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 906/1795] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:03:39.473191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5f47b-13cd-4be2-b205-8a39e6790d94 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:39.488448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5f47b-13cd-4be2-b205-8a39e6790d94 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:39.494891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85f14c-a80f-4fe1-941a-266a61046fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:39.496447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85f14c-a80f-4fe1-941a-266a61046fca admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:39.497058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85f14c-a80f-4fe1-941a-266a61046fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:39.497659 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85f14c-a80f-4fe1-941a-266a61046fca admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:39.500005 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85f14c-a80f-4fe1-941a-266a61046fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:39.502742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85f14c-a80f-4fe1-941a-266a61046fca admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:39.518888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 890/1796] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:03:39.524472 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b65743-8f78-43dc-8c2d-c044f603c14a admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:39.543546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b65743-8f78-43dc-8c2d-c044f603c14a admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:39.556146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7a6ca-d7f1-46c6-b113-45e5fef54d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:39.556775 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7a6ca-d7f1-46c6-b113-45e5fef54d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:39.557061 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7a6ca-d7f1-46c6-b113-45e5fef54d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:39.557337 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7a6ca-d7f1-46c6-b113-45e5fef54d4e admin admin] PATH_INFO: `/v3/projects/e065c50d60c9490d80080d19ebd28d4a/users/0f127c9e562b418592d07e238f7ce717/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:39.577156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7a6ca-d7f1-46c6-b113-45e5fef54d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e065c50d60c9490d80080d19ebd28d4a, user_id=0f127c9e562b418592d07e238f7ce717, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:39.580768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7a6ca-d7f1-46c6-b113-45e5fef54d4e admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:39.614447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aad2f2-c742-4662-91ee-130f7f2984a5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:39.614648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 907/1797] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:03:39 2022] PUT /identity/v3/projects/e065c50d60c9490d80080d19ebd28d4a/users/0f127c9e562b418592d07e238f7ce717/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:39.616205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aad2f2-c742-4662-91ee-130f7f2984a5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:39.616708 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aad2f2-c742-4662-91ee-130f7f2984a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:39.706610 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-32aad2f2-c742-4662-91ee-130f7f2984a5 None None] MFA Rules not processed for user `0f127c9e562b418592d07e238f7ce717`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:39.707875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-32aad2f2-c742-4662-91ee-130f7f2984a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:39.829838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 891/1798] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:39.887713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7a6ca-d7f1-46c6-b113-45e5fef54d4e admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:39.894026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-68e7a6ca-d7f1-46c6-b113-45e5fef54d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:40.061153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7a6ca-d7f1-46c6-b113-45e5fef54d4e admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:40.066317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ae6c5-cad1-47b4-8ac0-5fe54ea9216d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:40.067150 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ae6c5-cad1-47b4-8ac0-5fe54ea9216d service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:40.067432 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ae6c5-cad1-47b4-8ac0-5fe54ea9216d service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:40.067840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ae6c5-cad1-47b4-8ac0-5fe54ea9216d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:40.079454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ae6c5-cad1-47b4-8ac0-5fe54ea9216d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:40.081212 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ae6c5-cad1-47b4-8ac0-5fe54ea9216d service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:40.095046 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 908/1799] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:03:40.386303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aad2f2-c742-4662-91ee-130f7f2984a5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:40.388144 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-32aad2f2-c742-4662-91ee-130f7f2984a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:40.395511 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:40.416802 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aad2f2-c742-4662-91ee-130f7f2984a5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:40.420570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb30f8a-566c-4af7-9c1c-3c4553366ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:40.421395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb30f8a-566c-4af7-9c1c-3c4553366ded service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:40.421831 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb30f8a-566c-4af7-9c1c-3c4553366ded service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:40.422110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb30f8a-566c-4af7-9c1c-3c4553366ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:40.423831 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-acb30f8a-566c-4af7-9c1c-3c4553366ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:40.549238 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb30f8a-566c-4af7-9c1c-3c4553366ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:40.551083 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb30f8a-566c-4af7-9c1c-3c4553366ded service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:40.566045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 892/1800] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:03:50.089273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=63,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:50.560734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=29 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:52.625575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ae6c5-cad1-47b4-8ac0-5fe54ea9216d service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:52.635880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ae6c5-cad1-47b4-8ac0-5fe54ea9216d service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:52.640430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3adc05-75c0-4309-b876-d2b7400f6137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:52.641304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3adc05-75c0-4309-b876-d2b7400f6137 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:52.641737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3adc05-75c0-4309-b876-d2b7400f6137 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:52.642209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3adc05-75c0-4309-b876-d2b7400f6137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:52.645236 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-0d3adc05-75c0-4309-b876-d2b7400f6137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:52.723608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3adc05-75c0-4309-b876-d2b7400f6137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:52.725727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3adc05-75c0-4309-b876-d2b7400f6137 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:52.738973 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 909/1801] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:03:53.485460 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb30f8a-566c-4af7-9c1c-3c4553366ded service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:53.487201 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-acb30f8a-566c-4af7-9c1c-3c4553366ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:53.653566 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb30f8a-566c-4af7-9c1c-3c4553366ded service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:53.659752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f8567-1fb5-4b7f-a5c0-be855b46efd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:53.660802 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f8567-1fb5-4b7f-a5c0-be855b46efd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:53.661089 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f8567-1fb5-4b7f-a5c0-be855b46efd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:53.661389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f8567-1fb5-4b7f-a5c0-be855b46efd3 admin admin] PATH_INFO: `/v3/users/33e2c3fcec1a43ffa6f582a8ca0d36bf` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:53.663779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f8567-1fb5-4b7f-a5c0-be855b46efd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e2c3fcec1a43ffa6f582a8ca0d36bf)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:53.665802 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f8567-1fb5-4b7f-a5c0-be855b46efd3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:53.746248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f31f8567-1fb5-4b7f-a5c0-be855b46efd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e2c3fcec1a43ffa6f582a8ca0d36bf'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:53.757203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f31f8567-1fb5-4b7f-a5c0-be855b46efd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e2c3fcec1a43ffa6f582a8ca0d36bf'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:53.775397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f31f8567-1fb5-4b7f-a5c0-be855b46efd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e2c3fcec1a43ffa6f582a8ca0d36bf'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:53.792717 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f31f8567-1fb5-4b7f-a5c0-be855b46efd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e2c3fcec1a43ffa6f582a8ca0d36bf'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:53.794452 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f31f8567-1fb5-4b7f-a5c0-be855b46efd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e2c3fcec1a43ffa6f582a8ca0d36bf'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:53.802225 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 893/1802] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:03:53 2022] DELETE /identity/v3/users/33e2c3fcec1a43ffa6f582a8ca0d36bf => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:53.807129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09b94a-14d4-4c4a-9890-c042557df088 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:53.807635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09b94a-14d4-4c4a-9890-c042557df088 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:53.807743 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09b94a-14d4-4c4a-9890-c042557df088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:53.832430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5a09b94a-14d4-4c4a-9890-c042557df088 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:53.834956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5a09b94a-14d4-4c4a-9890-c042557df088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:53.965635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 910/1803] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:53.979695 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f8567-1fb5-4b7f-a5c0-be855b46efd3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:53.981726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f31f8567-1fb5-4b7f-a5c0-be855b46efd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:54.065469 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f8567-1fb5-4b7f-a5c0-be855b46efd3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:54.070941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c191cd-fb20-4bd9-ac46-f5273b10c47a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:54.071577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c191cd-fb20-4bd9-ac46-f5273b10c47a service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:54.071838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c191cd-fb20-4bd9-ac46-f5273b10c47a service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:54.072146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c191cd-fb20-4bd9-ac46-f5273b10c47a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:54.086967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c191cd-fb20-4bd9-ac46-f5273b10c47a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:54.089475 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c191cd-fb20-4bd9-ac46-f5273b10c47a service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:54.101402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 894/1804] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:03:54.477064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09b94a-14d4-4c4a-9890-c042557df088 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:54.478837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5a09b94a-14d4-4c4a-9890-c042557df088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:54.495274 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09b94a-14d4-4c4a-9890-c042557df088 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:54.502533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b554e-0fdb-4440-a631-54f1fe52d1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:54.503610 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b554e-0fdb-4440-a631-54f1fe52d1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:54.504172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b554e-0fdb-4440-a631-54f1fe52d1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:54.504926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b554e-0fdb-4440-a631-54f1fe52d1c9 admin admin] PATH_INFO: `/v3/projects/375a8a1ab8b6476e81b87479d2db0c4b` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:54.511355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b554e-0fdb-4440-a631-54f1fe52d1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=375a8a1ab8b6476e81b87479d2db0c4b)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:54.514362 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b554e-0fdb-4440-a631-54f1fe52d1c9 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:54.586294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d29b554e-0fdb-4440-a631-54f1fe52d1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '375a8a1ab8b6476e81b87479d2db0c4b', 'request_id': 'req-d29b554e-0fdb-4440-a631-54f1fe52d1c9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:54.605806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d29b554e-0fdb-4440-a631-54f1fe52d1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '375a8a1ab8b6476e81b87479d2db0c4b', 'request_id': 'req-d29b554e-0fdb-4440-a631-54f1fe52d1c9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:54.622507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d29b554e-0fdb-4440-a631-54f1fe52d1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '375a8a1ab8b6476e81b87479d2db0c4b', 'request_id': 'req-d29b554e-0fdb-4440-a631-54f1fe52d1c9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:54.650784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d29b554e-0fdb-4440-a631-54f1fe52d1c9 admin admin] The token cache is being invalidate because project 375a8a1ab8b6476e81b87479d2db0c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:03:54.651084 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d29b554e-0fdb-4440-a631-54f1fe52d1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:54.651844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d29b554e-0fdb-4440-a631-54f1fe52d1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:54.656887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 911/1805] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:03:54 2022] DELETE /identity/v3/projects/375a8a1ab8b6476e81b87479d2db0c4b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:54.658558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21d13b-7881-4a0d-8ba0-b8ee949cde99 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:54.659047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21d13b-7881-4a0d-8ba0-b8ee949cde99 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:54.659124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21d13b-7881-4a0d-8ba0-b8ee949cde99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:54.703873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3a21d13b-7881-4a0d-8ba0-b8ee949cde99 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:54.708125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3a21d13b-7881-4a0d-8ba0-b8ee949cde99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:54.753031 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:54.870351 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0659a-cbb1-4d55-9603-80572bc020a0 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:54.871184 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0659a-cbb1-4d55-9603-80572bc020a0 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:54.872500 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0659a-cbb1-4d55-9603-80572bc020a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:54.876686 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 895/1806] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:03:54.896226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5bf0659a-cbb1-4d55-9603-80572bc020a0 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:54.897954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5bf0659a-cbb1-4d55-9603-80572bc020a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:54.909351 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 912/1807] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:54.914047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21d13b-7881-4a0d-8ba0-b8ee949cde99 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:54.929619 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21d13b-7881-4a0d-8ba0-b8ee949cde99 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:54.944963 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a1a4c-10af-4edd-9cc9-5bd1450abf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:54.946027 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a1a4c-10af-4edd-9cc9-5bd1450abf65 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:54.946978 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a1a4c-10af-4edd-9cc9-5bd1450abf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:54.947324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a1a4c-10af-4edd-9cc9-5bd1450abf65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:54.948150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a1a4c-10af-4edd-9cc9-5bd1450abf65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:03:54.949725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a1a4c-10af-4edd-9cc9-5bd1450abf65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:54.952249 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a1a4c-10af-4edd-9cc9-5bd1450abf65 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:54.996028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 896/1808] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:03:54.998744 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0659a-cbb1-4d55-9603-80572bc020a0 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:55.051099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0659a-cbb1-4d55-9603-80572bc020a0 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:55.065755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c280a3-998b-448f-9d8d-66cd34c8abd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:55.068626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c280a3-998b-448f-9d8d-66cd34c8abd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:55.069339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c280a3-998b-448f-9d8d-66cd34c8abd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:55.069858 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c280a3-998b-448f-9d8d-66cd34c8abd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:55.071490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c280a3-998b-448f-9d8d-66cd34c8abd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:55.075609 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c280a3-998b-448f-9d8d-66cd34c8abd5 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:55.108347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:55.138375 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a1a4c-10af-4edd-9cc9-5bd1450abf65 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:55.140391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 913/1809] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:03:54 2022] POST /identity/v3/projects => generated 359 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:03:55.154386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a1a4c-10af-4edd-9cc9-5bd1450abf65 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:55.262124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cd88c-967f-4733-b639-4d522cd7f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:55.263147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd88c-967f-4733-b639-4d522cd7f38d admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:55.263618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd88c-967f-4733-b639-4d522cd7f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:55.264116 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd88c-967f-4733-b639-4d522cd7f38d admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:55.265290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cd88c-967f-4733-b639-4d522cd7f38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:55.269669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cd88c-967f-4733-b639-4d522cd7f38d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:55.306390 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 897/1810] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:03:55 2022] POST /identity/v3/users => generated 280 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:03:55.312682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c280a3-998b-448f-9d8d-66cd34c8abd5 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:55.331370 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c280a3-998b-448f-9d8d-66cd34c8abd5 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:55.338814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322b11d-923c-44f8-a6d6-5804e4011323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:55.340009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322b11d-923c-44f8-a6d6-5804e4011323 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:55.341973 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322b11d-923c-44f8-a6d6-5804e4011323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:55.342697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322b11d-923c-44f8-a6d6-5804e4011323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:55.344373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322b11d-923c-44f8-a6d6-5804e4011323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:55.346541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322b11d-923c-44f8-a6d6-5804e4011323 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:55.373698 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 914/1811] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:03:55.373994 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cd88c-967f-4733-b639-4d522cd7f38d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:55.389621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cd88c-967f-4733-b639-4d522cd7f38d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:55.400332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b3a88-2205-48d5-a2de-85204e0795ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:55.402371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b3a88-2205-48d5-a2de-85204e0795ef admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:55.402904 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b3a88-2205-48d5-a2de-85204e0795ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:55.403388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b3a88-2205-48d5-a2de-85204e0795ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:55.406015 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b3a88-2205-48d5-a2de-85204e0795ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:55.408861 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b3a88-2205-48d5-a2de-85204e0795ef admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:55.433498 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322b11d-923c-44f8-a6d6-5804e4011323 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:55.434157 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 898/1812] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:03:55.450772 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322b11d-923c-44f8-a6d6-5804e4011323 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:55.456273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381995aa-f84c-4252-a535-830c7b657fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:55.457778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381995aa-f84c-4252-a535-830c7b657fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:55.458738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381995aa-f84c-4252-a535-830c7b657fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:55.459339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381995aa-f84c-4252-a535-830c7b657fc5 admin admin] PATH_INFO: `/v3/projects/2a03b7ca6be2414085e89c22732bffca/users/7bc9686351144413ba97ad8c03c88e9c/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:55.485447 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381995aa-f84c-4252-a535-830c7b657fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a03b7ca6be2414085e89c22732bffca, user_id=7bc9686351144413ba97ad8c03c88e9c, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:55.490273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381995aa-f84c-4252-a535-830c7b657fc5 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:55.544451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 915/1813] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:03:55 2022] PUT /identity/v3/projects/2a03b7ca6be2414085e89c22732bffca/users/7bc9686351144413ba97ad8c03c88e9c/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:55.548108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73847918-564f-4457-bb05-ab1a5dfcf819 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:55.548558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73847918-564f-4457-bb05-ab1a5dfcf819 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:55.548879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73847918-564f-4457-bb05-ab1a5dfcf819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:55.604556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-73847918-564f-4457-bb05-ab1a5dfcf819 None None] MFA Rules not processed for user `7bc9686351144413ba97ad8c03c88e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:55.609180 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-73847918-564f-4457-bb05-ab1a5dfcf819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:55.776439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 899/1814] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:03:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:55.843572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381995aa-f84c-4252-a535-830c7b657fc5 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:55.850075 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-381995aa-f84c-4252-a535-830c7b657fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:56.005948 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381995aa-f84c-4252-a535-830c7b657fc5 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:56.018170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b4657-06d9-4196-b9d3-7b36c16031b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:56.020340 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b4657-06d9-4196-b9d3-7b36c16031b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:56.022741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b4657-06d9-4196-b9d3-7b36c16031b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:56.024453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b4657-06d9-4196-b9d3-7b36c16031b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:56.056170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b4657-06d9-4196-b9d3-7b36c16031b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:56.058988 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b4657-06d9-4196-b9d3-7b36c16031b1 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:56.090367 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 916/1815] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:04:05.762928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:06.070352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:10.512076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73847918-564f-4457-bb05-ab1a5dfcf819 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:10.513766 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-73847918-564f-4457-bb05-ab1a5dfcf819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:10.608088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73847918-564f-4457-bb05-ab1a5dfcf819 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:10.619808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1bdc6-f237-4ede-8bd0-79eaf65dfc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:10.620826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1bdc6-f237-4ede-8bd0-79eaf65dfc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:10.621105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1bdc6-f237-4ede-8bd0-79eaf65dfc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:10.621537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1bdc6-f237-4ede-8bd0-79eaf65dfc55 admin admin] PATH_INFO: `/v3/users/5d99b7134fb04e678edea9de3066f737` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:10.623542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1bdc6-f237-4ede-8bd0-79eaf65dfc55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d99b7134fb04e678edea9de3066f737)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:10.625214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1bdc6-f237-4ede-8bd0-79eaf65dfc55 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:10.688369 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-afe1bdc6-f237-4ede-8bd0-79eaf65dfc55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d99b7134fb04e678edea9de3066f737'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:10.703523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-afe1bdc6-f237-4ede-8bd0-79eaf65dfc55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d99b7134fb04e678edea9de3066f737'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:10.718228 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-afe1bdc6-f237-4ede-8bd0-79eaf65dfc55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d99b7134fb04e678edea9de3066f737'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:10.731496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-afe1bdc6-f237-4ede-8bd0-79eaf65dfc55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d99b7134fb04e678edea9de3066f737'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:10.732927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-afe1bdc6-f237-4ede-8bd0-79eaf65dfc55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d99b7134fb04e678edea9de3066f737'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:10.739774 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 900/1816] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:04:10 2022] DELETE /identity/v3/users/5d99b7134fb04e678edea9de3066f737 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:10.744201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af395b6d-8732-4179-818d-c8af46d93734 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:10.744673 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af395b6d-8732-4179-818d-c8af46d93734 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:10.744999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af395b6d-8732-4179-818d-c8af46d93734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:10.765692 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-af395b6d-8732-4179-818d-c8af46d93734 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:10.767597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-af395b6d-8732-4179-818d-c8af46d93734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:10.837858 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 917/1817] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:10.844723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1bdc6-f237-4ede-8bd0-79eaf65dfc55 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:10.846200 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-afe1bdc6-f237-4ede-8bd0-79eaf65dfc55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:10.917400 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1bdc6-f237-4ede-8bd0-79eaf65dfc55 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:10.921129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c48b6f-e2ce-4bf5-b6f4-f93a46ab94b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:10.921750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c48b6f-e2ce-4bf5-b6f4-f93a46ab94b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:10.922202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c48b6f-e2ce-4bf5-b6f4-f93a46ab94b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:10.922479 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c48b6f-e2ce-4bf5-b6f4-f93a46ab94b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:10.932600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c48b6f-e2ce-4bf5-b6f4-f93a46ab94b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:10.934210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c48b6f-e2ce-4bf5-b6f4-f93a46ab94b0 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:10.948241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 901/1818] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:04:11.005509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af395b6d-8732-4179-818d-c8af46d93734 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:11.007006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-af395b6d-8732-4179-818d-c8af46d93734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:11.021064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af395b6d-8732-4179-818d-c8af46d93734 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:11.026215 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cf64d-42c3-419a-a95f-f6c5faccf89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:11.027083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cf64d-42c3-419a-a95f-f6c5faccf89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:11.027447 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cf64d-42c3-419a-a95f-f6c5faccf89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:11.028979 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cf64d-42c3-419a-a95f-f6c5faccf89a admin admin] PATH_INFO: `/v3/users/9917479b51b54bc9861e4db4aa0157aa` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:11.030783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cf64d-42c3-419a-a95f-f6c5faccf89a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9917479b51b54bc9861e4db4aa0157aa)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:11.034052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cf64d-42c3-419a-a95f-f6c5faccf89a admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:11.120595 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c91cf64d-42c3-419a-a95f-f6c5faccf89a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9917479b51b54bc9861e4db4aa0157aa'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:11.132879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c91cf64d-42c3-419a-a95f-f6c5faccf89a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9917479b51b54bc9861e4db4aa0157aa'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:11.151169 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c91cf64d-42c3-419a-a95f-f6c5faccf89a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9917479b51b54bc9861e4db4aa0157aa'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:11.152054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c91cf64d-42c3-419a-a95f-f6c5faccf89a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9917479b51b54bc9861e4db4aa0157aa'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:11.152733 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c91cf64d-42c3-419a-a95f-f6c5faccf89a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9917479b51b54bc9861e4db4aa0157aa'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:11.181118 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 918/1819] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:04:11 2022] DELETE /identity/v3/users/9917479b51b54bc9861e4db4aa0157aa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:11.187194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a82acd-5adb-4b5e-80e9-718884e366b1 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:11.187859 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a82acd-5adb-4b5e-80e9-718884e366b1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:11.188530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a82acd-5adb-4b5e-80e9-718884e366b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:11.215611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cf64d-42c3-419a-a95f-f6c5faccf89a admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:11.217879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c91cf64d-42c3-419a-a95f-f6c5faccf89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:11.224966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-15a82acd-5adb-4b5e-80e9-718884e366b1 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:11.226418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-15a82acd-5adb-4b5e-80e9-718884e366b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:11.253401 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:11.325510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 902/1820] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:11.341701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cf64d-42c3-419a-a95f-f6c5faccf89a admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:11.345269 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a82acd-5adb-4b5e-80e9-718884e366b1 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:11.350908 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-15a82acd-5adb-4b5e-80e9-718884e366b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:11.355219 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff20bc8-56a9-434a-893c-be301dde6c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:11.355878 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff20bc8-56a9-434a-893c-be301dde6c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:11.356240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff20bc8-56a9-434a-893c-be301dde6c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:11.356515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff20bc8-56a9-434a-893c-be301dde6c43 admin admin] PATH_INFO: `/v3/projects/0699a5e68e884aa18a9286c60cfe265f` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:11.357997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff20bc8-56a9-434a-893c-be301dde6c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0699a5e68e884aa18a9286c60cfe265f)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:11.359977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff20bc8-56a9-434a-893c-be301dde6c43 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:11.406267 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:11.469844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a82acd-5adb-4b5e-80e9-718884e366b1 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:11.501105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5ff20bc8-56a9-434a-893c-be301dde6c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0699a5e68e884aa18a9286c60cfe265f', 'request_id': 'req-5ff20bc8-56a9-434a-893c-be301dde6c43'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:11.527934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5ff20bc8-56a9-434a-893c-be301dde6c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0699a5e68e884aa18a9286c60cfe265f', 'request_id': 'req-5ff20bc8-56a9-434a-893c-be301dde6c43'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:11.551058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5ff20bc8-56a9-434a-893c-be301dde6c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0699a5e68e884aa18a9286c60cfe265f', 'request_id': 'req-5ff20bc8-56a9-434a-893c-be301dde6c43'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:11.553577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d88db-b701-4abe-8e0d-ae54a3d35044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:11.554350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d88db-b701-4abe-8e0d-ae54a3d35044 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:11.554942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d88db-b701-4abe-8e0d-ae54a3d35044 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:11.555309 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d88db-b701-4abe-8e0d-ae54a3d35044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:11.603392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5ff20bc8-56a9-434a-893c-be301dde6c43 admin admin] The token cache is being invalidate because project 0699a5e68e884aa18a9286c60cfe265f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:04:11.603789 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5ff20bc8-56a9-434a-893c-be301dde6c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:11.605608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5ff20bc8-56a9-434a-893c-be301dde6c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:11.620259 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 919/1821] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:04:11 2022] DELETE /identity/v3/projects/0699a5e68e884aa18a9286c60cfe265f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:11.625490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff20bc8-56a9-434a-893c-be301dde6c43 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:11.636152 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5ff20bc8-56a9-434a-893c-be301dde6c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:11.685004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d88db-b701-4abe-8e0d-ae54a3d35044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:11.686695 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d88db-b701-4abe-8e0d-ae54a3d35044 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:11.707430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 903/1822] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:04:11.810711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff20bc8-56a9-434a-893c-be301dde6c43 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:11.826045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb32aa2-f474-49e1-954b-a42a2eccd1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:11.826996 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb32aa2-f474-49e1-954b-a42a2eccd1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:11.827287 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb32aa2-f474-49e1-954b-a42a2eccd1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:11.827570 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb32aa2-f474-49e1-954b-a42a2eccd1a0 admin admin] PATH_INFO: `/v3/users/3330ab51d0d740589d5f37ce5fc5cd14` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:11.830483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb32aa2-f474-49e1-954b-a42a2eccd1a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3330ab51d0d740589d5f37ce5fc5cd14)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:11.835172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb32aa2-f474-49e1-954b-a42a2eccd1a0 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:11.912682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9fb32aa2-f474-49e1-954b-a42a2eccd1a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3330ab51d0d740589d5f37ce5fc5cd14'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:11.922456 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9fb32aa2-f474-49e1-954b-a42a2eccd1a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3330ab51d0d740589d5f37ce5fc5cd14'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:11.943097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9fb32aa2-f474-49e1-954b-a42a2eccd1a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3330ab51d0d740589d5f37ce5fc5cd14'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:11.944089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9fb32aa2-f474-49e1-954b-a42a2eccd1a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3330ab51d0d740589d5f37ce5fc5cd14'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:11.944934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9fb32aa2-f474-49e1-954b-a42a2eccd1a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3330ab51d0d740589d5f37ce5fc5cd14'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:11.963252 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 920/1823] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:04:11 2022] DELETE /identity/v3/users/3330ab51d0d740589d5f37ce5fc5cd14 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:12.232052 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d88db-b701-4abe-8e0d-ae54a3d35044 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:12.233592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a59d88db-b701-4abe-8e0d-ae54a3d35044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:12.258279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d88db-b701-4abe-8e0d-ae54a3d35044 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:12.329348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:12.413556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93928b74-fd57-4445-9528-8da6c5afb0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:12.419938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93928b74-fd57-4445-9528-8da6c5afb0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:12.419938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93928b74-fd57-4445-9528-8da6c5afb0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:12.419938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93928b74-fd57-4445-9528-8da6c5afb0aa admin admin] PATH_INFO: `/v3/projects/0a50d865f8ee434f9311bd911c1c43d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:12.421905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93928b74-fd57-4445-9528-8da6c5afb0aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a50d865f8ee434f9311bd911c1c43d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:12.425281 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93928b74-fd57-4445-9528-8da6c5afb0aa admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:12.535218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-93928b74-fd57-4445-9528-8da6c5afb0aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a50d865f8ee434f9311bd911c1c43d7', 'request_id': 'req-93928b74-fd57-4445-9528-8da6c5afb0aa'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:12.545259 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-93928b74-fd57-4445-9528-8da6c5afb0aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a50d865f8ee434f9311bd911c1c43d7', 'request_id': 'req-93928b74-fd57-4445-9528-8da6c5afb0aa'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:12.555571 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-93928b74-fd57-4445-9528-8da6c5afb0aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a50d865f8ee434f9311bd911c1c43d7', 'request_id': 'req-93928b74-fd57-4445-9528-8da6c5afb0aa'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:12.579054 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-93928b74-fd57-4445-9528-8da6c5afb0aa admin admin] The token cache is being invalidate because project 0a50d865f8ee434f9311bd911c1c43d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:04:12.579393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-93928b74-fd57-4445-9528-8da6c5afb0aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:12.580311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-93928b74-fd57-4445-9528-8da6c5afb0aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:12.583539 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 904/1824] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:04:12 2022] DELETE /identity/v3/projects/0a50d865f8ee434f9311bd911c1c43d7 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:12.588478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eabd1-979c-4159-8754-bb39692909d9 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:12.588844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eabd1-979c-4159-8754-bb39692909d9 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:12.589034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eabd1-979c-4159-8754-bb39692909d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:12.620405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-d78eabd1-979c-4159-8754-bb39692909d9 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:12.621964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d78eabd1-979c-4159-8754-bb39692909d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:12.655972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:12.767345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 921/1825] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:12.781344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd2cad-9bc7-4859-9b65-bc6c251f434b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:12.782325 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd2cad-9bc7-4859-9b65-bc6c251f434b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:12.782622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd2cad-9bc7-4859-9b65-bc6c251f434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:12.824598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5ffd2cad-9bc7-4859-9b65-bc6c251f434b None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:12.825859 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5ffd2cad-9bc7-4859-9b65-bc6c251f434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:12.845744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 905/1826] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:12.850505 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eabd1-979c-4159-8754-bb39692909d9 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:12.877997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eabd1-979c-4159-8754-bb39692909d9 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:12.883895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bf31a-257b-4d1f-b73d-3535ecb36b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:12.884770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bf31a-257b-4d1f-b73d-3535ecb36b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:12.885293 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bf31a-257b-4d1f-b73d-3535ecb36b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:12.885569 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bf31a-257b-4d1f-b73d-3535ecb36b66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:12.886242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bf31a-257b-4d1f-b73d-3535ecb36b66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:04:12.886548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bf31a-257b-4d1f-b73d-3535ecb36b66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:12.888208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bf31a-257b-4d1f-b73d-3535ecb36b66 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:12.920042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 922/1827] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:04:12.924367 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd2cad-9bc7-4859-9b65-bc6c251f434b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:12.943505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd2cad-9bc7-4859-9b65-bc6c251f434b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:12.952259 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984655ef-fad7-447d-8ff9-79a6beb4be96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:12.953472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984655ef-fad7-447d-8ff9-79a6beb4be96 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:12.954778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984655ef-fad7-447d-8ff9-79a6beb4be96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:12.954778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984655ef-fad7-447d-8ff9-79a6beb4be96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:12.955617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984655ef-fad7-447d-8ff9-79a6beb4be96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:12.960777 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984655ef-fad7-447d-8ff9-79a6beb4be96 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:13.016525 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 906/1828] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:04:12 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:04:13.020828 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bf31a-257b-4d1f-b73d-3535ecb36b66 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:13.034043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bf31a-257b-4d1f-b73d-3535ecb36b66 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:13.117252 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf9c47-d02a-427d-9511-cb3c83c5b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:13.118189 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf9c47-d02a-427d-9511-cb3c83c5b376 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:13.118568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf9c47-d02a-427d-9511-cb3c83c5b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:13.118749 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf9c47-d02a-427d-9511-cb3c83c5b376 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:13.119378 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf9c47-d02a-427d-9511-cb3c83c5b376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:13.121353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf9c47-d02a-427d-9511-cb3c83c5b376 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:13.152019 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 923/1829] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:04:13 2022] POST /identity/v3/users => generated 282 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:04:13.157675 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984655ef-fad7-447d-8ff9-79a6beb4be96 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:13.171365 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984655ef-fad7-447d-8ff9-79a6beb4be96 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:13.178924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b117e88-471d-4018-b626-a32e830ae865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:13.180147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b117e88-471d-4018-b626-a32e830ae865 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:13.180598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b117e88-471d-4018-b626-a32e830ae865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:13.181173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b117e88-471d-4018-b626-a32e830ae865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:13.181824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b117e88-471d-4018-b626-a32e830ae865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:13.183646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b117e88-471d-4018-b626-a32e830ae865 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:13.198778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 907/1830] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:04:13.202935 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf9c47-d02a-427d-9511-cb3c83c5b376 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:13.213940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf9c47-d02a-427d-9511-cb3c83c5b376 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:13.220418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0c67f-70d9-4d04-9d64-8f1b1e66888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:13.221195 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0c67f-70d9-4d04-9d64-8f1b1e66888e admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:13.221604 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0c67f-70d9-4d04-9d64-8f1b1e66888e admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:13.222199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0c67f-70d9-4d04-9d64-8f1b1e66888e admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:13.224106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0c67f-70d9-4d04-9d64-8f1b1e66888e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:13.226288 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0c67f-70d9-4d04-9d64-8f1b1e66888e admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:13.251777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 924/1831] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:13.258787 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b117e88-471d-4018-b626-a32e830ae865 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:13.280519 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b117e88-471d-4018-b626-a32e830ae865 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:13.292705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba02f8-ab69-4946-8503-e8e9137450e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:13.294487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba02f8-ab69-4946-8503-e8e9137450e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:13.294993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba02f8-ab69-4946-8503-e8e9137450e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:13.295594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba02f8-ab69-4946-8503-e8e9137450e8 admin admin] PATH_INFO: `/v3/projects/92b7b6b00db04a738b24d162252ceed2/users/296c18c9a35941dd9385049dfbaaa198/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:13.334986 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba02f8-ab69-4946-8503-e8e9137450e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b7b6b00db04a738b24d162252ceed2, user_id=296c18c9a35941dd9385049dfbaaa198, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:13.338024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba02f8-ab69-4946-8503-e8e9137450e8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:13.364321 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 908/1832] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:04:13 2022] PUT /identity/v3/projects/92b7b6b00db04a738b24d162252ceed2/users/296c18c9a35941dd9385049dfbaaa198/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:04:13.366122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e838441-9d93-4d7c-a547-b43808e62b13 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:13.366400 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e838441-9d93-4d7c-a547-b43808e62b13 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:13.366669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e838441-9d93-4d7c-a547-b43808e62b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:13.416007 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5e838441-9d93-4d7c-a547-b43808e62b13 None None] MFA Rules not processed for user `296c18c9a35941dd9385049dfbaaa198`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:13.417409 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5e838441-9d93-4d7c-a547-b43808e62b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:13.624908 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 925/1833] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:13.741111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba02f8-ab69-4946-8503-e8e9137450e8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:13.742884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-38ba02f8-ab69-4946-8503-e8e9137450e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:13.874302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba02f8-ab69-4946-8503-e8e9137450e8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:13.886027 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e838441-9d93-4d7c-a547-b43808e62b13 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:13.886581 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10449a-496f-4ba5-bd23-b14a6da99f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:13.887062 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10449a-496f-4ba5-bd23-b14a6da99f3f service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:13.887349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10449a-496f-4ba5-bd23-b14a6da99f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:13.887624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10449a-496f-4ba5-bd23-b14a6da99f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:13.887735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5e838441-9d93-4d7c-a547-b43808e62b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:13.910187 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10449a-496f-4ba5-bd23-b14a6da99f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:13.912639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10449a-496f-4ba5-bd23-b14a6da99f3f service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:13.922273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:13.932257 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:13.932868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 909/1834] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:04:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:04:14.043628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e838441-9d93-4d7c-a547-b43808e62b13 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:14.081742 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d2b90-ac44-4e30-85f3-c4d4417a50e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:14.086202 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d2b90-ac44-4e30-85f3-c4d4417a50e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:14.089729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d2b90-ac44-4e30-85f3-c4d4417a50e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:14.092206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d2b90-ac44-4e30-85f3-c4d4417a50e5 admin admin] PATH_INFO: `/v3/projects/649f3d14d91d4892aed0e9ec6da31d76` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:14.094525 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d2b90-ac44-4e30-85f3-c4d4417a50e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=649f3d14d91d4892aed0e9ec6da31d76)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:14.100061 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d2b90-ac44-4e30-85f3-c4d4417a50e5 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:14.218832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-312d2b90-ac44-4e30-85f3-c4d4417a50e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649f3d14d91d4892aed0e9ec6da31d76', 'request_id': 'req-312d2b90-ac44-4e30-85f3-c4d4417a50e5'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:14.229995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-312d2b90-ac44-4e30-85f3-c4d4417a50e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649f3d14d91d4892aed0e9ec6da31d76', 'request_id': 'req-312d2b90-ac44-4e30-85f3-c4d4417a50e5'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:14.249433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-312d2b90-ac44-4e30-85f3-c4d4417a50e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649f3d14d91d4892aed0e9ec6da31d76', 'request_id': 'req-312d2b90-ac44-4e30-85f3-c4d4417a50e5'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:14.282391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-312d2b90-ac44-4e30-85f3-c4d4417a50e5 admin admin] The token cache is being invalidate because project 649f3d14d91d4892aed0e9ec6da31d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:04:14.283226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-312d2b90-ac44-4e30-85f3-c4d4417a50e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:14.284227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-312d2b90-ac44-4e30-85f3-c4d4417a50e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:14.286381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 926/1835] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:04:13 2022] DELETE /identity/v3/projects/649f3d14d91d4892aed0e9ec6da31d76 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:04:14.290701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10449a-496f-4ba5-bd23-b14a6da99f3f service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:14.305274 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10449a-496f-4ba5-bd23-b14a6da99f3f service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:14.421173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7624f86-32ee-4474-8b79-f69eec01af37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:14.422143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7624f86-32ee-4474-8b79-f69eec01af37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:14.422756 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7624f86-32ee-4474-8b79-f69eec01af37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:14.423190 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7624f86-32ee-4474-8b79-f69eec01af37 admin admin] PATH_INFO: `/v3/users/ff295a11aa8b41f1be8bd7ff3dc8e434` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:14.424727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7624f86-32ee-4474-8b79-f69eec01af37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff295a11aa8b41f1be8bd7ff3dc8e434)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:14.428977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7624f86-32ee-4474-8b79-f69eec01af37 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:14.513997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e7624f86-32ee-4474-8b79-f69eec01af37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff295a11aa8b41f1be8bd7ff3dc8e434'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:14.530356 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e7624f86-32ee-4474-8b79-f69eec01af37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff295a11aa8b41f1be8bd7ff3dc8e434'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:14.556076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e7624f86-32ee-4474-8b79-f69eec01af37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff295a11aa8b41f1be8bd7ff3dc8e434'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:14.569171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e7624f86-32ee-4474-8b79-f69eec01af37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff295a11aa8b41f1be8bd7ff3dc8e434'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:14.570065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e7624f86-32ee-4474-8b79-f69eec01af37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff295a11aa8b41f1be8bd7ff3dc8e434'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:14.581350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 910/1836] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:04:14 2022] DELETE /identity/v3/users/ff295a11aa8b41f1be8bd7ff3dc8e434 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:15.340897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d2b90-ac44-4e30-85f3-c4d4417a50e5 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:15.350360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-312d2b90-ac44-4e30-85f3-c4d4417a50e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:15.378422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d2b90-ac44-4e30-85f3-c4d4417a50e5 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:15.538095 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d84df-a64e-4369-b445-2fa9e38804a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:15.539248 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d84df-a64e-4369-b445-2fa9e38804a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:15.539680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d84df-a64e-4369-b445-2fa9e38804a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:15.540127 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d84df-a64e-4369-b445-2fa9e38804a5 admin admin] PATH_INFO: `/v3/projects/b9b0aee2cb8949ca8387c2d19bbe793c` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:15.556067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d84df-a64e-4369-b445-2fa9e38804a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b0aee2cb8949ca8387c2d19bbe793c)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:15.558682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d84df-a64e-4369-b445-2fa9e38804a5 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:15.662584 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d44d84df-a64e-4369-b445-2fa9e38804a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b0aee2cb8949ca8387c2d19bbe793c', 'request_id': 'req-d44d84df-a64e-4369-b445-2fa9e38804a5'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:15.664930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:15.679080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d44d84df-a64e-4369-b445-2fa9e38804a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b0aee2cb8949ca8387c2d19bbe793c', 'request_id': 'req-d44d84df-a64e-4369-b445-2fa9e38804a5'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:15.718164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d44d84df-a64e-4369-b445-2fa9e38804a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b0aee2cb8949ca8387c2d19bbe793c', 'request_id': 'req-d44d84df-a64e-4369-b445-2fa9e38804a5'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:15.733707 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d44d84df-a64e-4369-b445-2fa9e38804a5 admin admin] The token cache is being invalidate because project b9b0aee2cb8949ca8387c2d19bbe793c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:04:15.734004 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d44d84df-a64e-4369-b445-2fa9e38804a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:15.734703 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d44d84df-a64e-4369-b445-2fa9e38804a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:15.736637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 927/1837] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:04:15 2022] DELETE /identity/v3/projects/b9b0aee2cb8949ca8387c2d19bbe793c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:15.741839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0955a-d897-4e36-9eca-ccea09540807 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:15.742357 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0955a-d897-4e36-9eca-ccea09540807 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:15.742435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0955a-d897-4e36-9eca-ccea09540807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:15.768949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6ff0955a-d897-4e36-9eca-ccea09540807 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:15.771086 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6ff0955a-d897-4e36-9eca-ccea09540807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:15.892191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 911/1838] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:15.894560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ae197-7ca4-4193-b980-58984d98fcfd None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:15.895165 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ae197-7ca4-4193-b980-58984d98fcfd None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:15.895704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ae197-7ca4-4193-b980-58984d98fcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:15.930879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-a39ae197-7ca4-4193-b980-58984d98fcfd None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:15.932175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a39ae197-7ca4-4193-b980-58984d98fcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:15.947055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 928/1839] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:15.948284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0955a-d897-4e36-9eca-ccea09540807 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:15.960138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0955a-d897-4e36-9eca-ccea09540807 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:15.969732 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d11be-811b-42be-8d40-2ff36ec4cbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:15.970389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d11be-811b-42be-8d40-2ff36ec4cbca admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:15.970686 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d11be-811b-42be-8d40-2ff36ec4cbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:15.971528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d11be-811b-42be-8d40-2ff36ec4cbca admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:15.972384 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d11be-811b-42be-8d40-2ff36ec4cbca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:04:15.972563 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d11be-811b-42be-8d40-2ff36ec4cbca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:15.974636 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d11be-811b-42be-8d40-2ff36ec4cbca admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:15.997059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 912/1840] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:04:16.001661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ae197-7ca4-4193-b980-58984d98fcfd None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:16.014869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ae197-7ca4-4193-b980-58984d98fcfd None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:16.023074 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f3a2c-4b89-4418-8970-ef3abe390862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:16.024332 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f3a2c-4b89-4418-8970-ef3abe390862 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:16.024946 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f3a2c-4b89-4418-8970-ef3abe390862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:16.025321 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f3a2c-4b89-4418-8970-ef3abe390862 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:16.026324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f3a2c-4b89-4418-8970-ef3abe390862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:16.029482 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f3a2c-4b89-4418-8970-ef3abe390862 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:16.075700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 929/1841] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:04:16 2022] POST /identity/v3/projects => generated 407 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:04:16.076425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d11be-811b-42be-8d40-2ff36ec4cbca admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:16.085214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:16.090393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d11be-811b-42be-8d40-2ff36ec4cbca admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:16.219674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8df81c-1a1f-4035-bfb4-54b766568474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:16.220597 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8df81c-1a1f-4035-bfb4-54b766568474 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:16.222204 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8df81c-1a1f-4035-bfb4-54b766568474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:16.222658 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8df81c-1a1f-4035-bfb4-54b766568474 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:16.225038 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8df81c-1a1f-4035-bfb4-54b766568474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:16.228049 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8df81c-1a1f-4035-bfb4-54b766568474 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:16.262769 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 913/1842] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:04:16 2022] POST /identity/v3/users => generated 304 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:04:16.266642 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f3a2c-4b89-4418-8970-ef3abe390862 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:16.279701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f3a2c-4b89-4418-8970-ef3abe390862 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:16.287721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe0095-555c-49ce-8a02-e2caeaf2d1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:16.287721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe0095-555c-49ce-8a02-e2caeaf2d1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:16.287721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe0095-555c-49ce-8a02-e2caeaf2d1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:16.288166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe0095-555c-49ce-8a02-e2caeaf2d1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:16.288581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe0095-555c-49ce-8a02-e2caeaf2d1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:16.290216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe0095-555c-49ce-8a02-e2caeaf2d1e2 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:16.307281 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8df81c-1a1f-4035-bfb4-54b766568474 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:16.318410 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 930/1843] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:16.320763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8df81c-1a1f-4035-bfb4-54b766568474 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:16.330396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f29ce3-7d5c-47d4-bb2a-a14acf4aed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:16.331233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f29ce3-7d5c-47d4-bb2a-a14acf4aed1c admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:16.331618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f29ce3-7d5c-47d4-bb2a-a14acf4aed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:16.332048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f29ce3-7d5c-47d4-bb2a-a14acf4aed1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:16.333487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f29ce3-7d5c-47d4-bb2a-a14acf4aed1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:16.335456 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f29ce3-7d5c-47d4-bb2a-a14acf4aed1c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:16.352157 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 914/1844] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:16.358169 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe0095-555c-49ce-8a02-e2caeaf2d1e2 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:16.374093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe0095-555c-49ce-8a02-e2caeaf2d1e2 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:16.388534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652fe97-a97c-417f-9a3d-787603d9cf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:16.389393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652fe97-a97c-417f-9a3d-787603d9cf06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:16.390152 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652fe97-a97c-417f-9a3d-787603d9cf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:16.390152 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652fe97-a97c-417f-9a3d-787603d9cf06 admin admin] PATH_INFO: `/v3/projects/d4b1db75b60b4f43a192f73f630784cc/users/5ab4ccbbee1042f393e5ebb406313ea4/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:16.419459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652fe97-a97c-417f-9a3d-787603d9cf06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b1db75b60b4f43a192f73f630784cc, user_id=5ab4ccbbee1042f393e5ebb406313ea4, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:16.424852 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652fe97-a97c-417f-9a3d-787603d9cf06 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:16.472284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 931/1845] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:04:16 2022] PUT /identity/v3/projects/d4b1db75b60b4f43a192f73f630784cc/users/5ab4ccbbee1042f393e5ebb406313ea4/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:04:16.473914 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45ee25-e451-47f4-b710-122cfa737bd4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:16.475063 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45ee25-e451-47f4-b710-122cfa737bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:16.475352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45ee25-e451-47f4-b710-122cfa737bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:16.572448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-bf45ee25-e451-47f4-b710-122cfa737bd4 None None] MFA Rules not processed for user `5ab4ccbbee1042f393e5ebb406313ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:16.574956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bf45ee25-e451-47f4-b710-122cfa737bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:16.784519 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 915/1846] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:16 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:16.789687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652fe97-a97c-417f-9a3d-787603d9cf06 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:16.944337 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652fe97-a97c-417f-9a3d-787603d9cf06 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:16.954132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b437dae-16ca-4dae-ba14-57b8495e30ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:16.955026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b437dae-16ca-4dae-ba14-57b8495e30ed admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:16.955459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b437dae-16ca-4dae-ba14-57b8495e30ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:16.956287 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b437dae-16ca-4dae-ba14-57b8495e30ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:16.957109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b437dae-16ca-4dae-ba14-57b8495e30ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:16.960529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b437dae-16ca-4dae-ba14-57b8495e30ed admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:17.015500 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 932/1847] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:04:16 2022] POST /identity/v3/projects => generated 407 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:04:17.019255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45ee25-e451-47f4-b710-122cfa737bd4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:17.032733 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45ee25-e451-47f4-b710-122cfa737bd4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:17.178189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251a08e-6ea1-41db-8b45-32f0d57f8d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:17.184898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a08e-6ea1-41db-8b45-32f0d57f8d23 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:17.186725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a08e-6ea1-41db-8b45-32f0d57f8d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:17.187628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a08e-6ea1-41db-8b45-32f0d57f8d23 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:17.188794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251a08e-6ea1-41db-8b45-32f0d57f8d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:17.193116 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251a08e-6ea1-41db-8b45-32f0d57f8d23 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:17.253485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 916/1848] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:04:17 2022] POST /identity/v3/users => generated 310 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:04:17.257916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b437dae-16ca-4dae-ba14-57b8495e30ed admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:17.275397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b437dae-16ca-4dae-ba14-57b8495e30ed admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:17.283419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bd483-e791-47e2-ad4b-a7341635b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:17.284338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bd483-e791-47e2-ad4b-a7341635b3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:17.284897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bd483-e791-47e2-ad4b-a7341635b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:17.285324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bd483-e791-47e2-ad4b-a7341635b3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:17.287971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bd483-e791-47e2-ad4b-a7341635b3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:17.290864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bd483-e791-47e2-ad4b-a7341635b3e3 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:17.316513 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 933/1849] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:17.320745 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251a08e-6ea1-41db-8b45-32f0d57f8d23 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:17.328458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:17.344040 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251a08e-6ea1-41db-8b45-32f0d57f8d23 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:17.353933 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3e54d-29e6-4ae3-9d3f-5c39afc136b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:17.356010 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3e54d-29e6-4ae3-9d3f-5c39afc136b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:17.356489 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3e54d-29e6-4ae3-9d3f-5c39afc136b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:17.356933 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3e54d-29e6-4ae3-9d3f-5c39afc136b7 admin admin] PATH_INFO: `/v3/projects/d134d70835c1449d962e8b6a7a8006c2/users/ea1aed5324ee49ea9a03879bc5683e0d/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:17.400020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3e54d-29e6-4ae3-9d3f-5c39afc136b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d134d70835c1449d962e8b6a7a8006c2, user_id=ea1aed5324ee49ea9a03879bc5683e0d, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:17.414033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3e54d-29e6-4ae3-9d3f-5c39afc136b7 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:17.440186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 917/1850] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:04:17 2022] PUT /identity/v3/projects/d134d70835c1449d962e8b6a7a8006c2/users/ea1aed5324ee49ea9a03879bc5683e0d/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:04:17.445176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bd483-e791-47e2-ad4b-a7341635b3e3 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:17.465894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bd483-e791-47e2-ad4b-a7341635b3e3 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:17.569986 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:17.607119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff4182-f2cd-4a56-a76c-e2f5e9a8e713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:17.607758 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff4182-f2cd-4a56-a76c-e2f5e9a8e713 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:17.608066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff4182-f2cd-4a56-a76c-e2f5e9a8e713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:17.608341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff4182-f2cd-4a56-a76c-e2f5e9a8e713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:17.609027 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff4182-f2cd-4a56-a76c-e2f5e9a8e713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:17.610660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff4182-f2cd-4a56-a76c-e2f5e9a8e713 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:17.666786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 934/1851] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:17.670429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3e54d-29e6-4ae3-9d3f-5c39afc136b7 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:17.690622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3e54d-29e6-4ae3-9d3f-5c39afc136b7 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:17.708403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112230f-7a49-46a1-ac34-1f5b6f2f4021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:17.710279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112230f-7a49-46a1-ac34-1f5b6f2f4021 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:17.711199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112230f-7a49-46a1-ac34-1f5b6f2f4021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:17.713323 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112230f-7a49-46a1-ac34-1f5b6f2f4021 admin admin] PATH_INFO: `/v3/projects/d134d70835c1449d962e8b6a7a8006c2/users/ea1aed5324ee49ea9a03879bc5683e0d/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:17.722349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112230f-7a49-46a1-ac34-1f5b6f2f4021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d134d70835c1449d962e8b6a7a8006c2, user_id=ea1aed5324ee49ea9a03879bc5683e0d, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:17.733553 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112230f-7a49-46a1-ac34-1f5b6f2f4021 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:17.762823 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 918/1852] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:04:17 2022] PUT /identity/v3/projects/d134d70835c1449d962e8b6a7a8006c2/users/ea1aed5324ee49ea9a03879bc5683e0d/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:17.775264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc97b7-cc66-4bb5-9608-57bf26fd356c None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:17.775533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc97b7-cc66-4bb5-9608-57bf26fd356c None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:17.775828 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc97b7-cc66-4bb5-9608-57bf26fd356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:17.834510 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-50bc97b7-cc66-4bb5-9608-57bf26fd356c None None] MFA Rules not processed for user `ea1aed5324ee49ea9a03879bc5683e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:17.835835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-50bc97b7-cc66-4bb5-9608-57bf26fd356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:18.000355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 935/1853] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:17 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:18.059140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112230f-7a49-46a1-ac34-1f5b6f2f4021 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:18.062078 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6112230f-7a49-46a1-ac34-1f5b6f2f4021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:18.199880 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112230f-7a49-46a1-ac34-1f5b6f2f4021 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:18.203767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6f6b9-3158-4394-8090-e690b9ddaea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:18.204646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6f6b9-3158-4394-8090-e690b9ddaea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:18.205029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6f6b9-3158-4394-8090-e690b9ddaea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:18.205399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6f6b9-3158-4394-8090-e690b9ddaea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:18.310471 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6f6b9-3158-4394-8090-e690b9ddaea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:18.312110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6f6b9-3158-4394-8090-e690b9ddaea5 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:18.336675 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 919/1854] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:04:18 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:04:19.159333 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc97b7-cc66-4bb5-9608-57bf26fd356c None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:19.163112 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-50bc97b7-cc66-4bb5-9608-57bf26fd356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:19.375451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc97b7-cc66-4bb5-9608-57bf26fd356c None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:19.382704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38e80c-9763-4614-be14-08bb0e5d5a18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:19.383938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38e80c-9763-4614-be14-08bb0e5d5a18 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:19.384340 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38e80c-9763-4614-be14-08bb0e5d5a18 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:19.384725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38e80c-9763-4614-be14-08bb0e5d5a18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:19.395710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38e80c-9763-4614-be14-08bb0e5d5a18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:19.396637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38e80c-9763-4614-be14-08bb0e5d5a18 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:19.411573 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 936/1855] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:04:19 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:04:28.323736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=62,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:29.404357 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=75 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:31.305176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6f6b9-3158-4394-8090-e690b9ddaea5 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:31.307341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a0a6f6b9-3158-4394-8090-e690b9ddaea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:31.418907 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6f6b9-3158-4394-8090-e690b9ddaea5 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:31.423984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a9e38-d589-4692-8e82-0e30dca49734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:31.424665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a9e38-d589-4692-8e82-0e30dca49734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:31.425098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a9e38-d589-4692-8e82-0e30dca49734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:31.425380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a9e38-d589-4692-8e82-0e30dca49734 admin admin] PATH_INFO: `/v3/users/48938fc8a89547c3a91caeead99f5a81` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:31.427067 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a9e38-d589-4692-8e82-0e30dca49734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48938fc8a89547c3a91caeead99f5a81)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:31.429499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a9e38-d589-4692-8e82-0e30dca49734 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:31.494628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d67a9e38-d589-4692-8e82-0e30dca49734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48938fc8a89547c3a91caeead99f5a81'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:31.506374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d67a9e38-d589-4692-8e82-0e30dca49734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48938fc8a89547c3a91caeead99f5a81'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:31.529439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d67a9e38-d589-4692-8e82-0e30dca49734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48938fc8a89547c3a91caeead99f5a81'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:31.541756 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d67a9e38-d589-4692-8e82-0e30dca49734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48938fc8a89547c3a91caeead99f5a81'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:31.543605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d67a9e38-d589-4692-8e82-0e30dca49734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48938fc8a89547c3a91caeead99f5a81'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:31.552197 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 920/1856] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:04:31 2022] DELETE /identity/v3/users/48938fc8a89547c3a91caeead99f5a81 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:31.557362 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d0dd8-e13b-4149-a0a2-1333b0ad6da1 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:31.558272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d0dd8-e13b-4149-a0a2-1333b0ad6da1 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:31.558952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d0dd8-e13b-4149-a0a2-1333b0ad6da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:31.585991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-4d7d0dd8-e13b-4149-a0a2-1333b0ad6da1 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:31.587831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4d7d0dd8-e13b-4149-a0a2-1333b0ad6da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:31.679729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 937/1857] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:31.711266 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a9e38-d589-4692-8e82-0e30dca49734 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:31.713043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d67a9e38-d589-4692-8e82-0e30dca49734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:31.794465 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a9e38-d589-4692-8e82-0e30dca49734 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:31.799379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302bc85-75d3-4dcc-bd57-f4ba43d54163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:31.800161 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302bc85-75d3-4dcc-bd57-f4ba43d54163 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:31.800445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302bc85-75d3-4dcc-bd57-f4ba43d54163 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:31.802277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302bc85-75d3-4dcc-bd57-f4ba43d54163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:31.816969 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302bc85-75d3-4dcc-bd57-f4ba43d54163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:31.819744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302bc85-75d3-4dcc-bd57-f4ba43d54163 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:31.832838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 921/1858] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:04:33.527085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d0dd8-e13b-4149-a0a2-1333b0ad6da1 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:33.529416 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4d7d0dd8-e13b-4149-a0a2-1333b0ad6da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:33.546805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d0dd8-e13b-4149-a0a2-1333b0ad6da1 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:33.558289 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:33.559143 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:33.559566 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:33.560025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a admin admin] PATH_INFO: `/v3/projects/0ba2637d5962441787ce53702dbcbcc8` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:33.561995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba2637d5962441787ce53702dbcbcc8)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:33.565394 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:33.654467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba2637d5962441787ce53702dbcbcc8', 'request_id': 'req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:33.663729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba2637d5962441787ce53702dbcbcc8', 'request_id': 'req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:33.680641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba2637d5962441787ce53702dbcbcc8', 'request_id': 'req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:33.724315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a admin admin] The token cache is being invalidate because project 0ba2637d5962441787ce53702dbcbcc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:04:33.724885 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:33.725677 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:33.727419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 938/1859] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:04:33 2022] DELETE /identity/v3/projects/0ba2637d5962441787ce53702dbcbcc8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:33.731773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302bc85-75d3-4dcc-bd57-f4ba43d54163 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:33.743499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302bc85-75d3-4dcc-bd57-f4ba43d54163 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:33.771538 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:33.856967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4384c4-23cd-4b33-a5ba-b3ee31ec9b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:33.858309 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4384c4-23cd-4b33-a5ba-b3ee31ec9b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:33.864015 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4384c4-23cd-4b33-a5ba-b3ee31ec9b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:33.864908 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4384c4-23cd-4b33-a5ba-b3ee31ec9b4e admin admin] PATH_INFO: `/v3/users/eed4445a42de4e17b5e3f0e1e0909a38` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:33.866642 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4384c4-23cd-4b33-a5ba-b3ee31ec9b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed4445a42de4e17b5e3f0e1e0909a38)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:33.868888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4384c4-23cd-4b33-a5ba-b3ee31ec9b4e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:33.995021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cb4384c4-23cd-4b33-a5ba-b3ee31ec9b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed4445a42de4e17b5e3f0e1e0909a38'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:34.008939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cb4384c4-23cd-4b33-a5ba-b3ee31ec9b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed4445a42de4e17b5e3f0e1e0909a38'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:34.035824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cb4384c4-23cd-4b33-a5ba-b3ee31ec9b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed4445a42de4e17b5e3f0e1e0909a38'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:34.051340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cb4384c4-23cd-4b33-a5ba-b3ee31ec9b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed4445a42de4e17b5e3f0e1e0909a38'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:34.052164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cb4384c4-23cd-4b33-a5ba-b3ee31ec9b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed4445a42de4e17b5e3f0e1e0909a38'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:34.064044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 922/1860] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:04:33 2022] DELETE /identity/v3/users/eed4445a42de4e17b5e3f0e1e0909a38 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:35.170518 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:35.173442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:35.217747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cafa0-7c7d-4077-9a9b-fb32c984412a admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:35.403763 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5226772-04f7-4902-9c4a-a98852a97778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:35.404829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5226772-04f7-4902-9c4a-a98852a97778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:35.404829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5226772-04f7-4902-9c4a-a98852a97778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:35.405033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5226772-04f7-4902-9c4a-a98852a97778 admin admin] PATH_INFO: `/v3/projects/913dd11fdf254b3ebb975bc4491a8940` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:35.413161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5226772-04f7-4902-9c4a-a98852a97778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=913dd11fdf254b3ebb975bc4491a8940)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:35.415168 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5226772-04f7-4902-9c4a-a98852a97778 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:35.507685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:35.562142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a5226772-04f7-4902-9c4a-a98852a97778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913dd11fdf254b3ebb975bc4491a8940', 'request_id': 'req-a5226772-04f7-4902-9c4a-a98852a97778'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:35.573724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a5226772-04f7-4902-9c4a-a98852a97778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913dd11fdf254b3ebb975bc4491a8940', 'request_id': 'req-a5226772-04f7-4902-9c4a-a98852a97778'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:35.593422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a5226772-04f7-4902-9c4a-a98852a97778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913dd11fdf254b3ebb975bc4491a8940', 'request_id': 'req-a5226772-04f7-4902-9c4a-a98852a97778'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:35.621562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a5226772-04f7-4902-9c4a-a98852a97778 admin admin] The token cache is being invalidate because project 913dd11fdf254b3ebb975bc4491a8940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:04:35.622134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a5226772-04f7-4902-9c4a-a98852a97778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:35.623101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a5226772-04f7-4902-9c4a-a98852a97778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:35.626060 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 939/1861] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:04:35 2022] DELETE /identity/v3/projects/913dd11fdf254b3ebb975bc4491a8940 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:35.631896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ed773-753a-4952-81a2-9f7f38f85ec6 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:35.632439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ed773-753a-4952-81a2-9f7f38f85ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:35.632587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ed773-753a-4952-81a2-9f7f38f85ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:35.677557 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d45ed773-753a-4952-81a2-9f7f38f85ec6 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:35.681407 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d45ed773-753a-4952-81a2-9f7f38f85ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:35.774199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 923/1862] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:35.775370 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bd788-f0b8-42dd-a3ab-611f7fac7df0 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:35.775662 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bd788-f0b8-42dd-a3ab-611f7fac7df0 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:35.775962 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bd788-f0b8-42dd-a3ab-611f7fac7df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:35.852818 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-f04bd788-f0b8-42dd-a3ab-611f7fac7df0 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:35.854924 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f04bd788-f0b8-42dd-a3ab-611f7fac7df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:35.866021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 940/1863] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:04:35.871331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ed773-753a-4952-81a2-9f7f38f85ec6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:35.888256 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ed773-753a-4952-81a2-9f7f38f85ec6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:35.895639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47773a8-2735-4ac4-b1e0-4cfe111571dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:35.897273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47773a8-2735-4ac4-b1e0-4cfe111571dc admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:35.897839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47773a8-2735-4ac4-b1e0-4cfe111571dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:35.899220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47773a8-2735-4ac4-b1e0-4cfe111571dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:35.900484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47773a8-2735-4ac4-b1e0-4cfe111571dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:04:35.901551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47773a8-2735-4ac4-b1e0-4cfe111571dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:35.904103 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47773a8-2735-4ac4-b1e0-4cfe111571dc admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:35.924347 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 924/1864] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:04:35.930298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bd788-f0b8-42dd-a3ab-611f7fac7df0 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:35.981327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bd788-f0b8-42dd-a3ab-611f7fac7df0 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:35.992413 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35656dd-cfd2-42ff-8e7f-b3a85c2f0918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:35.993792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35656dd-cfd2-42ff-8e7f-b3a85c2f0918 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:35.994493 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35656dd-cfd2-42ff-8e7f-b3a85c2f0918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:35.995330 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35656dd-cfd2-42ff-8e7f-b3a85c2f0918 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:35.996283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35656dd-cfd2-42ff-8e7f-b3a85c2f0918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:35.999472 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35656dd-cfd2-42ff-8e7f-b3a85c2f0918 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:36.067761 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 941/1865] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:04:35 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:04:36.072919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47773a8-2735-4ac4-b1e0-4cfe111571dc admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:36.084778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47773a8-2735-4ac4-b1e0-4cfe111571dc admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:36.161003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:36.212029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b989a-455b-4c6c-a63f-869edfb0cb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:36.212909 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b989a-455b-4c6c-a63f-869edfb0cb86 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:36.213297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b989a-455b-4c6c-a63f-869edfb0cb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:36.213748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b989a-455b-4c6c-a63f-869edfb0cb86 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:36.214647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b989a-455b-4c6c-a63f-869edfb0cb86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:36.216795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b989a-455b-4c6c-a63f-869edfb0cb86 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:36.249359 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 925/1866] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:04:36 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:04:36.253651 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35656dd-cfd2-42ff-8e7f-b3a85c2f0918 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:36.273736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35656dd-cfd2-42ff-8e7f-b3a85c2f0918 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:36.292273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98945a8-84a6-4a12-b016-f8f72e506438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:36.293841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98945a8-84a6-4a12-b016-f8f72e506438 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:36.296002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98945a8-84a6-4a12-b016-f8f72e506438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:36.296468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98945a8-84a6-4a12-b016-f8f72e506438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:36.299214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98945a8-84a6-4a12-b016-f8f72e506438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:36.301861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98945a8-84a6-4a12-b016-f8f72e506438 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:36.322711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 942/1867] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:36.326374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b989a-455b-4c6c-a63f-869edfb0cb86 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:36.345711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b989a-455b-4c6c-a63f-869edfb0cb86 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:36.359139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f13a06-a74b-48f3-a58e-ef051a57179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:36.360004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f13a06-a74b-48f3-a58e-ef051a57179a admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:36.364651 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f13a06-a74b-48f3-a58e-ef051a57179a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:36.365326 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f13a06-a74b-48f3-a58e-ef051a57179a admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:36.366097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f13a06-a74b-48f3-a58e-ef051a57179a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:36.367849 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f13a06-a74b-48f3-a58e-ef051a57179a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:36.394282 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 926/1868] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:36.399546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98945a8-84a6-4a12-b016-f8f72e506438 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:36.421360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98945a8-84a6-4a12-b016-f8f72e506438 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:36.442412 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef55201-5706-490e-95cb-d94b5a17818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:36.443222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef55201-5706-490e-95cb-d94b5a17818a admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:36.443509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef55201-5706-490e-95cb-d94b5a17818a admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:36.443784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef55201-5706-490e-95cb-d94b5a17818a admin admin] PATH_INFO: `/v3/projects/c36edfe9ec85442eb45b30b4c96a9168/users/072652f37b794ee29ababc447eb9bda6/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:36.477217 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef55201-5706-490e-95cb-d94b5a17818a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c36edfe9ec85442eb45b30b4c96a9168, user_id=072652f37b794ee29ababc447eb9bda6, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:36.480065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef55201-5706-490e-95cb-d94b5a17818a admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:36.531065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 943/1869] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:04:36 2022] PUT /identity/v3/projects/c36edfe9ec85442eb45b30b4c96a9168/users/072652f37b794ee29ababc447eb9bda6/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:36.542358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e1f35-49ee-4517-bf2b-0afd1546a6f8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:36.542797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e1f35-49ee-4517-bf2b-0afd1546a6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:36.543351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e1f35-49ee-4517-bf2b-0afd1546a6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:36.604223 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a25e1f35-49ee-4517-bf2b-0afd1546a6f8 None None] MFA Rules not processed for user `072652f37b794ee29ababc447eb9bda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:36.616649 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a25e1f35-49ee-4517-bf2b-0afd1546a6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:36.617248 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef55201-5706-490e-95cb-d94b5a17818a admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:36.619372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2ef55201-5706-490e-95cb-d94b5a17818a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:36.741230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef55201-5706-490e-95cb-d94b5a17818a admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:36.749476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822383d-c729-4d82-9fdc-4efe3d0bab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:36.760911 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822383d-c729-4d82-9fdc-4efe3d0bab31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:36.762554 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822383d-c729-4d82-9fdc-4efe3d0bab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:36.763869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822383d-c729-4d82-9fdc-4efe3d0bab31 admin admin] PATH_INFO: `/v3/users/d75986e659174d50881e14a275adeb76` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:36.766110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822383d-c729-4d82-9fdc-4efe3d0bab31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75986e659174d50881e14a275adeb76)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:36.769118 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 927/1870] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:36.770518 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822383d-c729-4d82-9fdc-4efe3d0bab31 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:36.813590 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e1f35-49ee-4517-bf2b-0afd1546a6f8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:36.817110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a25e1f35-49ee-4517-bf2b-0afd1546a6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:36.851561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e822383d-c729-4d82-9fdc-4efe3d0bab31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75986e659174d50881e14a275adeb76'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:36.860643 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:DELETE=14,keystone:SELECT=82,keystone:INSERT=4 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:36.869894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e822383d-c729-4d82-9fdc-4efe3d0bab31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75986e659174d50881e14a275adeb76'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:36.907565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e822383d-c729-4d82-9fdc-4efe3d0bab31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75986e659174d50881e14a275adeb76'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:36.908645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e822383d-c729-4d82-9fdc-4efe3d0bab31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75986e659174d50881e14a275adeb76'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:36.910845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e822383d-c729-4d82-9fdc-4efe3d0bab31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75986e659174d50881e14a275adeb76'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:36.933165 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e1f35-49ee-4517-bf2b-0afd1546a6f8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:36.939139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 944/1871] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:04:36 2022] DELETE /identity/v3/users/d75986e659174d50881e14a275adeb76 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:04:37.014487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00f22d-23de-4f84-a76b-241034cba585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:37.017195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00f22d-23de-4f84-a76b-241034cba585 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:37.017808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00f22d-23de-4f84-a76b-241034cba585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:37.018365 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00f22d-23de-4f84-a76b-241034cba585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:37.022748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9c00f22d-23de-4f84-a76b-241034cba585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:37.037057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:37.149617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00f22d-23de-4f84-a76b-241034cba585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:37.151794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00f22d-23de-4f84-a76b-241034cba585 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:37.169199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 928/1872] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:04:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:04:37.237239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822383d-c729-4d82-9fdc-4efe3d0bab31 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:37.242784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e822383d-c729-4d82-9fdc-4efe3d0bab31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:37.401241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822383d-c729-4d82-9fdc-4efe3d0bab31 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:37.430069 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763e7d9-7006-470f-8d0a-c0e5c1c11540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:37.430731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763e7d9-7006-470f-8d0a-c0e5c1c11540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:37.431010 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763e7d9-7006-470f-8d0a-c0e5c1c11540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:37.431285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763e7d9-7006-470f-8d0a-c0e5c1c11540 admin admin] PATH_INFO: `/v3/users/072652f37b794ee29ababc447eb9bda6` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:37.432568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763e7d9-7006-470f-8d0a-c0e5c1c11540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=072652f37b794ee29ababc447eb9bda6)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:37.434542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763e7d9-7006-470f-8d0a-c0e5c1c11540 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:37.550396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f763e7d9-7006-470f-8d0a-c0e5c1c11540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072652f37b794ee29ababc447eb9bda6'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:37.562049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f763e7d9-7006-470f-8d0a-c0e5c1c11540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072652f37b794ee29ababc447eb9bda6'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:37.592226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f763e7d9-7006-470f-8d0a-c0e5c1c11540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072652f37b794ee29ababc447eb9bda6'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:37.595445 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f763e7d9-7006-470f-8d0a-c0e5c1c11540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072652f37b794ee29ababc447eb9bda6'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:37.596209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f763e7d9-7006-470f-8d0a-c0e5c1c11540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072652f37b794ee29ababc447eb9bda6'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:37.619503 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 945/1873] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:04:37 2022] DELETE /identity/v3/users/072652f37b794ee29ababc447eb9bda6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:37.624735 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4d4cf-78da-4c34-893e-18daa0a106cc None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:37.625085 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4d4cf-78da-4c34-893e-18daa0a106cc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:37.625371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4d4cf-78da-4c34-893e-18daa0a106cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:37.677004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2df4d4cf-78da-4c34-893e-18daa0a106cc None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:37.678578 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2df4d4cf-78da-4c34-893e-18daa0a106cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:37.880922 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 929/1874] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:38.004261 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763e7d9-7006-470f-8d0a-c0e5c1c11540 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:38.005896 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f763e7d9-7006-470f-8d0a-c0e5c1c11540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:38.117293 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:38.122349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763e7d9-7006-470f-8d0a-c0e5c1c11540 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:38.129408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75a608-b263-4d53-8fa1-cd5b8998187e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:38.132155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75a608-b263-4d53-8fa1-cd5b8998187e service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:38.133232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75a608-b263-4d53-8fa1-cd5b8998187e service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:38.134710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75a608-b263-4d53-8fa1-cd5b8998187e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:38.166434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75a608-b263-4d53-8fa1-cd5b8998187e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:38.168923 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75a608-b263-4d53-8fa1-cd5b8998187e service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:38.187089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 946/1875] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:04:38.469942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4d4cf-78da-4c34-893e-18daa0a106cc None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:38.471562 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2df4d4cf-78da-4c34-893e-18daa0a106cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:38.495034 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4d4cf-78da-4c34-893e-18daa0a106cc None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:38.510917 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d0c66-2f60-4933-9fec-92808786e2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:38.512701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d0c66-2f60-4933-9fec-92808786e2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:38.513279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d0c66-2f60-4933-9fec-92808786e2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:38.514815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d0c66-2f60-4933-9fec-92808786e2cf admin admin] PATH_INFO: `/v3/projects/b14fa476ccaa46858631f2e568f3b08c` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:38.518915 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d0c66-2f60-4933-9fec-92808786e2cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14fa476ccaa46858631f2e568f3b08c)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:38.524542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d0c66-2f60-4933-9fec-92808786e2cf admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:38.655989 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-db4d0c66-2f60-4933-9fec-92808786e2cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14fa476ccaa46858631f2e568f3b08c', 'request_id': 'req-db4d0c66-2f60-4933-9fec-92808786e2cf'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:38.672782 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-db4d0c66-2f60-4933-9fec-92808786e2cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14fa476ccaa46858631f2e568f3b08c', 'request_id': 'req-db4d0c66-2f60-4933-9fec-92808786e2cf'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:38.687146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-db4d0c66-2f60-4933-9fec-92808786e2cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14fa476ccaa46858631f2e568f3b08c', 'request_id': 'req-db4d0c66-2f60-4933-9fec-92808786e2cf'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:38.715095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-db4d0c66-2f60-4933-9fec-92808786e2cf admin admin] The token cache is being invalidate because project b14fa476ccaa46858631f2e568f3b08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:04:38.716055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-db4d0c66-2f60-4933-9fec-92808786e2cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:38.720902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-db4d0c66-2f60-4933-9fec-92808786e2cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:38.723406 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 930/1876] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:04:38 2022] DELETE /identity/v3/projects/b14fa476ccaa46858631f2e568f3b08c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:38.728188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6a5f7-52c6-43cc-b20d-6616a9f9ce4a None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:38.729009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6a5f7-52c6-43cc-b20d-6616a9f9ce4a None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:38.729009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6a5f7-52c6-43cc-b20d-6616a9f9ce4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:38.777452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-a9c6a5f7-52c6-43cc-b20d-6616a9f9ce4a None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:38.778811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a9c6a5f7-52c6-43cc-b20d-6616a9f9ce4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:38.914405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 947/1877] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:38.922972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d2c47-a5ef-4c1d-bcac-ae2e2bc52c70 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:38.923485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d2c47-a5ef-4c1d-bcac-ae2e2bc52c70 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:38.923485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d2c47-a5ef-4c1d-bcac-ae2e2bc52c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:38.969540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9f0d2c47-a5ef-4c1d-bcac-ae2e2bc52c70 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:38.972182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9f0d2c47-a5ef-4c1d-bcac-ae2e2bc52c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:39.001031 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 931/1878] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:39.005142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6a5f7-52c6-43cc-b20d-6616a9f9ce4a None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:39.023245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6a5f7-52c6-43cc-b20d-6616a9f9ce4a None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:39.034244 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c05166-a8c8-4cef-a13a-4a4d3554b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:39.036721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c05166-a8c8-4cef-a13a-4a4d3554b1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:39.037630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c05166-a8c8-4cef-a13a-4a4d3554b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:39.038129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c05166-a8c8-4cef-a13a-4a4d3554b1c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:39.039055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c05166-a8c8-4cef-a13a-4a4d3554b1c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:04:39.039709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c05166-a8c8-4cef-a13a-4a4d3554b1c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:39.052301 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c05166-a8c8-4cef-a13a-4a4d3554b1c9 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:39.092973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d2c47-a5ef-4c1d-bcac-ae2e2bc52c70 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:39.108307 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 948/1879] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:04:39.108845 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d2c47-a5ef-4c1d-bcac-ae2e2bc52c70 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:39.121826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eb600-79f8-49c6-97ef-eb136823ed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:39.122832 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eb600-79f8-49c6-97ef-eb136823ed93 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:39.123134 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eb600-79f8-49c6-97ef-eb136823ed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:39.123424 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2eb600-79f8-49c6-97ef-eb136823ed93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:39.124176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2eb600-79f8-49c6-97ef-eb136823ed93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:39.131651 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2eb600-79f8-49c6-97ef-eb136823ed93 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:39.183568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 932/1880] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:04:39 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:04:39.187731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c05166-a8c8-4cef-a13a-4a4d3554b1c9 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:39.208631 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c05166-a8c8-4cef-a13a-4a4d3554b1c9 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:39.338695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b070d14-5f38-4555-bed9-d7f2028cd9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:39.339338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b070d14-5f38-4555-bed9-d7f2028cd9df admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:39.339624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b070d14-5f38-4555-bed9-d7f2028cd9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:39.339915 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b070d14-5f38-4555-bed9-d7f2028cd9df admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:39.340584 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b070d14-5f38-4555-bed9-d7f2028cd9df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:39.343465 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b070d14-5f38-4555-bed9-d7f2028cd9df admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:39.388102 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 949/1881] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:04:39 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:04:39.393226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eb600-79f8-49c6-97ef-eb136823ed93 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:39.402608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:39.409530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2eb600-79f8-49c6-97ef-eb136823ed93 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:39.437152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d01e7-0c48-48cc-9978-b81631dd476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:39.437978 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d01e7-0c48-48cc-9978-b81631dd476b admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:39.440146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d01e7-0c48-48cc-9978-b81631dd476b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:39.443000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d01e7-0c48-48cc-9978-b81631dd476b admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:39.444025 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d01e7-0c48-48cc-9978-b81631dd476b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:39.449803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d01e7-0c48-48cc-9978-b81631dd476b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:39.465750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 933/1882] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:39.469448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b070d14-5f38-4555-bed9-d7f2028cd9df admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:39.486299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b070d14-5f38-4555-bed9-d7f2028cd9df admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:39.500637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44dca1-94cb-4c52-93a7-2905383ad310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:39.501272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44dca1-94cb-4c52-93a7-2905383ad310 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:39.501557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44dca1-94cb-4c52-93a7-2905383ad310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:39.501831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44dca1-94cb-4c52-93a7-2905383ad310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:39.502567 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44dca1-94cb-4c52-93a7-2905383ad310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:39.505897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44dca1-94cb-4c52-93a7-2905383ad310 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:39.543671 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 950/1883] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:39.545747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d01e7-0c48-48cc-9978-b81631dd476b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:39.566467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d01e7-0c48-48cc-9978-b81631dd476b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:39.582569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff80b44-c88c-40bc-8712-410ea173beae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:39.583707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff80b44-c88c-40bc-8712-410ea173beae admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:39.584106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff80b44-c88c-40bc-8712-410ea173beae admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:39.584600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff80b44-c88c-40bc-8712-410ea173beae admin admin] PATH_INFO: `/v3/projects/4a229be58da642758a52802fc421fd83/users/28a9c1fb3e064a9ba9c5ee798833b633/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:39.629050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff80b44-c88c-40bc-8712-410ea173beae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a229be58da642758a52802fc421fd83, user_id=28a9c1fb3e064a9ba9c5ee798833b633, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:39.633505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff80b44-c88c-40bc-8712-410ea173beae admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:39.663601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 934/1884] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:04:39 2022] PUT /identity/v3/projects/4a229be58da642758a52802fc421fd83/users/28a9c1fb3e064a9ba9c5ee798833b633/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:04:39.674455 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07638806-9a36-46a6-929b-acbe1251a8bf None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:39.674796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07638806-9a36-46a6-929b-acbe1251a8bf None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:39.674976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07638806-9a36-46a6-929b-acbe1251a8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:39.719494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-07638806-9a36-46a6-929b-acbe1251a8bf None None] MFA Rules not processed for user `28a9c1fb3e064a9ba9c5ee798833b633`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:39.721555 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-07638806-9a36-46a6-929b-acbe1251a8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:39.777193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:39.821678 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 951/1885] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:39.823737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff80b44-c88c-40bc-8712-410ea173beae admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:39.952810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff80b44-c88c-40bc-8712-410ea173beae admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:39.973828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136114cb-1913-43a8-83cf-0fb0d209678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:39.974190 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136114cb-1913-43a8-83cf-0fb0d209678c admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:39.976253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136114cb-1913-43a8-83cf-0fb0d209678c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:39.976253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136114cb-1913-43a8-83cf-0fb0d209678c admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:39.976253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136114cb-1913-43a8-83cf-0fb0d209678c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:39.980773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136114cb-1913-43a8-83cf-0fb0d209678c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:40.061670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 935/1886] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:04:39 2022] POST /identity/v3/projects => generated 383 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:04:40.065864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07638806-9a36-46a6-929b-acbe1251a8bf None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:40.085006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07638806-9a36-46a6-929b-acbe1251a8bf None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:40.218409 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0be24-51ad-48e4-8df3-d811b7203a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:40.219023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0be24-51ad-48e4-8df3-d811b7203a95 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:40.219301 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0be24-51ad-48e4-8df3-d811b7203a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:40.219571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0be24-51ad-48e4-8df3-d811b7203a95 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:40.220258 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0be24-51ad-48e4-8df3-d811b7203a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:40.222836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0be24-51ad-48e4-8df3-d811b7203a95 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:40.250054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 952/1887] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:04:40 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:04:40.253811 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136114cb-1913-43a8-83cf-0fb0d209678c admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:40.272031 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136114cb-1913-43a8-83cf-0fb0d209678c admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:40.282994 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62854ee9-d57c-49d6-a2e2-c0a9c0420775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:40.283984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62854ee9-d57c-49d6-a2e2-c0a9c0420775 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:40.284849 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62854ee9-d57c-49d6-a2e2-c0a9c0420775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:40.286195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62854ee9-d57c-49d6-a2e2-c0a9c0420775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:40.287074 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62854ee9-d57c-49d6-a2e2-c0a9c0420775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:40.291144 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62854ee9-d57c-49d6-a2e2-c0a9c0420775 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:40.310191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0be24-51ad-48e4-8df3-d811b7203a95 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:40.310525 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 936/1888] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:40.326971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0be24-51ad-48e4-8df3-d811b7203a95 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:40.337571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abe1ee-2125-4c6a-b136-672a2887e9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:40.338845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abe1ee-2125-4c6a-b136-672a2887e9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:40.339636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abe1ee-2125-4c6a-b136-672a2887e9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:40.340181 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abe1ee-2125-4c6a-b136-672a2887e9c0 admin admin] PATH_INFO: `/v3/projects/35c91762e06e43aba5fdc13e0c601dd0/users/f9e8edd31bf54072b3dded7088549780/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:40.367214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abe1ee-2125-4c6a-b136-672a2887e9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c91762e06e43aba5fdc13e0c601dd0, user_id=f9e8edd31bf54072b3dded7088549780, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:40.371110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abe1ee-2125-4c6a-b136-672a2887e9c0 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:40.391227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 953/1889] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:04:40 2022] PUT /identity/v3/projects/35c91762e06e43aba5fdc13e0c601dd0/users/f9e8edd31bf54072b3dded7088549780/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:40.399217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62854ee9-d57c-49d6-a2e2-c0a9c0420775 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:40.415241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62854ee9-d57c-49d6-a2e2-c0a9c0420775 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:40.515970 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714d13e-cc03-45c0-b74d-3885afb7878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:40.516606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714d13e-cc03-45c0-b74d-3885afb7878b admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:40.516890 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714d13e-cc03-45c0-b74d-3885afb7878b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:40.517168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714d13e-cc03-45c0-b74d-3885afb7878b admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:40.517869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714d13e-cc03-45c0-b74d-3885afb7878b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:40.520631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714d13e-cc03-45c0-b74d-3885afb7878b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:40.536725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 937/1890] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:40.542372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abe1ee-2125-4c6a-b136-672a2887e9c0 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:40.583279 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abe1ee-2125-4c6a-b136-672a2887e9c0 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:40.597767 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743796fa-c0e2-4dbd-b97d-92cf0cd7bd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:40.598463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743796fa-c0e2-4dbd-b97d-92cf0cd7bd2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:40.598738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743796fa-c0e2-4dbd-b97d-92cf0cd7bd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:40.599017 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743796fa-c0e2-4dbd-b97d-92cf0cd7bd2b admin admin] PATH_INFO: `/v3/projects/35c91762e06e43aba5fdc13e0c601dd0/users/f9e8edd31bf54072b3dded7088549780/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:40.601272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743796fa-c0e2-4dbd-b97d-92cf0cd7bd2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c91762e06e43aba5fdc13e0c601dd0, user_id=f9e8edd31bf54072b3dded7088549780, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:40.605070 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743796fa-c0e2-4dbd-b97d-92cf0cd7bd2b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:40.633470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929b3fd-11ec-43b7-b772-1b89ad7b3097 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:40.633470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929b3fd-11ec-43b7-b772-1b89ad7b3097 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:40.633470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929b3fd-11ec-43b7-b772-1b89ad7b3097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:40.639306 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 954/1891] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:04:40 2022] PUT /identity/v3/projects/35c91762e06e43aba5fdc13e0c601dd0/users/f9e8edd31bf54072b3dded7088549780/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:40.681557 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f929b3fd-11ec-43b7-b772-1b89ad7b3097 None None] MFA Rules not processed for user `f9e8edd31bf54072b3dded7088549780`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:40.682026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f929b3fd-11ec-43b7-b772-1b89ad7b3097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:40.719241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:40.786824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 938/1892] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:40.798436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743796fa-c0e2-4dbd-b97d-92cf0cd7bd2b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:40.804939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-743796fa-c0e2-4dbd-b97d-92cf0cd7bd2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:40.834841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929b3fd-11ec-43b7-b772-1b89ad7b3097 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:40.836485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f929b3fd-11ec-43b7-b772-1b89ad7b3097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:40.919219 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743796fa-c0e2-4dbd-b97d-92cf0cd7bd2b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:40.926761 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba15112-aa56-4814-80c2-b443cdc500af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:40.928033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba15112-aa56-4814-80c2-b443cdc500af service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:40.928487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba15112-aa56-4814-80c2-b443cdc500af service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:40.929872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba15112-aa56-4814-80c2-b443cdc500af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:41.005047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929b3fd-11ec-43b7-b772-1b89ad7b3097 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:41.018401 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:41.019067 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:41.019925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:41.020208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca admin admin] PATH_INFO: `/v3/projects/c36edfe9ec85442eb45b30b4c96a9168` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:41.023732 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c36edfe9ec85442eb45b30b4c96a9168)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:41.026160 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:41.140630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:41.147607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba15112-aa56-4814-80c2-b443cdc500af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:41.149285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba15112-aa56-4814-80c2-b443cdc500af service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:41.156026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c36edfe9ec85442eb45b30b4c96a9168', 'request_id': 'req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:41.164364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 955/1893] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:04:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:04:41.173005 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c36edfe9ec85442eb45b30b4c96a9168', 'request_id': 'req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:41.182837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c36edfe9ec85442eb45b30b4c96a9168', 'request_id': 'req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:41.199394 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca admin admin] The token cache is being invalidate because project c36edfe9ec85442eb45b30b4c96a9168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:04:41.199710 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:41.200397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:41.203994 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 939/1894] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:04:40 2022] DELETE /identity/v3/projects/c36edfe9ec85442eb45b30b4c96a9168 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:41.208703 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2784d-d5d6-432d-971b-b39c0e558294 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:41.209229 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2784d-d5d6-432d-971b-b39c0e558294 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:41.209707 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2784d-d5d6-432d-971b-b39c0e558294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:41.253041 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:41.255860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-09c2784d-d5d6-432d-971b-b39c0e558294 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:41.256711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:41.257296 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-09c2784d-d5d6-432d-971b-b39c0e558294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:41.345536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 956/1895] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:04:41.354635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849940-2128-4b4b-9f22-6c61706abb13 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:41.355038 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849940-2128-4b4b-9f22-6c61706abb13 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:41.355369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849940-2128-4b4b-9f22-6c61706abb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:41.365615 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:41.395811 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2a337-4de0-4ac5-b0ac-c9b9efb500ca admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:41.401440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-42849940-2128-4b4b-9f22-6c61706abb13 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:41.402852 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-42849940-2128-4b4b-9f22-6c61706abb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:41.405576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605a4bd-fa4a-4f05-bb98-caa8e5c0c35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:41.406453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605a4bd-fa4a-4f05-bb98-caa8e5c0c35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:41.406844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605a4bd-fa4a-4f05-bb98-caa8e5c0c35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:41.407133 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605a4bd-fa4a-4f05-bb98-caa8e5c0c35d admin admin] PATH_INFO: `/v3/users/5ab4ccbbee1042f393e5ebb406313ea4` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:41.409319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605a4bd-fa4a-4f05-bb98-caa8e5c0c35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab4ccbbee1042f393e5ebb406313ea4)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:41.412064 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605a4bd-fa4a-4f05-bb98-caa8e5c0c35d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:41.417781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 957/1896] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:41.421986 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849940-2128-4b4b-9f22-6c61706abb13 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:41.440440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849940-2128-4b4b-9f22-6c61706abb13 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:41.451592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadeb7a-bcc0-40bb-a681-ab0f69251dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:41.452732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadeb7a-bcc0-40bb-a681-ab0f69251dde admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:41.453513 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadeb7a-bcc0-40bb-a681-ab0f69251dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:41.455563 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadeb7a-bcc0-40bb-a681-ab0f69251dde admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:41.459648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baadeb7a-bcc0-40bb-a681-ab0f69251dde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:04:41.459648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baadeb7a-bcc0-40bb-a681-ab0f69251dde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:41.462418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baadeb7a-bcc0-40bb-a681-ab0f69251dde admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:41.491015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 958/1897] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:04:41.496123 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadeb7a-bcc0-40bb-a681-ab0f69251dde admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:41.518847 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadeb7a-bcc0-40bb-a681-ab0f69251dde admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:41.526175 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f605a4bd-fa4a-4f05-bb98-caa8e5c0c35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab4ccbbee1042f393e5ebb406313ea4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:41.528354 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dabda8-14a9-45da-836c-e86a2034a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:41.538305 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dabda8-14a9-45da-836c-e86a2034a7bd admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:41.538935 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dabda8-14a9-45da-836c-e86a2034a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:41.539605 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dabda8-14a9-45da-836c-e86a2034a7bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:41.541246 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f605a4bd-fa4a-4f05-bb98-caa8e5c0c35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab4ccbbee1042f393e5ebb406313ea4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:41.541851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dabda8-14a9-45da-836c-e86a2034a7bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:41.544064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dabda8-14a9-45da-836c-e86a2034a7bd admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:41.577044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f605a4bd-fa4a-4f05-bb98-caa8e5c0c35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab4ccbbee1042f393e5ebb406313ea4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:41.599524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f605a4bd-fa4a-4f05-bb98-caa8e5c0c35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab4ccbbee1042f393e5ebb406313ea4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:41.600894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 959/1898] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:04:41 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:04:41.604025 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f605a4bd-fa4a-4f05-bb98-caa8e5c0c35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab4ccbbee1042f393e5ebb406313ea4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:41.606128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dabda8-14a9-45da-836c-e86a2034a7bd admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:41.608427 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-30dabda8-14a9-45da-836c-e86a2034a7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:41.618560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 940/1899] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:04:41 2022] DELETE /identity/v3/users/5ab4ccbbee1042f393e5ebb406313ea4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:41.622990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661d809-2a80-4a97-873a-7ff1262fbfb9 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:41.623138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661d809-2a80-4a97-873a-7ff1262fbfb9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:41.623466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661d809-2a80-4a97-873a-7ff1262fbfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:41.672118 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2661d809-2a80-4a97-873a-7ff1262fbfb9 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:41.672987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2661d809-2a80-4a97-873a-7ff1262fbfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:41.756119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dabda8-14a9-45da-836c-e86a2034a7bd admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:41.834240 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 941/1900] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:41.847288 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661d809-2a80-4a97-873a-7ff1262fbfb9 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:41.849839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2661d809-2a80-4a97-873a-7ff1262fbfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:41.872548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0561f-d35b-47ba-9583-f3ae7976cd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:41.873178 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0561f-d35b-47ba-9583-f3ae7976cd0c admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:41.873986 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0561f-d35b-47ba-9583-f3ae7976cd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:41.873986 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0561f-d35b-47ba-9583-f3ae7976cd0c admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:41.874294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0561f-d35b-47ba-9583-f3ae7976cd0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:41.876262 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0561f-d35b-47ba-9583-f3ae7976cd0c admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:41.899234 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:41.958062 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 960/1901] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:04:41 2022] POST /identity/v3/users => generated 287 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:04:41.962933 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0561f-d35b-47ba-9583-f3ae7976cd0c admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:41.979862 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661d809-2a80-4a97-873a-7ff1262fbfb9 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:41.984649 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b5209-20b2-4159-ae0c-fab668951544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:41.985406 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b5209-20b2-4159-ae0c-fab668951544 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:41.986129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b5209-20b2-4159-ae0c-fab668951544 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:41.986459 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b5209-20b2-4159-ae0c-fab668951544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:41.987738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0561f-d35b-47ba-9583-f3ae7976cd0c admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:42.000820 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee7c7a-cfe1-43d6-9df1-92df4ff1d4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:42.001950 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee7c7a-cfe1-43d6-9df1-92df4ff1d4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:42.002411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee7c7a-cfe1-43d6-9df1-92df4ff1d4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:42.002975 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee7c7a-cfe1-43d6-9df1-92df4ff1d4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:42.004352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b5209-20b2-4159-ae0c-fab668951544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:42.004753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee7c7a-cfe1-43d6-9df1-92df4ff1d4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:42.007673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b5209-20b2-4159-ae0c-fab668951544 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:42.010349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee7c7a-cfe1-43d6-9df1-92df4ff1d4f4 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:42.021401 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 942/1902] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:04:42.058133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 961/1903] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:42.064022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b5209-20b2-4159-ae0c-fab668951544 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:42.105305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b5209-20b2-4159-ae0c-fab668951544 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:42.128467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86484c-6bef-480a-9bd7-7d5446a9233f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:42.129162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86484c-6bef-480a-9bd7-7d5446a9233f admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:42.129444 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86484c-6bef-480a-9bd7-7d5446a9233f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:42.129804 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86484c-6bef-480a-9bd7-7d5446a9233f admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:42.130484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86484c-6bef-480a-9bd7-7d5446a9233f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:42.132392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee7c7a-cfe1-43d6-9df1-92df4ff1d4f4 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:42.133305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86484c-6bef-480a-9bd7-7d5446a9233f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:42.134244 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a3ee7c7a-cfe1-43d6-9df1-92df4ff1d4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:42.158058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee7c7a-cfe1-43d6-9df1-92df4ff1d4f4 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:42.158555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 943/1904] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:42.163549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86484c-6bef-480a-9bd7-7d5446a9233f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:42.166841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdefacf-26b8-4524-a6bf-1ab7bbd6d20f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:42.167474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdefacf-26b8-4524-a6bf-1ab7bbd6d20f service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:42.167751 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdefacf-26b8-4524-a6bf-1ab7bbd6d20f service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:42.168117 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdefacf-26b8-4524-a6bf-1ab7bbd6d20f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:42.174391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9bdefacf-26b8-4524-a6bf-1ab7bbd6d20f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:42.178941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:42.189581 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86484c-6bef-480a-9bd7-7d5446a9233f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:42.199937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3265785-325e-4fa0-97c9-ac86b002c6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:42.200920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3265785-325e-4fa0-97c9-ac86b002c6f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:42.202431 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3265785-325e-4fa0-97c9-ac86b002c6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:42.203557 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3265785-325e-4fa0-97c9-ac86b002c6f1 admin admin] PATH_INFO: `/v3/projects/15fa784a7ad94c7caf3b7e7cd2ab42d6/users/c8238b59d0ee46b0a0f09e170a9510ec/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:42.226004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3265785-325e-4fa0-97c9-ac86b002c6f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15fa784a7ad94c7caf3b7e7cd2ab42d6, user_id=c8238b59d0ee46b0a0f09e170a9510ec, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:42.229210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3265785-325e-4fa0-97c9-ac86b002c6f1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:42.250495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 944/1905] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:04:42 2022] PUT /identity/v3/projects/15fa784a7ad94c7caf3b7e7cd2ab42d6/users/c8238b59d0ee46b0a0f09e170a9510ec/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:42.263282 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74492e-fa45-4376-a503-d1d916ea3c89 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:42.263652 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74492e-fa45-4376-a503-d1d916ea3c89 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:42.264165 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74492e-fa45-4376-a503-d1d916ea3c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:42.304413 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3f74492e-fa45-4376-a503-d1d916ea3c89 None None] MFA Rules not processed for user `c8238b59d0ee46b0a0f09e170a9510ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:42.305860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdefacf-26b8-4524-a6bf-1ab7bbd6d20f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:42.307497 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3f74492e-fa45-4376-a503-d1d916ea3c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:42.328140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdefacf-26b8-4524-a6bf-1ab7bbd6d20f service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:42.352956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 962/1906] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:04:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:04:42.421023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 945/1907] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:04:42.441895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdefacf-26b8-4524-a6bf-1ab7bbd6d20f service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:42.498809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdefacf-26b8-4524-a6bf-1ab7bbd6d20f service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:42.509729 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74492e-fa45-4376-a503-d1d916ea3c89 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:42.511525 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3f74492e-fa45-4376-a503-d1d916ea3c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:42.660561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d9682-30f4-4200-b062-db3af19dc339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:42.661481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d9682-30f4-4200-b062-db3af19dc339 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:42.661761 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d9682-30f4-4200-b062-db3af19dc339 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:42.662028 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d9682-30f4-4200-b062-db3af19dc339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:42.680211 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74492e-fa45-4376-a503-d1d916ea3c89 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:42.684416 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d9682-30f4-4200-b062-db3af19dc339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:42.686456 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d9682-30f4-4200-b062-db3af19dc339 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:42.695152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:42.695152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:42.695478 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:42.695575 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08 admin admin] PATH_INFO: `/v3/projects/d4b1db75b60b4f43a192f73f630784cc` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:42.697872 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b1db75b60b4f43a192f73f630784cc)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:42.701077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:42.711125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 963/1908] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:04:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:04:42.816140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b1db75b60b4f43a192f73f630784cc', 'request_id': 'req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:42.829216 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b1db75b60b4f43a192f73f630784cc', 'request_id': 'req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:42.846345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b1db75b60b4f43a192f73f630784cc', 'request_id': 'req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:42.861183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:42.883967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08 admin admin] The token cache is being invalidate because project d4b1db75b60b4f43a192f73f630784cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:04:42.884489 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:42.886738 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:42.894277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 946/1909] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:04:42 2022] DELETE /identity/v3/projects/d4b1db75b60b4f43a192f73f630784cc => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:42.899458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d9682-30f4-4200-b062-db3af19dc339 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:42.925342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d9682-30f4-4200-b062-db3af19dc339 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:43.028210 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef487d1-6030-49ea-abaa-e9c22150c727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:43.029062 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef487d1-6030-49ea-abaa-e9c22150c727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:43.029727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef487d1-6030-49ea-abaa-e9c22150c727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:43.029727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef487d1-6030-49ea-abaa-e9c22150c727 admin admin] PATH_INFO: `/v3/users/ea1aed5324ee49ea9a03879bc5683e0d` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:43.031291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef487d1-6030-49ea-abaa-e9c22150c727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea1aed5324ee49ea9a03879bc5683e0d)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:43.033460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef487d1-6030-49ea-abaa-e9c22150c727 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:43.085638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:43.163125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fef487d1-6030-49ea-abaa-e9c22150c727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea1aed5324ee49ea9a03879bc5683e0d'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:43.181979 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fef487d1-6030-49ea-abaa-e9c22150c727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea1aed5324ee49ea9a03879bc5683e0d'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:43.206594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fef487d1-6030-49ea-abaa-e9c22150c727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea1aed5324ee49ea9a03879bc5683e0d'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:43.208369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fef487d1-6030-49ea-abaa-e9c22150c727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea1aed5324ee49ea9a03879bc5683e0d'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:43.209131 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fef487d1-6030-49ea-abaa-e9c22150c727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea1aed5324ee49ea9a03879bc5683e0d'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:43.268585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 964/1910] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:04:42 2022] DELETE /identity/v3/users/ea1aed5324ee49ea9a03879bc5683e0d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:44.967694 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:44.969608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:45.000118 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a662a-12a9-40e4-a4bf-b32fc1d9fb08 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:45.165367 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96925657-94be-4a12-b850-b230d612ea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:45.166209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96925657-94be-4a12-b850-b230d612ea0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:45.166732 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96925657-94be-4a12-b850-b230d612ea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:45.167223 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96925657-94be-4a12-b850-b230d612ea0b admin admin] PATH_INFO: `/v3/projects/d134d70835c1449d962e8b6a7a8006c2` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:45.168860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96925657-94be-4a12-b850-b230d612ea0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d134d70835c1449d962e8b6a7a8006c2)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:45.171212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96925657-94be-4a12-b850-b230d612ea0b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:45.290206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-96925657-94be-4a12-b850-b230d612ea0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd134d70835c1449d962e8b6a7a8006c2', 'request_id': 'req-96925657-94be-4a12-b850-b230d612ea0b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:45.307029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-96925657-94be-4a12-b850-b230d612ea0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd134d70835c1449d962e8b6a7a8006c2', 'request_id': 'req-96925657-94be-4a12-b850-b230d612ea0b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:45.331013 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-96925657-94be-4a12-b850-b230d612ea0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd134d70835c1449d962e8b6a7a8006c2', 'request_id': 'req-96925657-94be-4a12-b850-b230d612ea0b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:45.364336 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-96925657-94be-4a12-b850-b230d612ea0b admin admin] The token cache is being invalidate because project d134d70835c1449d962e8b6a7a8006c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:04:45.364704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-96925657-94be-4a12-b850-b230d612ea0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:45.366468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-96925657-94be-4a12-b850-b230d612ea0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:45.370811 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 947/1911] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:04:44 2022] DELETE /identity/v3/projects/d134d70835c1449d962e8b6a7a8006c2 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:45.375939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553ca1c-6f0a-4fb5-a2f5-732c93eec9f1 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:45.376773 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553ca1c-6f0a-4fb5-a2f5-732c93eec9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:45.377195 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553ca1c-6f0a-4fb5-a2f5-732c93eec9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:45.419614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-d553ca1c-6f0a-4fb5-a2f5-732c93eec9f1 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:45.421791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d553ca1c-6f0a-4fb5-a2f5-732c93eec9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:45.554037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 965/1912] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:04:45.565438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f2e31-9349-4b38-a5c6-3918eb9d8ad8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:45.565931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f2e31-9349-4b38-a5c6-3918eb9d8ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:45.580474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f2e31-9349-4b38-a5c6-3918eb9d8ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:45.669630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a16f2e31-9349-4b38-a5c6-3918eb9d8ad8 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:45.670931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a16f2e31-9349-4b38-a5c6-3918eb9d8ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:45.699113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 948/1913] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:45.703075 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553ca1c-6f0a-4fb5-a2f5-732c93eec9f1 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:45.714417 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553ca1c-6f0a-4fb5-a2f5-732c93eec9f1 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:45.734297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d052f-0b87-43a2-a061-29fa75ec7158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:45.735941 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d052f-0b87-43a2-a061-29fa75ec7158 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:45.736632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d052f-0b87-43a2-a061-29fa75ec7158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:45.739814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d052f-0b87-43a2-a061-29fa75ec7158 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:45.741216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d052f-0b87-43a2-a061-29fa75ec7158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:04:45.741754 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d052f-0b87-43a2-a061-29fa75ec7158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:45.743800 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d052f-0b87-43a2-a061-29fa75ec7158 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:45.758669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 966/1914] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:04:45.763359 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f2e31-9349-4b38-a5c6-3918eb9d8ad8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:45.777361 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f2e31-9349-4b38-a5c6-3918eb9d8ad8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:45.785227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339687b-3089-4819-874e-33150e67b166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:45.786206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339687b-3089-4819-874e-33150e67b166 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:45.786631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339687b-3089-4819-874e-33150e67b166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:45.787032 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339687b-3089-4819-874e-33150e67b166 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:45.788091 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339687b-3089-4819-874e-33150e67b166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:45.791239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339687b-3089-4819-874e-33150e67b166 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:45.842761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 949/1915] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:04:45 2022] POST /identity/v3/projects => generated 391 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:04:45.846773 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d052f-0b87-43a2-a061-29fa75ec7158 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:45.859667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d052f-0b87-43a2-a061-29fa75ec7158 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:46.009392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb4ea0-204a-428d-94e8-cecb713dc0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:46.010088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb4ea0-204a-428d-94e8-cecb713dc0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:46.010742 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb4ea0-204a-428d-94e8-cecb713dc0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:46.010742 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb4ea0-204a-428d-94e8-cecb713dc0b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:46.011486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb4ea0-204a-428d-94e8-cecb713dc0b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:46.013717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb4ea0-204a-428d-94e8-cecb713dc0b6 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:46.101043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 967/1916] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:04:45 2022] POST /identity/v3/users => generated 296 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:04:46.102274 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339687b-3089-4819-874e-33150e67b166 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:46.119978 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339687b-3089-4819-874e-33150e67b166 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:46.134290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a20a4-97f3-43ec-b4e2-8f3665357380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:46.136628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a20a4-97f3-43ec-b4e2-8f3665357380 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:46.137751 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a20a4-97f3-43ec-b4e2-8f3665357380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:46.138233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a20a4-97f3-43ec-b4e2-8f3665357380 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:46.140903 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a20a4-97f3-43ec-b4e2-8f3665357380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:46.147731 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a20a4-97f3-43ec-b4e2-8f3665357380 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:46.185387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 950/1917] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:46.189118 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb4ea0-204a-428d-94e8-cecb713dc0b6 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:46.210805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb4ea0-204a-428d-94e8-cecb713dc0b6 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:46.226794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7958d-96d8-4406-8f52-0184adb5d6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:46.227572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7958d-96d8-4406-8f52-0184adb5d6de admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:46.227856 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7958d-96d8-4406-8f52-0184adb5d6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:46.228163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7958d-96d8-4406-8f52-0184adb5d6de admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:46.228844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7958d-96d8-4406-8f52-0184adb5d6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:46.230527 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7958d-96d8-4406-8f52-0184adb5d6de admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:46.245914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:46.265962 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 968/1918] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:46.271372 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a20a4-97f3-43ec-b4e2-8f3665357380 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:46.284145 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a20a4-97f3-43ec-b4e2-8f3665357380 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:46.302556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a5699-8f94-4218-8e56-27b7256cc5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:46.304050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a5699-8f94-4218-8e56-27b7256cc5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:46.304367 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a5699-8f94-4218-8e56-27b7256cc5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:46.305042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a5699-8f94-4218-8e56-27b7256cc5b9 admin admin] PATH_INFO: `/v3/projects/98ec50f0ec344d0ebefda92e333960d8/users/f6af2d3f99294190980215974998321f/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:46.348670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a5699-8f94-4218-8e56-27b7256cc5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ec50f0ec344d0ebefda92e333960d8, user_id=f6af2d3f99294190980215974998321f, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:46.354992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a5699-8f94-4218-8e56-27b7256cc5b9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:46.384120 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 951/1919] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:04:46 2022] PUT /identity/v3/projects/98ec50f0ec344d0ebefda92e333960d8/users/f6af2d3f99294190980215974998321f/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:04:46.397592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68201351-c9da-464f-b78f-edc5c76e4790 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:46.398570 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68201351-c9da-464f-b78f-edc5c76e4790 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:46.399046 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68201351-c9da-464f-b78f-edc5c76e4790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:46.463384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-68201351-c9da-464f-b78f-edc5c76e4790 None None] MFA Rules not processed for user `f6af2d3f99294190980215974998321f`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:46.464848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-68201351-c9da-464f-b78f-edc5c76e4790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:46.647819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 969/1920] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:46.712932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a5699-8f94-4218-8e56-27b7256cc5b9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:46.718075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bf3a5699-8f94-4218-8e56-27b7256cc5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:46.799415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:46.873530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a5699-8f94-4218-8e56-27b7256cc5b9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:46.885517 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6ecef-64b6-4f5f-a3dd-15a2e09a368f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:46.886149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6ecef-64b6-4f5f-a3dd-15a2e09a368f service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:46.886435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6ecef-64b6-4f5f-a3dd-15a2e09a368f service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:46.886713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6ecef-64b6-4f5f-a3dd-15a2e09a368f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:46.905816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6ecef-64b6-4f5f-a3dd-15a2e09a368f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:46.907245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6ecef-64b6-4f5f-a3dd-15a2e09a368f service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:46.935141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 952/1921] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:04:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:04:48.397451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68201351-c9da-464f-b78f-edc5c76e4790 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:48.399702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-68201351-c9da-464f-b78f-edc5c76e4790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:48.539455 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68201351-c9da-464f-b78f-edc5c76e4790 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:48.546440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c390d03-b24e-4dc8-977b-196a7fea37ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:48.547837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c390d03-b24e-4dc8-977b-196a7fea37ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:48.547837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c390d03-b24e-4dc8-977b-196a7fea37ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:48.547837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c390d03-b24e-4dc8-977b-196a7fea37ce admin admin] PATH_INFO: `/v3/users/2b963f39a6204ab8b96aa54de6dbb1ef` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:48.549565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c390d03-b24e-4dc8-977b-196a7fea37ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b963f39a6204ab8b96aa54de6dbb1ef)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:48.552129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c390d03-b24e-4dc8-977b-196a7fea37ce admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:48.640086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4c390d03-b24e-4dc8-977b-196a7fea37ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b963f39a6204ab8b96aa54de6dbb1ef'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:48.653072 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4c390d03-b24e-4dc8-977b-196a7fea37ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b963f39a6204ab8b96aa54de6dbb1ef'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:48.680717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4c390d03-b24e-4dc8-977b-196a7fea37ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b963f39a6204ab8b96aa54de6dbb1ef'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:48.682040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4c390d03-b24e-4dc8-977b-196a7fea37ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b963f39a6204ab8b96aa54de6dbb1ef'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:48.682882 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4c390d03-b24e-4dc8-977b-196a7fea37ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b963f39a6204ab8b96aa54de6dbb1ef'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:48.729092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 970/1922] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:04:48 2022] DELETE /identity/v3/users/2b963f39a6204ab8b96aa54de6dbb1ef => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:49.627522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6ecef-64b6-4f5f-a3dd-15a2e09a368f service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:49.659435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6ecef-64b6-4f5f-a3dd-15a2e09a368f service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:49.801602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859c99f-68bf-4e06-ac94-e95dd3f46777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:49.802275 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859c99f-68bf-4e06-ac94-e95dd3f46777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:49.802562 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859c99f-68bf-4e06-ac94-e95dd3f46777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:49.802837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859c99f-68bf-4e06-ac94-e95dd3f46777 admin admin] PATH_INFO: `/v3/projects/8baa89c5ef0a4ae6b6732960ef00712a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:49.812859 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859c99f-68bf-4e06-ac94-e95dd3f46777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8baa89c5ef0a4ae6b6732960ef00712a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:49.815419 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859c99f-68bf-4e06-ac94-e95dd3f46777 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:49.945935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8859c99f-68bf-4e06-ac94-e95dd3f46777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8baa89c5ef0a4ae6b6732960ef00712a', 'request_id': 'req-8859c99f-68bf-4e06-ac94-e95dd3f46777'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:49.964341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8859c99f-68bf-4e06-ac94-e95dd3f46777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8baa89c5ef0a4ae6b6732960ef00712a', 'request_id': 'req-8859c99f-68bf-4e06-ac94-e95dd3f46777'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:49.977773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8859c99f-68bf-4e06-ac94-e95dd3f46777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8baa89c5ef0a4ae6b6732960ef00712a', 'request_id': 'req-8859c99f-68bf-4e06-ac94-e95dd3f46777'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:50.033085 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8859c99f-68bf-4e06-ac94-e95dd3f46777 admin admin] The token cache is being invalidate because project 8baa89c5ef0a4ae6b6732960ef00712a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:04:50.033085 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8859c99f-68bf-4e06-ac94-e95dd3f46777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:50.034913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8859c99f-68bf-4e06-ac94-e95dd3f46777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:04:50.038271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 953/1923] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:04:49 2022] DELETE /identity/v3/projects/8baa89c5ef0a4ae6b6732960ef00712a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:50.043347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6473728-5e3d-4175-b84f-37e7bd1aa0b6 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:50.043812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6473728-5e3d-4175-b84f-37e7bd1aa0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:50.044108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6473728-5e3d-4175-b84f-37e7bd1aa0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:50.094886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-d6473728-5e3d-4175-b84f-37e7bd1aa0b6 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:50.096298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d6473728-5e3d-4175-b84f-37e7bd1aa0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:50.119120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:50.208641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 971/1924] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:50.211185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491206f-85f5-44bc-a83e-08761414bad3 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:50.211652 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491206f-85f5-44bc-a83e-08761414bad3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:50.212802 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491206f-85f5-44bc-a83e-08761414bad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:50.270353 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e491206f-85f5-44bc-a83e-08761414bad3 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:50.273727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e491206f-85f5-44bc-a83e-08761414bad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:50.306579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 954/1925] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:04:50.309534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6473728-5e3d-4175-b84f-37e7bd1aa0b6 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:50.342360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6473728-5e3d-4175-b84f-37e7bd1aa0b6 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:50.354795 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea856ad-19da-4f98-9e06-686a24e64126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:50.357943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea856ad-19da-4f98-9e06-686a24e64126 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:50.359229 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea856ad-19da-4f98-9e06-686a24e64126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:50.360545 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea856ad-19da-4f98-9e06-686a24e64126 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:50.364648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea856ad-19da-4f98-9e06-686a24e64126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:04:50.365772 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea856ad-19da-4f98-9e06-686a24e64126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:50.371388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea856ad-19da-4f98-9e06-686a24e64126 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:50.425221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491206f-85f5-44bc-a83e-08761414bad3 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:50.425705 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 972/1926] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:04:50.450662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491206f-85f5-44bc-a83e-08761414bad3 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:50.465216 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f36b86-1a74-4eed-b8ae-ffdbe1b4e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:50.465872 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f36b86-1a74-4eed-b8ae-ffdbe1b4e021 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:50.466153 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f36b86-1a74-4eed-b8ae-ffdbe1b4e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:50.466423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f36b86-1a74-4eed-b8ae-ffdbe1b4e021 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:50.468881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f36b86-1a74-4eed-b8ae-ffdbe1b4e021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:50.480220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f36b86-1a74-4eed-b8ae-ffdbe1b4e021 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:50.579152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 955/1927] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:04:50 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:04:50.579611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea856ad-19da-4f98-9e06-686a24e64126 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:50.601432 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea856ad-19da-4f98-9e06-686a24e64126 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:50.720513 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe4683-605d-4bec-949d-3bc1f48c2e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:50.721193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4683-605d-4bec-949d-3bc1f48c2e40 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:50.721505 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4683-605d-4bec-949d-3bc1f48c2e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:50.721808 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe4683-605d-4bec-949d-3bc1f48c2e40 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:50.722716 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe4683-605d-4bec-949d-3bc1f48c2e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:50.726003 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe4683-605d-4bec-949d-3bc1f48c2e40 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:50.768273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 973/1928] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:04:50 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:04:50.769789 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f36b86-1a74-4eed-b8ae-ffdbe1b4e021 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:50.796595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f36b86-1a74-4eed-b8ae-ffdbe1b4e021 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:50.806140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84722395-dc92-4bcc-adde-1c061cc18f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:50.806965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84722395-dc92-4bcc-adde-1c061cc18f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:50.807523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84722395-dc92-4bcc-adde-1c061cc18f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:50.808225 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84722395-dc92-4bcc-adde-1c061cc18f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:50.809787 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84722395-dc92-4bcc-adde-1c061cc18f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:50.819002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84722395-dc92-4bcc-adde-1c061cc18f5b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:50.844941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 956/1929] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:04:50.850582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe4683-605d-4bec-949d-3bc1f48c2e40 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:50.866140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe4683-605d-4bec-949d-3bc1f48c2e40 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:50.871635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f768195-f3f3-4dca-ac5a-6d89a5addc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:50.873441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f768195-f3f3-4dca-ac5a-6d89a5addc92 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:50.873441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f768195-f3f3-4dca-ac5a-6d89a5addc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:50.873441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f768195-f3f3-4dca-ac5a-6d89a5addc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:50.875702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f768195-f3f3-4dca-ac5a-6d89a5addc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:50.876577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f768195-f3f3-4dca-ac5a-6d89a5addc92 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:50.901292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 974/1930] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:50.903023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84722395-dc92-4bcc-adde-1c061cc18f5b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:50.917367 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84722395-dc92-4bcc-adde-1c061cc18f5b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:50.930459 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca366a-e7fd-4063-a389-8735c454f871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:50.933692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca366a-e7fd-4063-a389-8735c454f871 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:50.934242 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca366a-e7fd-4063-a389-8735c454f871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:50.934910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca366a-e7fd-4063-a389-8735c454f871 admin admin] PATH_INFO: `/v3/projects/7117d650ba7f41bd805a064feb0bd6cf/users/889455382b4549f5a90daad1278c039f/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:50.981238 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca366a-e7fd-4063-a389-8735c454f871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7117d650ba7f41bd805a064feb0bd6cf, user_id=889455382b4549f5a90daad1278c039f, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:50.985272 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca366a-e7fd-4063-a389-8735c454f871 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:50.990003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:51.023609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 957/1931] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:04:50 2022] PUT /identity/v3/projects/7117d650ba7f41bd805a064feb0bd6cf/users/889455382b4549f5a90daad1278c039f/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:51.026387 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec246310-1057-4c47-a65a-991acd3dd232 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:51.027492 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec246310-1057-4c47-a65a-991acd3dd232 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:51.028021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec246310-1057-4c47-a65a-991acd3dd232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:51.077997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-ec246310-1057-4c47-a65a-991acd3dd232 None None] MFA Rules not processed for user `889455382b4549f5a90daad1278c039f`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:51.084309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ec246310-1057-4c47-a65a-991acd3dd232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:51.240555 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 975/1932] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:04:51.244899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca366a-e7fd-4063-a389-8735c454f871 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:51.379884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca366a-e7fd-4063-a389-8735c454f871 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:51.388648 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4335-1592-439a-936a-ef9917388695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:51.391410 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4335-1592-439a-936a-ef9917388695 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:51.393129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4335-1592-439a-936a-ef9917388695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:51.393518 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4335-1592-439a-936a-ef9917388695 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:51.395215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae4335-1592-439a-936a-ef9917388695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:51.398507 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae4335-1592-439a-936a-ef9917388695 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:51.450993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 958/1933] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:04:51 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:04:51.458019 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec246310-1057-4c47-a65a-991acd3dd232 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:51.469637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:51.475648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec246310-1057-4c47-a65a-991acd3dd232 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:51.600207 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e619e-036a-46df-9cac-ea6aa56472dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:51.600840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e619e-036a-46df-9cac-ea6aa56472dd admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:51.601126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e619e-036a-46df-9cac-ea6aa56472dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:51.601417 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e619e-036a-46df-9cac-ea6aa56472dd admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:51.602052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e619e-036a-46df-9cac-ea6aa56472dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:51.607688 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e619e-036a-46df-9cac-ea6aa56472dd admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:51.680349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 976/1934] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:04:51 2022] POST /identity/v3/users => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:04:51.683402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4335-1592-439a-936a-ef9917388695 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:51.699236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4335-1592-439a-936a-ef9917388695 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:51.708816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8652f9c-9b7e-4dd8-890e-b1a774afa993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:51.711193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8652f9c-9b7e-4dd8-890e-b1a774afa993 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:51.711761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8652f9c-9b7e-4dd8-890e-b1a774afa993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:51.712429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8652f9c-9b7e-4dd8-890e-b1a774afa993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:51.716080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8652f9c-9b7e-4dd8-890e-b1a774afa993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:51.721318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8652f9c-9b7e-4dd8-890e-b1a774afa993 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:51.742724 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 959/1935] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:51.744035 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e619e-036a-46df-9cac-ea6aa56472dd admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:51.754466 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e619e-036a-46df-9cac-ea6aa56472dd admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:51.759349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2f402-9b0c-4976-9a58-47120527c4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:51.760063 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2f402-9b0c-4976-9a58-47120527c4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:51.760342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2f402-9b0c-4976-9a58-47120527c4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:51.760614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2f402-9b0c-4976-9a58-47120527c4f8 admin admin] PATH_INFO: `/v3/projects/c78a51d772c74b2a986986b4995208e7/users/975a42ea803d455e8f028c00ff564837/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:51.795221 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2f402-9b0c-4976-9a58-47120527c4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78a51d772c74b2a986986b4995208e7, user_id=975a42ea803d455e8f028c00ff564837, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:51.801575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2f402-9b0c-4976-9a58-47120527c4f8 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:51.831540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8652f9c-9b7e-4dd8-890e-b1a774afa993 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:51.848887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 977/1936] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:04:51 2022] PUT /identity/v3/projects/c78a51d772c74b2a986986b4995208e7/users/975a42ea803d455e8f028c00ff564837/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:51.855573 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8652f9c-9b7e-4dd8-890e-b1a774afa993 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:51.982191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59719047-cab9-4e99-a647-37c4a7a66561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:51.982887 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59719047-cab9-4e99-a647-37c4a7a66561 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:51.983172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59719047-cab9-4e99-a647-37c4a7a66561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:51.983443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59719047-cab9-4e99-a647-37c4a7a66561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:51.984178 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59719047-cab9-4e99-a647-37c4a7a66561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:51.989193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59719047-cab9-4e99-a647-37c4a7a66561 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:52.021493 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 960/1937] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:04:52.025365 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2f402-9b0c-4976-9a58-47120527c4f8 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:52.066821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2f402-9b0c-4976-9a58-47120527c4f8 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:52.073984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ac5de-d634-4a5a-ad31-b5149d78b115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:52.077535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ac5de-d634-4a5a-ad31-b5149d78b115 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:52.078404 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ac5de-d634-4a5a-ad31-b5149d78b115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:52.079284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ac5de-d634-4a5a-ad31-b5149d78b115 admin admin] PATH_INFO: `/v3/projects/c78a51d772c74b2a986986b4995208e7/users/975a42ea803d455e8f028c00ff564837/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:52.102594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ac5de-d634-4a5a-ad31-b5149d78b115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78a51d772c74b2a986986b4995208e7, user_id=975a42ea803d455e8f028c00ff564837, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:52.107078 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ac5de-d634-4a5a-ad31-b5149d78b115 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:52.145258 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e454c7-f8d0-422f-88bc-39c870998125 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:52.145258 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e454c7-f8d0-422f-88bc-39c870998125 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:52.145258 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e454c7-f8d0-422f-88bc-39c870998125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:52.150583 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 978/1938] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:04:52 2022] PUT /identity/v3/projects/c78a51d772c74b2a986986b4995208e7/users/975a42ea803d455e8f028c00ff564837/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:52.204240 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d5e454c7-f8d0-422f-88bc-39c870998125 None None] MFA Rules not processed for user `975a42ea803d455e8f028c00ff564837`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:04:52.206798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d5e454c7-f8d0-422f-88bc-39c870998125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:52.334507 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:52.389435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 961/1939] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:04:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:04:52.414892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ac5de-d634-4a5a-ad31-b5149d78b115 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:04:52.418940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9a0ac5de-d634-4a5a-ad31-b5149d78b115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:04:52.607891 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ac5de-d634-4a5a-ad31-b5149d78b115 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:04:52.619532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d453e29-93fd-4db7-9e23-47548fc306fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:04:52.620345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d453e29-93fd-4db7-9e23-47548fc306fa service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:04:52.620631 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d453e29-93fd-4db7-9e23-47548fc306fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:04:52.620927 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d453e29-93fd-4db7-9e23-47548fc306fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:04:52.632618 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d453e29-93fd-4db7-9e23-47548fc306fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:04:52.634091 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d453e29-93fd-4db7-9e23-47548fc306fa service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:04:52.658581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 979/1940] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:04:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:05:01.858716 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e454c7-f8d0-422f-88bc-39c870998125 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:01.957467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e454c7-f8d0-422f-88bc-39c870998125 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:01.962460 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812b89f-26b1-4efe-a4ee-fbf7ae68efaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:01.963129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812b89f-26b1-4efe-a4ee-fbf7ae68efaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:01.963410 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812b89f-26b1-4efe-a4ee-fbf7ae68efaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:01.963688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812b89f-26b1-4efe-a4ee-fbf7ae68efaf admin admin] PATH_INFO: `/v3/users/889455382b4549f5a90daad1278c039f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:01.964896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812b89f-26b1-4efe-a4ee-fbf7ae68efaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=889455382b4549f5a90daad1278c039f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:01.966856 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812b89f-26b1-4efe-a4ee-fbf7ae68efaf admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:02.052666 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c812b89f-26b1-4efe-a4ee-fbf7ae68efaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889455382b4549f5a90daad1278c039f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:02.071818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c812b89f-26b1-4efe-a4ee-fbf7ae68efaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889455382b4549f5a90daad1278c039f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:02.109349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c812b89f-26b1-4efe-a4ee-fbf7ae68efaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889455382b4549f5a90daad1278c039f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:02.124632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c812b89f-26b1-4efe-a4ee-fbf7ae68efaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889455382b4549f5a90daad1278c039f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:02.125700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c812b89f-26b1-4efe-a4ee-fbf7ae68efaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889455382b4549f5a90daad1278c039f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:02.141111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 962/1941] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:05:01 2022] DELETE /identity/v3/users/889455382b4549f5a90daad1278c039f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:02.142661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572b287-afc1-4732-b055-6dc38e8f4ba4 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:02.143164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572b287-afc1-4732-b055-6dc38e8f4ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:02.143242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572b287-afc1-4732-b055-6dc38e8f4ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:02.194364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-1572b287-afc1-4732-b055-6dc38e8f4ba4 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:02.196088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1572b287-afc1-4732-b055-6dc38e8f4ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:02.352687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:02.372981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 980/1942] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:05:02.446332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812b89f-26b1-4efe-a4ee-fbf7ae68efaf admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:02.450136 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c812b89f-26b1-4efe-a4ee-fbf7ae68efaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:02.588471 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812b89f-26b1-4efe-a4ee-fbf7ae68efaf admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:02.593369 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d17ab-9d14-4bdc-8b35-2a95cc661dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:02.594417 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d17ab-9d14-4bdc-8b35-2a95cc661dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:02.594694 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d17ab-9d14-4bdc-8b35-2a95cc661dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:02.594960 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d17ab-9d14-4bdc-8b35-2a95cc661dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:02.610024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d17ab-9d14-4bdc-8b35-2a95cc661dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:02.611485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d17ab-9d14-4bdc-8b35-2a95cc661dc2 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:02.629445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 963/1943] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:05:04.473076 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572b287-afc1-4732-b055-6dc38e8f4ba4 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:04.474656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1572b287-afc1-4732-b055-6dc38e8f4ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:04.511097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572b287-afc1-4732-b055-6dc38e8f4ba4 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:04.528564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915bd95-3230-44e3-9fec-f60d06562100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:04.529461 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915bd95-3230-44e3-9fec-f60d06562100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:04.529919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915bd95-3230-44e3-9fec-f60d06562100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:04.530340 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915bd95-3230-44e3-9fec-f60d06562100 admin admin] PATH_INFO: `/v3/projects/7117d650ba7f41bd805a064feb0bd6cf` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:04.531732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915bd95-3230-44e3-9fec-f60d06562100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7117d650ba7f41bd805a064feb0bd6cf)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:04.533898 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915bd95-3230-44e3-9fec-f60d06562100 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:04.695675 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-0915bd95-3230-44e3-9fec-f60d06562100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7117d650ba7f41bd805a064feb0bd6cf', 'request_id': 'req-0915bd95-3230-44e3-9fec-f60d06562100'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:04.714444 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-0915bd95-3230-44e3-9fec-f60d06562100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7117d650ba7f41bd805a064feb0bd6cf', 'request_id': 'req-0915bd95-3230-44e3-9fec-f60d06562100'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:04.734454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-0915bd95-3230-44e3-9fec-f60d06562100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7117d650ba7f41bd805a064feb0bd6cf', 'request_id': 'req-0915bd95-3230-44e3-9fec-f60d06562100'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:04.753631 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-0915bd95-3230-44e3-9fec-f60d06562100 admin admin] The token cache is being invalidate because project 7117d650ba7f41bd805a064feb0bd6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:05:04.755994 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-0915bd95-3230-44e3-9fec-f60d06562100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:04.757284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-0915bd95-3230-44e3-9fec-f60d06562100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:04.771416 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 981/1944] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:05:04 2022] DELETE /identity/v3/projects/7117d650ba7f41bd805a064feb0bd6cf => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:04.775538 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d17ab-9d14-4bdc-8b35-2a95cc661dc2 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:04.788499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d17ab-9d14-4bdc-8b35-2a95cc661dc2 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:04.816091 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:04.952899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68eff5d-ec1b-4b66-acd2-27aafadcac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:04.954011 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eff5d-ec1b-4b66-acd2-27aafadcac6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:04.954691 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eff5d-ec1b-4b66-acd2-27aafadcac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:04.955107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eff5d-ec1b-4b66-acd2-27aafadcac6e admin admin] PATH_INFO: `/v3/users/975a42ea803d455e8f028c00ff564837` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:04.958292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68eff5d-ec1b-4b66-acd2-27aafadcac6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=975a42ea803d455e8f028c00ff564837)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:04.962184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68eff5d-ec1b-4b66-acd2-27aafadcac6e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:05.063804 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d68eff5d-ec1b-4b66-acd2-27aafadcac6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '975a42ea803d455e8f028c00ff564837'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:05.077428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d68eff5d-ec1b-4b66-acd2-27aafadcac6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '975a42ea803d455e8f028c00ff564837'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:05.100669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d68eff5d-ec1b-4b66-acd2-27aafadcac6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '975a42ea803d455e8f028c00ff564837'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:05.110798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d68eff5d-ec1b-4b66-acd2-27aafadcac6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '975a42ea803d455e8f028c00ff564837'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:05.112063 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d68eff5d-ec1b-4b66-acd2-27aafadcac6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '975a42ea803d455e8f028c00ff564837'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:05.121455 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 964/1945] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:05:04 2022] DELETE /identity/v3/users/975a42ea803d455e8f028c00ff564837 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:06.134352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915bd95-3230-44e3-9fec-f60d06562100 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:06.136609 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-0915bd95-3230-44e3-9fec-f60d06562100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:06.155890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915bd95-3230-44e3-9fec-f60d06562100 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:06.245621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d0965-f919-4bb6-bf8b-baa6a27d93be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:06.246617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d0965-f919-4bb6-bf8b-baa6a27d93be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:06.247172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d0965-f919-4bb6-bf8b-baa6a27d93be admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:06.247452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d0965-f919-4bb6-bf8b-baa6a27d93be admin admin] PATH_INFO: `/v3/users/f6af2d3f99294190980215974998321f` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:06.248649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d0965-f919-4bb6-bf8b-baa6a27d93be admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6af2d3f99294190980215974998321f)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:06.250759 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d0965-f919-4bb6-bf8b-baa6a27d93be admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:06.333570 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-559d0965-f919-4bb6-bf8b-baa6a27d93be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6af2d3f99294190980215974998321f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:06.347585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-559d0965-f919-4bb6-bf8b-baa6a27d93be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6af2d3f99294190980215974998321f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:06.371782 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-559d0965-f919-4bb6-bf8b-baa6a27d93be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6af2d3f99294190980215974998321f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:06.372501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-559d0965-f919-4bb6-bf8b-baa6a27d93be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6af2d3f99294190980215974998321f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:06.373242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-559d0965-f919-4bb6-bf8b-baa6a27d93be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6af2d3f99294190980215974998321f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:06.396600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 982/1946] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:05:06 2022] DELETE /identity/v3/users/f6af2d3f99294190980215974998321f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:06.401984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae33f4-1984-4df1-b612-17d8acff941d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:06.402885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae33f4-1984-4df1-b612-17d8acff941d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:06.403337 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae33f4-1984-4df1-b612-17d8acff941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:06.427819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d3ae33f4-1984-4df1-b612-17d8acff941d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:06.429633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d3ae33f4-1984-4df1-b612-17d8acff941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:06.496532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d0965-f919-4bb6-bf8b-baa6a27d93be admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:06.500589 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-559d0965-f919-4bb6-bf8b-baa6a27d93be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:06.508024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:06.515105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 965/1947] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:06.545987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae33f4-1984-4df1-b612-17d8acff941d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:06.547875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d3ae33f4-1984-4df1-b612-17d8acff941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:06.615233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:06.642090 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d0965-f919-4bb6-bf8b-baa6a27d93be admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:06.649852 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868663e-b16f-431b-b866-b0d6f3d02158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:06.650701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868663e-b16f-431b-b866-b0d6f3d02158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:06.651311 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868663e-b16f-431b-b866-b0d6f3d02158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:06.651652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868663e-b16f-431b-b866-b0d6f3d02158 admin admin] PATH_INFO: `/v3/projects/c78a51d772c74b2a986986b4995208e7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:06.652997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868663e-b16f-431b-b866-b0d6f3d02158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c78a51d772c74b2a986986b4995208e7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:06.656324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868663e-b16f-431b-b866-b0d6f3d02158 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:06.662039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae33f4-1984-4df1-b612-17d8acff941d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:06.669398 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ca610-3edc-48dd-a4eb-2c5a67c2ea01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:06.670748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ca610-3edc-48dd-a4eb-2c5a67c2ea01 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:06.671937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ca610-3edc-48dd-a4eb-2c5a67c2ea01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:06.672602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ca610-3edc-48dd-a4eb-2c5a67c2ea01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:06.706069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ca610-3edc-48dd-a4eb-2c5a67c2ea01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:06.708950 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ca610-3edc-48dd-a4eb-2c5a67c2ea01 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:06.722913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 966/1948] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:05:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:05:06.761579 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8868663e-b16f-431b-b866-b0d6f3d02158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c78a51d772c74b2a986986b4995208e7', 'request_id': 'req-8868663e-b16f-431b-b866-b0d6f3d02158'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:06.770223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8868663e-b16f-431b-b866-b0d6f3d02158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c78a51d772c74b2a986986b4995208e7', 'request_id': 'req-8868663e-b16f-431b-b866-b0d6f3d02158'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:06.783596 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8868663e-b16f-431b-b866-b0d6f3d02158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c78a51d772c74b2a986986b4995208e7', 'request_id': 'req-8868663e-b16f-431b-b866-b0d6f3d02158'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:06.807240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8868663e-b16f-431b-b866-b0d6f3d02158 admin admin] The token cache is being invalidate because project c78a51d772c74b2a986986b4995208e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:05:06.807793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8868663e-b16f-431b-b866-b0d6f3d02158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:06.810525 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8868663e-b16f-431b-b866-b0d6f3d02158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:06.816107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 983/1949] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:05:06 2022] DELETE /identity/v3/projects/c78a51d772c74b2a986986b4995208e7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:06.826577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e03bf8-cc23-43da-a6e5-57cc1e66a435 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:06.828334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e03bf8-cc23-43da-a6e5-57cc1e66a435 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:06.828814 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e03bf8-cc23-43da-a6e5-57cc1e66a435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:06.862943 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-30e03bf8-cc23-43da-a6e5-57cc1e66a435 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:06.865274 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-30e03bf8-cc23-43da-a6e5-57cc1e66a435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:06.969369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9831d26-8423-402d-acfc-be503b4d15f9 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:06.969736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 967/1950] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:06.974085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9831d26-8423-402d-acfc-be503b4d15f9 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:06.974786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9831d26-8423-402d-acfc-be503b4d15f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:07.014337 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-f9831d26-8423-402d-acfc-be503b4d15f9 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:07.015650 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f9831d26-8423-402d-acfc-be503b4d15f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:07.033582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e03bf8-cc23-43da-a6e5-57cc1e66a435 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:07.043869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 984/1951] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:05:07.055384 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e03bf8-cc23-43da-a6e5-57cc1e66a435 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:07.068589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5091d-b902-4846-b630-f97fe9dbf3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:07.069244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5091d-b902-4846-b630-f97fe9dbf3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:07.069596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5091d-b902-4846-b630-f97fe9dbf3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:07.069873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5091d-b902-4846-b630-f97fe9dbf3a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:07.071408 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5091d-b902-4846-b630-f97fe9dbf3a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:05:07.071723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5091d-b902-4846-b630-f97fe9dbf3a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:07.073412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5091d-b902-4846-b630-f97fe9dbf3a4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:07.118937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 968/1952] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:05:07.124764 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9831d26-8423-402d-acfc-be503b4d15f9 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:07.140557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9831d26-8423-402d-acfc-be503b4d15f9 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:07.162856 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef52781-5a97-485c-9632-750787aa2168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:07.178160 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52781-5a97-485c-9632-750787aa2168 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:07.180906 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52781-5a97-485c-9632-750787aa2168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:07.181618 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52781-5a97-485c-9632-750787aa2168 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:07.182655 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef52781-5a97-485c-9632-750787aa2168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:07.192823 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef52781-5a97-485c-9632-750787aa2168 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:07.300630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 985/1953] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:05:07 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:05:07.305485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5091d-b902-4846-b630-f97fe9dbf3a4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:07.334709 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5091d-b902-4846-b630-f97fe9dbf3a4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:07.519721 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590dd9c-50e8-4f0d-83e9-d9abb46d03ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:07.521105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590dd9c-50e8-4f0d-83e9-d9abb46d03ee admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:07.521396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590dd9c-50e8-4f0d-83e9-d9abb46d03ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:07.521667 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590dd9c-50e8-4f0d-83e9-d9abb46d03ee admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:07.522537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590dd9c-50e8-4f0d-83e9-d9abb46d03ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:07.525424 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590dd9c-50e8-4f0d-83e9-d9abb46d03ee admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:07.556447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 969/1954] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:05:07 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:05:07.560743 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef52781-5a97-485c-9632-750787aa2168 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:07.575460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef52781-5a97-485c-9632-750787aa2168 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:07.583204 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ab5f2-9964-407b-a6ed-4bc23497f45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:07.584240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ab5f2-9964-407b-a6ed-4bc23497f45d admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:07.584713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ab5f2-9964-407b-a6ed-4bc23497f45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:07.585028 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ab5f2-9964-407b-a6ed-4bc23497f45d admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:07.588345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ab5f2-9964-407b-a6ed-4bc23497f45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:07.588345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ab5f2-9964-407b-a6ed-4bc23497f45d admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:07.604413 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 986/1955] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:05:07.606074 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590dd9c-50e8-4f0d-83e9-d9abb46d03ee admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:07.620759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590dd9c-50e8-4f0d-83e9-d9abb46d03ee admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:07.626531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6ccbe-c9d4-42c6-9f91-b531264acd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:07.627418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6ccbe-c9d4-42c6-9f91-b531264acd9a admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:07.627738 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6ccbe-c9d4-42c6-9f91-b531264acd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:07.628064 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6ccbe-c9d4-42c6-9f91-b531264acd9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:07.628827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6ccbe-c9d4-42c6-9f91-b531264acd9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:07.630414 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6ccbe-c9d4-42c6-9f91-b531264acd9a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:07.655640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 970/1956] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:05:07.657536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ab5f2-9964-407b-a6ed-4bc23497f45d admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:07.670438 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ab5f2-9964-407b-a6ed-4bc23497f45d admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:07.682135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37609c-208d-406e-8150-feb8038758b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:07.682829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37609c-208d-406e-8150-feb8038758b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:07.683111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37609c-208d-406e-8150-feb8038758b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:07.683386 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37609c-208d-406e-8150-feb8038758b0 admin admin] PATH_INFO: `/v3/projects/62a1d6aa201d4adc9a2d604a74d4c816/users/8e6f6811b3504ec0ba15766f2b7bfd38/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:07.707244 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37609c-208d-406e-8150-feb8038758b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a1d6aa201d4adc9a2d604a74d4c816, user_id=8e6f6811b3504ec0ba15766f2b7bfd38, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:07.710276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37609c-208d-406e-8150-feb8038758b0 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:07.726942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 987/1957] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:05:07 2022] PUT /identity/v3/projects/62a1d6aa201d4adc9a2d604a74d4c816/users/8e6f6811b3504ec0ba15766f2b7bfd38/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:07.739374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4fe63-7186-4d53-9e50-a20653ece79d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:07.739681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4fe63-7186-4d53-9e50-a20653ece79d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:07.739967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4fe63-7186-4d53-9e50-a20653ece79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:07.785559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-faa4fe63-7186-4d53-9e50-a20653ece79d None None] MFA Rules not processed for user `8e6f6811b3504ec0ba15766f2b7bfd38`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:07.790712 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-faa4fe63-7186-4d53-9e50-a20653ece79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:07.799016 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37609c-208d-406e-8150-feb8038758b0 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:07.801194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3b37609c-208d-406e-8150-feb8038758b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:07.873400 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:07.888718 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:07.948796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 971/1958] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:07.982956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37609c-208d-406e-8150-feb8038758b0 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:08.007612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4fe63-7186-4d53-9e50-a20653ece79d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:08.008845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ce6d5-e641-4e1e-a970-79c0f1340e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:08.009910 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ce6d5-e641-4e1e-a970-79c0f1340e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:08.010348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ce6d5-e641-4e1e-a970-79c0f1340e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:08.010474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-faa4fe63-7186-4d53-9e50-a20653ece79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:08.011054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ce6d5-e641-4e1e-a970-79c0f1340e3f admin admin] PATH_INFO: `/v3/projects/98ec50f0ec344d0ebefda92e333960d8` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:08.014115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ce6d5-e641-4e1e-a970-79c0f1340e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ec50f0ec344d0ebefda92e333960d8)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:08.020753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ce6d5-e641-4e1e-a970-79c0f1340e3f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:08.132006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-815ce6d5-e641-4e1e-a970-79c0f1340e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ec50f0ec344d0ebefda92e333960d8', 'request_id': 'req-815ce6d5-e641-4e1e-a970-79c0f1340e3f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:08.150878 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-815ce6d5-e641-4e1e-a970-79c0f1340e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ec50f0ec344d0ebefda92e333960d8', 'request_id': 'req-815ce6d5-e641-4e1e-a970-79c0f1340e3f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:08.167503 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4fe63-7186-4d53-9e50-a20653ece79d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:08.169134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-815ce6d5-e641-4e1e-a970-79c0f1340e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ec50f0ec344d0ebefda92e333960d8', 'request_id': 'req-815ce6d5-e641-4e1e-a970-79c0f1340e3f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:08.214003 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-815ce6d5-e641-4e1e-a970-79c0f1340e3f admin admin] The token cache is being invalidate because project 98ec50f0ec344d0ebefda92e333960d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:05:08.214827 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-815ce6d5-e641-4e1e-a970-79c0f1340e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:08.218074 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-815ce6d5-e641-4e1e-a970-79c0f1340e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:08.221005 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 988/1959] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:05:07 2022] DELETE /identity/v3/projects/98ec50f0ec344d0ebefda92e333960d8 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:08.225554 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce337f-2810-4442-b999-522953b43f80 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:08.226747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce337f-2810-4442-b999-522953b43f80 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:08.227241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce337f-2810-4442-b999-522953b43f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:08.276508 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf336b-c42f-4952-912e-c75e3555fb72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:08.277227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf336b-c42f-4952-912e-c75e3555fb72 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:08.278339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf336b-c42f-4952-912e-c75e3555fb72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:08.278339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf336b-c42f-4952-912e-c75e3555fb72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:08.280251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bebf336b-c42f-4952-912e-c75e3555fb72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:08.285420 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-78ce337f-2810-4442-b999-522953b43f80 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:08.286698 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-78ce337f-2810-4442-b999-522953b43f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:08.358493 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf336b-c42f-4952-912e-c75e3555fb72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:08.361107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf336b-c42f-4952-912e-c75e3555fb72 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:08.373962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 972/1960] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:05:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:05:08.401147 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 989/1961] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:08.410172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba66184-e742-4844-bdef-265048edfacd None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:08.410763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba66184-e742-4844-bdef-265048edfacd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:08.411794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba66184-e742-4844-bdef-265048edfacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:08.446775 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-bba66184-e742-4844-bdef-265048edfacd None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:08.449185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bba66184-e742-4844-bdef-265048edfacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:08.476605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 973/1962] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:08.483108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce337f-2810-4442-b999-522953b43f80 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:08.499396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce337f-2810-4442-b999-522953b43f80 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:08.519541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca892a9-48af-4647-a654-928bdf9c1f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:08.520423 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca892a9-48af-4647-a654-928bdf9c1f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:08.520808 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca892a9-48af-4647-a654-928bdf9c1f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:08.521211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca892a9-48af-4647-a654-928bdf9c1f9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:08.522000 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca892a9-48af-4647-a654-928bdf9c1f9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:05:08.522410 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca892a9-48af-4647-a654-928bdf9c1f9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:08.529862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca892a9-48af-4647-a654-928bdf9c1f9d admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:08.557172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 990/1963] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:05:08.561492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba66184-e742-4844-bdef-265048edfacd None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:08.574943 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba66184-e742-4844-bdef-265048edfacd None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:08.587595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0cb04-b5f7-4b26-8c8d-1c3180d72a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:08.588622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0cb04-b5f7-4b26-8c8d-1c3180d72a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:08.589138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0cb04-b5f7-4b26-8c8d-1c3180d72a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:08.589420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0cb04-b5f7-4b26-8c8d-1c3180d72a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:08.590151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0cb04-b5f7-4b26-8c8d-1c3180d72a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:08.593462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0cb04-b5f7-4b26-8c8d-1c3180d72a48 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:08.642044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca892a9-48af-4647-a654-928bdf9c1f9d admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:08.656436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 974/1964] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:05:08 2022] POST /identity/v3/projects => generated 361 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:05:08.661641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca892a9-48af-4647-a654-928bdf9c1f9d admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:08.756035 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:08.782645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c2d4a-cff5-479c-ac84-6e983a2df0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:08.783280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c2d4a-cff5-479c-ac84-6e983a2df0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:08.783561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c2d4a-cff5-479c-ac84-6e983a2df0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:08.783828 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c2d4a-cff5-479c-ac84-6e983a2df0f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:08.784573 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c2d4a-cff5-479c-ac84-6e983a2df0f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:08.787364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c2d4a-cff5-479c-ac84-6e983a2df0f7 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:08.822139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 991/1965] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:05:08 2022] POST /identity/v3/users => generated 281 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:05:08.824525 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0cb04-b5f7-4b26-8c8d-1c3180d72a48 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:08.836636 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0cb04-b5f7-4b26-8c8d-1c3180d72a48 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:08.843385 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f71cc5-38f3-4c5b-901a-25cfc93fd0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:08.844417 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f71cc5-38f3-4c5b-901a-25cfc93fd0cd admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:08.844885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f71cc5-38f3-4c5b-901a-25cfc93fd0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:08.845320 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f71cc5-38f3-4c5b-901a-25cfc93fd0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:08.846133 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f71cc5-38f3-4c5b-901a-25cfc93fd0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:08.847990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f71cc5-38f3-4c5b-901a-25cfc93fd0cd admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:08.870681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 975/1966] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:05:08.870894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c2d4a-cff5-479c-ac84-6e983a2df0f7 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:08.886076 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c2d4a-cff5-479c-ac84-6e983a2df0f7 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:08.892339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc1dd1-a253-4a9b-97e1-d9cc6d24c8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:08.893340 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc1dd1-a253-4a9b-97e1-d9cc6d24c8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:08.893863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc1dd1-a253-4a9b-97e1-d9cc6d24c8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:08.894541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc1dd1-a253-4a9b-97e1-d9cc6d24c8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:08.896022 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc1dd1-a253-4a9b-97e1-d9cc6d24c8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:08.898023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc1dd1-a253-4a9b-97e1-d9cc6d24c8f1 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:08.927365 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f71cc5-38f3-4c5b-901a-25cfc93fd0cd admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:08.927891 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 992/1967] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:05:08.933723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:08.943114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f71cc5-38f3-4c5b-901a-25cfc93fd0cd admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:08.948804 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e864d-5673-4558-8c8a-d6b3e8e40660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:08.949488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e864d-5673-4558-8c8a-d6b3e8e40660 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:08.949824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e864d-5673-4558-8c8a-d6b3e8e40660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:08.950100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e864d-5673-4558-8c8a-d6b3e8e40660 admin admin] PATH_INFO: `/v3/projects/69590172b92b4d12b412a8953a7dab9c/users/9ef9e622419343ba9377d6143e43ab58/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:08.970148 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e864d-5673-4558-8c8a-d6b3e8e40660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69590172b92b4d12b412a8953a7dab9c, user_id=9ef9e622419343ba9377d6143e43ab58, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:08.973973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e864d-5673-4558-8c8a-d6b3e8e40660 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:09.006882 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 976/1968] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:05:08 2022] PUT /identity/v3/projects/69590172b92b4d12b412a8953a7dab9c/users/9ef9e622419343ba9377d6143e43ab58/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:09.021743 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842d113-0037-4919-8c35-0dc5be5d2679 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:09.021743 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842d113-0037-4919-8c35-0dc5be5d2679 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:09.021743 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842d113-0037-4919-8c35-0dc5be5d2679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:09.072598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-f842d113-0037-4919-8c35-0dc5be5d2679 None None] MFA Rules not processed for user `9ef9e622419343ba9377d6143e43ab58`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:09.073966 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f842d113-0037-4919-8c35-0dc5be5d2679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:09.176926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 993/1969] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:09.220929 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e864d-5673-4558-8c8a-d6b3e8e40660 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:09.223367 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d55e864d-5673-4558-8c8a-d6b3e8e40660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:09.329243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e864d-5673-4558-8c8a-d6b3e8e40660 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:09.333688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49078014-ae85-4110-b72e-73591e456cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:09.334339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49078014-ae85-4110-b72e-73591e456cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:09.334618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49078014-ae85-4110-b72e-73591e456cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:09.334891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49078014-ae85-4110-b72e-73591e456cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:09.345285 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49078014-ae85-4110-b72e-73591e456cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:09.348367 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49078014-ae85-4110-b72e-73591e456cd2 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:09.359342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 977/1970] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:05:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:05:11.231974 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842d113-0037-4919-8c35-0dc5be5d2679 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:11.234192 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f842d113-0037-4919-8c35-0dc5be5d2679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:11.402333 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842d113-0037-4919-8c35-0dc5be5d2679 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:11.411664 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d146384-e45c-4c16-a811-6745ae92cabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:11.412901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d146384-e45c-4c16-a811-6745ae92cabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:11.413309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d146384-e45c-4c16-a811-6745ae92cabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:11.413685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d146384-e45c-4c16-a811-6745ae92cabb admin admin] PATH_INFO: `/v3/users/8e6f6811b3504ec0ba15766f2b7bfd38` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:11.417187 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d146384-e45c-4c16-a811-6745ae92cabb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6f6811b3504ec0ba15766f2b7bfd38)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:11.419583 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d146384-e45c-4c16-a811-6745ae92cabb admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:11.511716 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-2d146384-e45c-4c16-a811-6745ae92cabb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6f6811b3504ec0ba15766f2b7bfd38'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:11.532074 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-2d146384-e45c-4c16-a811-6745ae92cabb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6f6811b3504ec0ba15766f2b7bfd38'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:11.536786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:11.554473 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-2d146384-e45c-4c16-a811-6745ae92cabb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6f6811b3504ec0ba15766f2b7bfd38'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:11.555761 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-2d146384-e45c-4c16-a811-6745ae92cabb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6f6811b3504ec0ba15766f2b7bfd38'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:11.556972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-2d146384-e45c-4c16-a811-6745ae92cabb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6f6811b3504ec0ba15766f2b7bfd38'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:11.579465 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 994/1971] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:05:11 2022] DELETE /identity/v3/users/8e6f6811b3504ec0ba15766f2b7bfd38 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:11.584666 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92fc14-d82b-4c97-9850-3f4596ad3b9f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:11.585189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92fc14-d82b-4c97-9850-3f4596ad3b9f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:11.585306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92fc14-d82b-4c97-9850-3f4596ad3b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:11.611647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1d92fc14-d82b-4c97-9850-3f4596ad3b9f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:11.612981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1d92fc14-d82b-4c97-9850-3f4596ad3b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:11.709325 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 978/1972] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:11.758798 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d146384-e45c-4c16-a811-6745ae92cabb admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:11.761815 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2d146384-e45c-4c16-a811-6745ae92cabb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:11.901687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d146384-e45c-4c16-a811-6745ae92cabb admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:11.910515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc2a4c-1ffb-453b-80ca-38dd0cf7fe05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:11.911164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc2a4c-1ffb-453b-80ca-38dd0cf7fe05 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:11.913080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc2a4c-1ffb-453b-80ca-38dd0cf7fe05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:11.913080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc2a4c-1ffb-453b-80ca-38dd0cf7fe05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:11.938942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc2a4c-1ffb-453b-80ca-38dd0cf7fe05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:11.940951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc2a4c-1ffb-453b-80ca-38dd0cf7fe05 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:11.965301 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 995/1973] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:05:12.135841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92fc14-d82b-4c97-9850-3f4596ad3b9f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:12.137749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1d92fc14-d82b-4c97-9850-3f4596ad3b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:12.152782 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92fc14-d82b-4c97-9850-3f4596ad3b9f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:12.158171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5f0fe-f528-4876-84d4-4fb054542fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:12.158924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5f0fe-f528-4876-84d4-4fb054542fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:12.159205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5f0fe-f528-4876-84d4-4fb054542fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:12.159478 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5f0fe-f528-4876-84d4-4fb054542fcf admin admin] PATH_INFO: `/v3/users/28a9c1fb3e064a9ba9c5ee798833b633` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:12.162703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5f0fe-f528-4876-84d4-4fb054542fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a9c1fb3e064a9ba9c5ee798833b633)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:12.164515 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5f0fe-f528-4876-84d4-4fb054542fcf admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:12.249054 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64a5f0fe-f528-4876-84d4-4fb054542fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a9c1fb3e064a9ba9c5ee798833b633'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:12.262060 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64a5f0fe-f528-4876-84d4-4fb054542fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a9c1fb3e064a9ba9c5ee798833b633'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:12.283962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64a5f0fe-f528-4876-84d4-4fb054542fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a9c1fb3e064a9ba9c5ee798833b633'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:12.294222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:12.299057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64a5f0fe-f528-4876-84d4-4fb054542fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a9c1fb3e064a9ba9c5ee798833b633'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:12.301013 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64a5f0fe-f528-4876-84d4-4fb054542fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a9c1fb3e064a9ba9c5ee798833b633'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:12.325965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 979/1974] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:05:12 2022] DELETE /identity/v3/users/28a9c1fb3e064a9ba9c5ee798833b633 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:12.328283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e3359-7f8e-4f6c-a1e6-126509f7b7e1 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:12.328977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e3359-7f8e-4f6c-a1e6-126509f7b7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:12.329267 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e3359-7f8e-4f6c-a1e6-126509f7b7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:12.389075 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e50e3359-7f8e-4f6c-a1e6-126509f7b7e1 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:12.390345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e50e3359-7f8e-4f6c-a1e6-126509f7b7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:12.491780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 996/1975] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:12.543858 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5f0fe-f528-4876-84d4-4fb054542fcf admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:12.545321 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-64a5f0fe-f528-4876-84d4-4fb054542fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:12.615115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5f0fe-f528-4876-84d4-4fb054542fcf admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:12.620756 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4f2f6-1b31-4a38-9d85-7a157a2ff64a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:12.621390 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4f2f6-1b31-4a38-9d85-7a157a2ff64a service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:12.621664 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4f2f6-1b31-4a38-9d85-7a157a2ff64a service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:12.621927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4f2f6-1b31-4a38-9d85-7a157a2ff64a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:12.633899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4f2f6-1b31-4a38-9d85-7a157a2ff64a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:12.635254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4f2f6-1b31-4a38-9d85-7a157a2ff64a service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:12.647137 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 980/1976] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:05:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:05:13.632343 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e3359-7f8e-4f6c-a1e6-126509f7b7e1 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:13.633839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e50e3359-7f8e-4f6c-a1e6-126509f7b7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:13.661055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e3359-7f8e-4f6c-a1e6-126509f7b7e1 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:13.666339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cca490-2ba3-4533-b769-50bd56c18095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:13.667065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cca490-2ba3-4533-b769-50bd56c18095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:13.667283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cca490-2ba3-4533-b769-50bd56c18095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:13.667553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cca490-2ba3-4533-b769-50bd56c18095 admin admin] PATH_INFO: `/v3/projects/62a1d6aa201d4adc9a2d604a74d4c816` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:13.669120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cca490-2ba3-4533-b769-50bd56c18095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a1d6aa201d4adc9a2d604a74d4c816)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:13.671448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cca490-2ba3-4533-b769-50bd56c18095 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:13.763724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-28cca490-2ba3-4533-b769-50bd56c18095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a1d6aa201d4adc9a2d604a74d4c816', 'request_id': 'req-28cca490-2ba3-4533-b769-50bd56c18095'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:13.774472 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-28cca490-2ba3-4533-b769-50bd56c18095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a1d6aa201d4adc9a2d604a74d4c816', 'request_id': 'req-28cca490-2ba3-4533-b769-50bd56c18095'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:13.790928 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-28cca490-2ba3-4533-b769-50bd56c18095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a1d6aa201d4adc9a2d604a74d4c816', 'request_id': 'req-28cca490-2ba3-4533-b769-50bd56c18095'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:13.807017 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:13.813404 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-28cca490-2ba3-4533-b769-50bd56c18095 admin admin] The token cache is being invalidate because project 62a1d6aa201d4adc9a2d604a74d4c816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:05:13.814275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-28cca490-2ba3-4533-b769-50bd56c18095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:13.816004 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-28cca490-2ba3-4533-b769-50bd56c18095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:13.821185 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 997/1977] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:05:13 2022] DELETE /identity/v3/projects/62a1d6aa201d4adc9a2d604a74d4c816 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:13.825075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27909d9-5582-450e-ae99-feccb6dcc708 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:13.825980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27909d9-5582-450e-ae99-feccb6dcc708 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:13.827256 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27909d9-5582-450e-ae99-feccb6dcc708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:13.858421 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b27909d9-5582-450e-ae99-feccb6dcc708 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:13.859986 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b27909d9-5582-450e-ae99-feccb6dcc708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:13.971538 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 981/1978] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:13.973780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a01c4f-2df9-473f-9c11-361f71bdacf3 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:13.974232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a01c4f-2df9-473f-9c11-361f71bdacf3 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:13.974650 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a01c4f-2df9-473f-9c11-361f71bdacf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:14.006990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-39a01c4f-2df9-473f-9c11-361f71bdacf3 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:14.008526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-39a01c4f-2df9-473f-9c11-361f71bdacf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:14.022104 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 998/1979] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:14.027217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27909d9-5582-450e-ae99-feccb6dcc708 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:14.047533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27909d9-5582-450e-ae99-feccb6dcc708 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:14.055349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b9a51-3f7b-4080-a107-717acd78246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:14.056129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b9a51-3f7b-4080-a107-717acd78246e admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:14.056414 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b9a51-3f7b-4080-a107-717acd78246e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:14.056690 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b9a51-3f7b-4080-a107-717acd78246e admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:14.057484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b9a51-3f7b-4080-a107-717acd78246e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:05:14.057918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b9a51-3f7b-4080-a107-717acd78246e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:14.060846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b9a51-3f7b-4080-a107-717acd78246e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:14.064040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a01c4f-2df9-473f-9c11-361f71bdacf3 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:14.066848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-39a01c4f-2df9-473f-9c11-361f71bdacf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:14.082451 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 982/1980] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:05:14.083483 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b9a51-3f7b-4080-a107-717acd78246e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:14.088727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a01c4f-2df9-473f-9c11-361f71bdacf3 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:14.096153 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b9a51-3f7b-4080-a107-717acd78246e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:14.100898 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195d328-cc06-4f09-b5ff-3f8633e9daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:14.101585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195d328-cc06-4f09-b5ff-3f8633e9daa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:14.101861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195d328-cc06-4f09-b5ff-3f8633e9daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:14.102124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195d328-cc06-4f09-b5ff-3f8633e9daa9 admin admin] PATH_INFO: `/v3/projects/4a229be58da642758a52802fc421fd83` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:14.103420 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195d328-cc06-4f09-b5ff-3f8633e9daa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a229be58da642758a52802fc421fd83)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:14.104833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc0b6d-4add-481a-9665-3a50d5f726d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:14.105372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195d328-cc06-4f09-b5ff-3f8633e9daa9 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:14.105483 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc0b6d-4add-481a-9665-3a50d5f726d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:14.105742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc0b6d-4add-481a-9665-3a50d5f726d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:14.107083 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc0b6d-4add-481a-9665-3a50d5f726d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:14.107735 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc0b6d-4add-481a-9665-3a50d5f726d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:14.113566 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc0b6d-4add-481a-9665-3a50d5f726d8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:14.181349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 983/1981] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:05:14 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:05:14.182752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc0b6d-4add-481a-9665-3a50d5f726d8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:14.183722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-0195d328-cc06-4f09-b5ff-3f8633e9daa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a229be58da642758a52802fc421fd83', 'request_id': 'req-0195d328-cc06-4f09-b5ff-3f8633e9daa9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:14.194222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-0195d328-cc06-4f09-b5ff-3f8633e9daa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a229be58da642758a52802fc421fd83', 'request_id': 'req-0195d328-cc06-4f09-b5ff-3f8633e9daa9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:14.206324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-0195d328-cc06-4f09-b5ff-3f8633e9daa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a229be58da642758a52802fc421fd83', 'request_id': 'req-0195d328-cc06-4f09-b5ff-3f8633e9daa9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:14.244213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-0195d328-cc06-4f09-b5ff-3f8633e9daa9 admin admin] The token cache is being invalidate because project 4a229be58da642758a52802fc421fd83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:05:14.244972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-0195d328-cc06-4f09-b5ff-3f8633e9daa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:14.246729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-0195d328-cc06-4f09-b5ff-3f8633e9daa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:14.248681 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 999/1982] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:05:14 2022] DELETE /identity/v3/projects/4a229be58da642758a52802fc421fd83 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:05:14.254905 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195d328-cc06-4f09-b5ff-3f8633e9daa9 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:14.257391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-0195d328-cc06-4f09-b5ff-3f8633e9daa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:14.308798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc0b6d-4add-481a-9665-3a50d5f726d8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:14.321419 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dd860-8bc0-4368-8a86-c057f2ba07c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:14.322162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dd860-8bc0-4368-8a86-c057f2ba07c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:14.322484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dd860-8bc0-4368-8a86-c057f2ba07c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:14.322712 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17dd860-8bc0-4368-8a86-c057f2ba07c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:14.323350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17dd860-8bc0-4368-8a86-c057f2ba07c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:14.326633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17dd860-8bc0-4368-8a86-c057f2ba07c4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:14.345843 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:14.350512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195d328-cc06-4f09-b5ff-3f8633e9daa9 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:14.357351 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4a606-e12d-4451-91f0-709759222f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:14.358230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4a606-e12d-4451-91f0-709759222f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:14.358681 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4a606-e12d-4451-91f0-709759222f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:14.359526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4a606-e12d-4451-91f0-709759222f8e admin admin] PATH_INFO: `/v3/users/f9e8edd31bf54072b3dded7088549780` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:14.360484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4a606-e12d-4451-91f0-709759222f8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e8edd31bf54072b3dded7088549780)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:14.364177 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4a606-e12d-4451-91f0-709759222f8e admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:14.370249 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 984/1983] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:05:14 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:05:14.374130 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dd860-8bc0-4368-8a86-c057f2ba07c4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:14.375844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e17dd860-8bc0-4368-8a86-c057f2ba07c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:14.403515 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17dd860-8bc0-4368-8a86-c057f2ba07c4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:14.414418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a854c03-bb45-44ea-85be-a70565fd14ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:14.415066 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a854c03-bb45-44ea-85be-a70565fd14ee admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:14.415349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a854c03-bb45-44ea-85be-a70565fd14ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:14.415626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a854c03-bb45-44ea-85be-a70565fd14ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:14.416331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a854c03-bb45-44ea-85be-a70565fd14ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:14.417964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a854c03-bb45-44ea-85be-a70565fd14ee admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:14.442496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-bef4a606-e12d-4451-91f0-709759222f8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e8edd31bf54072b3dded7088549780'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:14.455309 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 985/1984] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:05:14.460384 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a854c03-bb45-44ea-85be-a70565fd14ee admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:14.471793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-bef4a606-e12d-4451-91f0-709759222f8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e8edd31bf54072b3dded7088549780'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:14.472590 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a854c03-bb45-44ea-85be-a70565fd14ee admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:14.478314 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc792b-b849-45e0-8cd9-744a6c7b3c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:14.479024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc792b-b849-45e0-8cd9-744a6c7b3c3e admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:14.479566 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc792b-b849-45e0-8cd9-744a6c7b3c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:14.479997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc792b-b849-45e0-8cd9-744a6c7b3c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:14.480830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc792b-b849-45e0-8cd9-744a6c7b3c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:14.483345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc792b-b849-45e0-8cd9-744a6c7b3c3e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:14.498886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-bef4a606-e12d-4451-91f0-709759222f8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e8edd31bf54072b3dded7088549780'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:14.502436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-bef4a606-e12d-4451-91f0-709759222f8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e8edd31bf54072b3dded7088549780'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:14.503470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 986/1985] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:05:14.504927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc792b-b849-45e0-8cd9-744a6c7b3c3e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:14.506590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-bef4a606-e12d-4451-91f0-709759222f8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e8edd31bf54072b3dded7088549780'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:14.506805 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-aefc792b-b849-45e0-8cd9-744a6c7b3c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:14.514595 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:14.531438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc792b-b849-45e0-8cd9-744a6c7b3c3e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:14.541700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1000/1986] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:05:14 2022] DELETE /identity/v3/users/f9e8edd31bf54072b3dded7088549780 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:14.543279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049e74e-c140-4702-b21c-ecaf5dd495b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:14.544455 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049e74e-c140-4702-b21c-ecaf5dd495b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:14.544651 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049e74e-c140-4702-b21c-ecaf5dd495b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:14.545138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049e74e-c140-4702-b21c-ecaf5dd495b6 admin admin] PATH_INFO: `/v3/projects/3b540a89aa1d423085d0be0a423a2812/users/128e18cfa29b47bd9a52ec67fed8b772/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:14.569470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049e74e-c140-4702-b21c-ecaf5dd495b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b540a89aa1d423085d0be0a423a2812, user_id=128e18cfa29b47bd9a52ec67fed8b772, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:14.572925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049e74e-c140-4702-b21c-ecaf5dd495b6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:14.603963 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 987/1987] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:05:14 2022] PUT /identity/v3/projects/3b540a89aa1d423085d0be0a423a2812/users/128e18cfa29b47bd9a52ec67fed8b772/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:14.606485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86707b1-ee22-453e-98e6-3720aabcfac1 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:14.606997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86707b1-ee22-453e-98e6-3720aabcfac1 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:14.607771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86707b1-ee22-453e-98e6-3720aabcfac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:14.660723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e86707b1-ee22-453e-98e6-3720aabcfac1 None None] MFA Rules not processed for user `128e18cfa29b47bd9a52ec67fed8b772`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:14.663706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e86707b1-ee22-453e-98e6-3720aabcfac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:14.823617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1001/1988] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:14.864591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049e74e-c140-4702-b21c-ecaf5dd495b6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:14.867885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a049e74e-c140-4702-b21c-ecaf5dd495b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:14.981796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049e74e-c140-4702-b21c-ecaf5dd495b6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:14.988433 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e524eaf-1e96-4ec8-9f03-50f3be146325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:14.989977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e524eaf-1e96-4ec8-9f03-50f3be146325 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:14.990594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e524eaf-1e96-4ec8-9f03-50f3be146325 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:14.991136 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e524eaf-1e96-4ec8-9f03-50f3be146325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:15.005476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e524eaf-1e96-4ec8-9f03-50f3be146325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:15.008650 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e524eaf-1e96-4ec8-9f03-50f3be146325 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:15.027284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 988/1989] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:05:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:05:15.863979 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86707b1-ee22-453e-98e6-3720aabcfac1 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:15.864622 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e86707b1-ee22-453e-98e6-3720aabcfac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:16.032474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86707b1-ee22-453e-98e6-3720aabcfac1 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:16.039743 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95ef5c-95ab-4db2-b0bc-a0044f1e376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:16.041475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95ef5c-95ab-4db2-b0bc-a0044f1e376c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:16.041909 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95ef5c-95ab-4db2-b0bc-a0044f1e376c admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:16.042289 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95ef5c-95ab-4db2-b0bc-a0044f1e376c admin admin] PATH_INFO: `/v3/projects/35c91762e06e43aba5fdc13e0c601dd0` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:16.057377 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95ef5c-95ab-4db2-b0bc-a0044f1e376c admin admin] RBAC: Authorizing `identity:delete_project(project_id=35c91762e06e43aba5fdc13e0c601dd0)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:16.059418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95ef5c-95ab-4db2-b0bc-a0044f1e376c admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:16.170236 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-2e95ef5c-95ab-4db2-b0bc-a0044f1e376c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c91762e06e43aba5fdc13e0c601dd0', 'request_id': 'req-2e95ef5c-95ab-4db2-b0bc-a0044f1e376c'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:16.190604 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-2e95ef5c-95ab-4db2-b0bc-a0044f1e376c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c91762e06e43aba5fdc13e0c601dd0', 'request_id': 'req-2e95ef5c-95ab-4db2-b0bc-a0044f1e376c'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:16.232018 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-2e95ef5c-95ab-4db2-b0bc-a0044f1e376c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c91762e06e43aba5fdc13e0c601dd0', 'request_id': 'req-2e95ef5c-95ab-4db2-b0bc-a0044f1e376c'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:16.270311 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-2e95ef5c-95ab-4db2-b0bc-a0044f1e376c admin admin] The token cache is being invalidate because project 35c91762e06e43aba5fdc13e0c601dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:05:16.270870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-2e95ef5c-95ab-4db2-b0bc-a0044f1e376c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:16.272219 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-2e95ef5c-95ab-4db2-b0bc-a0044f1e376c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:16.274248 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1002/1990] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:05:15 2022] DELETE /identity/v3/projects/35c91762e06e43aba5fdc13e0c601dd0 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:16.279510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d110413-c652-4c6e-bf06-80684e13e07d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:16.280081 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d110413-c652-4c6e-bf06-80684e13e07d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:16.280178 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d110413-c652-4c6e-bf06-80684e13e07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:16.309108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3d110413-c652-4c6e-bf06-80684e13e07d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:16.311115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3d110413-c652-4c6e-bf06-80684e13e07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:16.403880 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 989/1991] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:16.414710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1793c-c8f8-4907-957f-3ec860eb38cf None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:16.414997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1793c-c8f8-4907-957f-3ec860eb38cf None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:16.415272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1793c-c8f8-4907-957f-3ec860eb38cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:16.461323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-99d1793c-c8f8-4907-957f-3ec860eb38cf None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:16.462651 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-99d1793c-c8f8-4907-957f-3ec860eb38cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:16.481643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d110413-c652-4c6e-bf06-80684e13e07d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:16.482347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1003/1992] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:16.500525 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d110413-c652-4c6e-bf06-80684e13e07d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:16.508100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035768a3-6f2a-4b02-bbe5-2647b8918649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:16.508961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035768a3-6f2a-4b02-bbe5-2647b8918649 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:16.509462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035768a3-6f2a-4b02-bbe5-2647b8918649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:16.510024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035768a3-6f2a-4b02-bbe5-2647b8918649 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:16.511143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035768a3-6f2a-4b02-bbe5-2647b8918649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:05:16.511631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035768a3-6f2a-4b02-bbe5-2647b8918649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:16.513545 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035768a3-6f2a-4b02-bbe5-2647b8918649 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:16.542723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 990/1993] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:05:16.547378 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1793c-c8f8-4907-957f-3ec860eb38cf None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:16.561413 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1793c-c8f8-4907-957f-3ec860eb38cf None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:16.572447 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4030095-e27c-43be-a183-769ba81d493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:16.573330 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030095-e27c-43be-a183-769ba81d493f admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:16.573701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030095-e27c-43be-a183-769ba81d493f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:16.574033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030095-e27c-43be-a183-769ba81d493f admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:16.574999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4030095-e27c-43be-a183-769ba81d493f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:16.577395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4030095-e27c-43be-a183-769ba81d493f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:16.589797 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:16.635604 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1004/1994] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:05:16 2022] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:05:16.639726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035768a3-6f2a-4b02-bbe5-2647b8918649 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:16.656962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035768a3-6f2a-4b02-bbe5-2647b8918649 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:16.717992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:16.760380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894a362-bf96-456b-b28b-f846d0f0d1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:16.761185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a362-bf96-456b-b28b-f846d0f0d1dc admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:16.761543 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a362-bf96-456b-b28b-f846d0f0d1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:16.761908 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a362-bf96-456b-b28b-f846d0f0d1dc admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:16.762879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894a362-bf96-456b-b28b-f846d0f0d1dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:16.765673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894a362-bf96-456b-b28b-f846d0f0d1dc admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:16.795892 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 991/1995] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:05:16 2022] POST /identity/v3/users => generated 283 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:05:16.801128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4030095-e27c-43be-a183-769ba81d493f admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:16.824459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4030095-e27c-43be-a183-769ba81d493f admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:16.832284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8b792-a8b6-4850-b8de-0384f0454f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:16.835316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8b792-a8b6-4850-b8de-0384f0454f37 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:16.835727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8b792-a8b6-4850-b8de-0384f0454f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:16.836135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8b792-a8b6-4850-b8de-0384f0454f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:16.836920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8b792-a8b6-4850-b8de-0384f0454f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:16.839344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8b792-a8b6-4850-b8de-0384f0454f37 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:16.853888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1005/1996] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:05:16.858200 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894a362-bf96-456b-b28b-f846d0f0d1dc admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:16.878869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894a362-bf96-456b-b28b-f846d0f0d1dc admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:16.885748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868afaf-520e-483e-8394-b68784f266cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:16.886496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868afaf-520e-483e-8394-b68784f266cb admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:16.886877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868afaf-520e-483e-8394-b68784f266cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:16.887250 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868afaf-520e-483e-8394-b68784f266cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:16.888046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868afaf-520e-483e-8394-b68784f266cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:16.890208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868afaf-520e-483e-8394-b68784f266cb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:16.917060 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 992/1997] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:05:16.918553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8b792-a8b6-4850-b8de-0384f0454f37 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:16.930581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8b792-a8b6-4850-b8de-0384f0454f37 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:16.937148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0c61d-23f8-43b3-bd2c-f0a09cd13a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:16.937920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0c61d-23f8-43b3-bd2c-f0a09cd13a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:16.938454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0c61d-23f8-43b3-bd2c-f0a09cd13a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:16.938931 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0c61d-23f8-43b3-bd2c-f0a09cd13a64 admin admin] PATH_INFO: `/v3/projects/a6f4914f715841c8b3907ff7b2f108f4/users/e03766982f50410883a6b3f7532f16c9/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:16.972064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0c61d-23f8-43b3-bd2c-f0a09cd13a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f4914f715841c8b3907ff7b2f108f4, user_id=e03766982f50410883a6b3f7532f16c9, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:16.976956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0c61d-23f8-43b3-bd2c-f0a09cd13a64 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:16.997624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1006/1998] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:05:16 2022] PUT /identity/v3/projects/a6f4914f715841c8b3907ff7b2f108f4/users/e03766982f50410883a6b3f7532f16c9/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:17.009488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abffb61-6127-4d2b-aaba-f0f107827ac9 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:17.009837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abffb61-6127-4d2b-aaba-f0f107827ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:17.010090 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abffb61-6127-4d2b-aaba-f0f107827ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:17.046879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4abffb61-6127-4d2b-aaba-f0f107827ac9 None None] MFA Rules not processed for user `e03766982f50410883a6b3f7532f16c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:17.048161 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4abffb61-6127-4d2b-aaba-f0f107827ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:17.197925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 993/1999] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:17.198237 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0c61d-23f8-43b3-bd2c-f0a09cd13a64 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:17.334942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0c61d-23f8-43b3-bd2c-f0a09cd13a64 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:17.341512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2fe6a-7635-4b93-862e-0d424b0757ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:17.341856 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2fe6a-7635-4b93-862e-0d424b0757ab admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:17.342126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2fe6a-7635-4b93-862e-0d424b0757ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:17.342527 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2fe6a-7635-4b93-862e-0d424b0757ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:17.343308 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2fe6a-7635-4b93-862e-0d424b0757ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:17.348033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2fe6a-7635-4b93-862e-0d424b0757ab admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:17.383122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1007/2000] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:05:17 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:05:17.384681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abffb61-6127-4d2b-aaba-f0f107827ac9 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:17.398385 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abffb61-6127-4d2b-aaba-f0f107827ac9 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:17.506476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d771b-c4a8-4cd2-a0cf-fc1fd8684281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:17.507542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d771b-c4a8-4cd2-a0cf-fc1fd8684281 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:17.508494 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d771b-c4a8-4cd2-a0cf-fc1fd8684281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:17.508867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d771b-c4a8-4cd2-a0cf-fc1fd8684281 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:17.509797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d771b-c4a8-4cd2-a0cf-fc1fd8684281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:17.513619 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d771b-c4a8-4cd2-a0cf-fc1fd8684281 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:17.551655 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2fe6a-7635-4b93-862e-0d424b0757ab admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:17.551934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 994/2001] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:05:17 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:05:17.593740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2fe6a-7635-4b93-862e-0d424b0757ab admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:17.612411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce48b1-12b5-400a-9141-d21cb8ecac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:17.613491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce48b1-12b5-400a-9141-d21cb8ecac27 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:17.613928 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce48b1-12b5-400a-9141-d21cb8ecac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:17.615309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce48b1-12b5-400a-9141-d21cb8ecac27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:17.617124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce48b1-12b5-400a-9141-d21cb8ecac27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:17.622464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce48b1-12b5-400a-9141-d21cb8ecac27 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:17.656580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1008/2002] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:05:17.661586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d771b-c4a8-4cd2-a0cf-fc1fd8684281 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:17.679526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d771b-c4a8-4cd2-a0cf-fc1fd8684281 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:17.700185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec0c9e-02b6-453f-b63f-5dabdfe6edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:17.701811 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec0c9e-02b6-453f-b63f-5dabdfe6edb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:17.703749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec0c9e-02b6-453f-b63f-5dabdfe6edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:17.704053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec0c9e-02b6-453f-b63f-5dabdfe6edb0 admin admin] PATH_INFO: `/v3/projects/f5052693b62644228f382741e67cddfd/users/3e9da8d4c537450e9f06e20002f14d8f/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:17.761039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec0c9e-02b6-453f-b63f-5dabdfe6edb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5052693b62644228f382741e67cddfd, user_id=3e9da8d4c537450e9f06e20002f14d8f, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:17.763751 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec0c9e-02b6-453f-b63f-5dabdfe6edb0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:17.784067 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 995/2003] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:05:17 2022] PUT /identity/v3/projects/f5052693b62644228f382741e67cddfd/users/3e9da8d4c537450e9f06e20002f14d8f/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:17.788920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce48b1-12b5-400a-9141-d21cb8ecac27 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:17.802562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce48b1-12b5-400a-9141-d21cb8ecac27 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:17.908719 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4beabd-7589-47ec-a028-9ead17ec9ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:17.910502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4beabd-7589-47ec-a028-9ead17ec9ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:17.911307 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4beabd-7589-47ec-a028-9ead17ec9ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:17.914149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4beabd-7589-47ec-a028-9ead17ec9ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:17.918878 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4beabd-7589-47ec-a028-9ead17ec9ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:17.923956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4beabd-7589-47ec-a028-9ead17ec9ec2 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:17.952869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1009/2004] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:05:17.956867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec0c9e-02b6-453f-b63f-5dabdfe6edb0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:17.970625 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec0c9e-02b6-453f-b63f-5dabdfe6edb0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:17.990447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbc63b-2d6f-4364-be88-c397e2c83087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:17.991148 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbc63b-2d6f-4364-be88-c397e2c83087 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:17.991413 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbc63b-2d6f-4364-be88-c397e2c83087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:17.991814 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbc63b-2d6f-4364-be88-c397e2c83087 admin admin] PATH_INFO: `/v3/projects/f5052693b62644228f382741e67cddfd/users/3e9da8d4c537450e9f06e20002f14d8f/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:17.994241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbc63b-2d6f-4364-be88-c397e2c83087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5052693b62644228f382741e67cddfd, user_id=3e9da8d4c537450e9f06e20002f14d8f, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:17.999875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbc63b-2d6f-4364-be88-c397e2c83087 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:18.009884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:18.031118 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 996/2005] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:05:17 2022] PUT /identity/v3/projects/f5052693b62644228f382741e67cddfd/users/3e9da8d4c537450e9f06e20002f14d8f/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:18.043569 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d350e6-e5b7-4a19-b4e9-f5c6f0c82d72 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:18.043839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d350e6-e5b7-4a19-b4e9-f5c6f0c82d72 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:18.044135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d350e6-e5b7-4a19-b4e9-f5c6f0c82d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:18.095165 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e0d350e6-e5b7-4a19-b4e9-f5c6f0c82d72 None None] MFA Rules not processed for user `3e9da8d4c537450e9f06e20002f14d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:18.100462 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e0d350e6-e5b7-4a19-b4e9-f5c6f0c82d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:18.123727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:18.251577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1010/2006] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:18.285256 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbc63b-2d6f-4364-be88-c397e2c83087 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:18.289195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2bdbc63b-2d6f-4364-be88-c397e2c83087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:18.438247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbc63b-2d6f-4364-be88-c397e2c83087 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:18.454730 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff1ee3-f729-4b7a-9f06-b529f7baddda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:18.455827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff1ee3-f729-4b7a-9f06-b529f7baddda service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:18.456364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff1ee3-f729-4b7a-9f06-b529f7baddda service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:18.456836 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff1ee3-f729-4b7a-9f06-b529f7baddda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:18.477221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff1ee3-f729-4b7a-9f06-b529f7baddda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:18.479114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff1ee3-f729-4b7a-9f06-b529f7baddda service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:18.499722 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 997/2007] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:05:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:05:25.087208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d350e6-e5b7-4a19-b4e9-f5c6f0c82d72 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:25.104134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d350e6-e5b7-4a19-b4e9-f5c6f0c82d72 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:25.110902 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200752a2-376b-417e-a5b9-c34a89d78780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:25.112060 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200752a2-376b-417e-a5b9-c34a89d78780 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:25.112536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200752a2-376b-417e-a5b9-c34a89d78780 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:25.112974 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200752a2-376b-417e-a5b9-c34a89d78780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:25.292999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200752a2-376b-417e-a5b9-c34a89d78780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:25.294867 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200752a2-376b-417e-a5b9-c34a89d78780 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:25.336002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1011/2008] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:05:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:05:28.385021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff1ee3-f729-4b7a-9f06-b529f7baddda service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:28.569826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff1ee3-f729-4b7a-9f06-b529f7baddda service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:28.584807 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168bd11-6090-4c75-a355-3fca01aa7480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:28.585484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168bd11-6090-4c75-a355-3fca01aa7480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:28.585767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168bd11-6090-4c75-a355-3fca01aa7480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:28.587012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168bd11-6090-4c75-a355-3fca01aa7480 admin admin] PATH_INFO: `/v3/users/e03766982f50410883a6b3f7532f16c9` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:28.592181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168bd11-6090-4c75-a355-3fca01aa7480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e03766982f50410883a6b3f7532f16c9)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:28.594407 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168bd11-6090-4c75-a355-3fca01aa7480 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:28.704400 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1168bd11-6090-4c75-a355-3fca01aa7480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e03766982f50410883a6b3f7532f16c9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:28.722948 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1168bd11-6090-4c75-a355-3fca01aa7480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e03766982f50410883a6b3f7532f16c9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:28.748613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1168bd11-6090-4c75-a355-3fca01aa7480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e03766982f50410883a6b3f7532f16c9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:28.761184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1168bd11-6090-4c75-a355-3fca01aa7480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e03766982f50410883a6b3f7532f16c9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:28.762159 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1168bd11-6090-4c75-a355-3fca01aa7480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e03766982f50410883a6b3f7532f16c9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:28.779191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 998/2009] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:05:28 2022] DELETE /identity/v3/users/e03766982f50410883a6b3f7532f16c9 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:28.780889 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40bb2a-1166-472e-8519-46aa3524bfa7 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:28.781753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40bb2a-1166-472e-8519-46aa3524bfa7 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:28.782268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40bb2a-1166-472e-8519-46aa3524bfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:28.808304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-eb40bb2a-1166-472e-8519-46aa3524bfa7 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:28.810260 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-eb40bb2a-1166-472e-8519-46aa3524bfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:28.898519 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1012/2010] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:28.912802 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168bd11-6090-4c75-a355-3fca01aa7480 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:28.915608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1168bd11-6090-4c75-a355-3fca01aa7480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:28.951394 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:29.028650 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168bd11-6090-4c75-a355-3fca01aa7480 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:29.038505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce4192-591c-4be2-815b-3371d3f841c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:29.039407 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce4192-591c-4be2-815b-3371d3f841c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:29.039839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce4192-591c-4be2-815b-3371d3f841c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:29.040507 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce4192-591c-4be2-815b-3371d3f841c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:29.055310 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce4192-591c-4be2-815b-3371d3f841c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:29.057182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce4192-591c-4be2-815b-3371d3f841c2 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:29.071740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 999/2011] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:05:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:05:31.362599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40bb2a-1166-472e-8519-46aa3524bfa7 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:31.364002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-eb40bb2a-1166-472e-8519-46aa3524bfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:31.392088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40bb2a-1166-472e-8519-46aa3524bfa7 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:31.414238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa654aac-af1a-4dbf-872f-c959a24909eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:31.415037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa654aac-af1a-4dbf-872f-c959a24909eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:31.415415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa654aac-af1a-4dbf-872f-c959a24909eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:31.415880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa654aac-af1a-4dbf-872f-c959a24909eb admin admin] PATH_INFO: `/v3/projects/a6f4914f715841c8b3907ff7b2f108f4` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:31.417338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa654aac-af1a-4dbf-872f-c959a24909eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f4914f715841c8b3907ff7b2f108f4)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:31.420334 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa654aac-af1a-4dbf-872f-c959a24909eb admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:31.528522 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:31.551745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fa654aac-af1a-4dbf-872f-c959a24909eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f4914f715841c8b3907ff7b2f108f4', 'request_id': 'req-fa654aac-af1a-4dbf-872f-c959a24909eb'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:31.562172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fa654aac-af1a-4dbf-872f-c959a24909eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f4914f715841c8b3907ff7b2f108f4', 'request_id': 'req-fa654aac-af1a-4dbf-872f-c959a24909eb'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:31.572764 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fa654aac-af1a-4dbf-872f-c959a24909eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f4914f715841c8b3907ff7b2f108f4', 'request_id': 'req-fa654aac-af1a-4dbf-872f-c959a24909eb'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:31.592507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fa654aac-af1a-4dbf-872f-c959a24909eb admin admin] The token cache is being invalidate because project a6f4914f715841c8b3907ff7b2f108f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:05:31.593715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fa654aac-af1a-4dbf-872f-c959a24909eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:31.594552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fa654aac-af1a-4dbf-872f-c959a24909eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:31.600370 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1013/2012] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:05:31 2022] DELETE /identity/v3/projects/a6f4914f715841c8b3907ff7b2f108f4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:31.601391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce4192-591c-4be2-815b-3371d3f841c2 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:31.619731 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce4192-591c-4be2-815b-3371d3f841c2 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:31.706197 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516902d7-77dc-4041-8265-a2729119c6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:31.706907 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516902d7-77dc-4041-8265-a2729119c6b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:31.707192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516902d7-77dc-4041-8265-a2729119c6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:31.707514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516902d7-77dc-4041-8265-a2729119c6b2 admin admin] PATH_INFO: `/v3/users/3e9da8d4c537450e9f06e20002f14d8f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:31.708781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516902d7-77dc-4041-8265-a2729119c6b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e9da8d4c537450e9f06e20002f14d8f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:31.711502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516902d7-77dc-4041-8265-a2729119c6b2 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:31.788382 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-516902d7-77dc-4041-8265-a2729119c6b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e9da8d4c537450e9f06e20002f14d8f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:31.802148 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-516902d7-77dc-4041-8265-a2729119c6b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e9da8d4c537450e9f06e20002f14d8f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:31.819571 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-516902d7-77dc-4041-8265-a2729119c6b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e9da8d4c537450e9f06e20002f14d8f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:31.829082 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-516902d7-77dc-4041-8265-a2729119c6b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e9da8d4c537450e9f06e20002f14d8f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:31.830143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-516902d7-77dc-4041-8265-a2729119c6b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e9da8d4c537450e9f06e20002f14d8f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:31.838013 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1000/2013] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:05:31 2022] DELETE /identity/v3/users/3e9da8d4c537450e9f06e20002f14d8f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:33.142238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa654aac-af1a-4dbf-872f-c959a24909eb admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:33.145495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-fa654aac-af1a-4dbf-872f-c959a24909eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:33.168884 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa654aac-af1a-4dbf-872f-c959a24909eb admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:33.302190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236fafe-bb03-4d2a-a9eb-7b9e42fceeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:33.303069 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236fafe-bb03-4d2a-a9eb-7b9e42fceeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:33.305760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236fafe-bb03-4d2a-a9eb-7b9e42fceeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:33.306279 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236fafe-bb03-4d2a-a9eb-7b9e42fceeb2 admin admin] PATH_INFO: `/v3/projects/f5052693b62644228f382741e67cddfd` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:33.342575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236fafe-bb03-4d2a-a9eb-7b9e42fceeb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5052693b62644228f382741e67cddfd)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:33.350006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236fafe-bb03-4d2a-a9eb-7b9e42fceeb2 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:33.468504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f236fafe-bb03-4d2a-a9eb-7b9e42fceeb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5052693b62644228f382741e67cddfd', 'request_id': 'req-f236fafe-bb03-4d2a-a9eb-7b9e42fceeb2'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:33.487818 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f236fafe-bb03-4d2a-a9eb-7b9e42fceeb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5052693b62644228f382741e67cddfd', 'request_id': 'req-f236fafe-bb03-4d2a-a9eb-7b9e42fceeb2'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:33.501713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f236fafe-bb03-4d2a-a9eb-7b9e42fceeb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5052693b62644228f382741e67cddfd', 'request_id': 'req-f236fafe-bb03-4d2a-a9eb-7b9e42fceeb2'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:33.520459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f236fafe-bb03-4d2a-a9eb-7b9e42fceeb2 admin admin] The token cache is being invalidate because project f5052693b62644228f382741e67cddfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:05:33.521280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f236fafe-bb03-4d2a-a9eb-7b9e42fceeb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:33.525478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-f236fafe-bb03-4d2a-a9eb-7b9e42fceeb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:33.535078 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1014/2014] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:05:33 2022] DELETE /identity/v3/projects/f5052693b62644228f382741e67cddfd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:33.538570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffab22-253b-4ccc-b4e1-dedb11e23b1e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:33.539048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffab22-253b-4ccc-b4e1-dedb11e23b1e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:33.539230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffab22-253b-4ccc-b4e1-dedb11e23b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:33.568755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-efffab22-253b-4ccc-b4e1-dedb11e23b1e None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:33.569996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-efffab22-253b-4ccc-b4e1-dedb11e23b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:33.618854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:33.670736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1001/2015] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:33.678870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf255aac-33a3-49c3-9463-ce3b8fa863e9 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:33.680366 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf255aac-33a3-49c3-9463-ce3b8fa863e9 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:33.680700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf255aac-33a3-49c3-9463-ce3b8fa863e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:33.723686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-bf255aac-33a3-49c3-9463-ce3b8fa863e9 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:33.729115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-bf255aac-33a3-49c3-9463-ce3b8fa863e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:33.751035 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1015/2016] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:33.755949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffab22-253b-4ccc-b4e1-dedb11e23b1e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:33.772654 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffab22-253b-4ccc-b4e1-dedb11e23b1e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:33.790320 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799a7ce-8e46-4567-978a-9455dcf4c4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:33.792588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799a7ce-8e46-4567-978a-9455dcf4c4fc admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:33.793322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799a7ce-8e46-4567-978a-9455dcf4c4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:33.793795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799a7ce-8e46-4567-978a-9455dcf4c4fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:33.795135 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799a7ce-8e46-4567-978a-9455dcf4c4fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:05:33.795743 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799a7ce-8e46-4567-978a-9455dcf4c4fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:33.798382 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799a7ce-8e46-4567-978a-9455dcf4c4fc admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:33.823756 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1002/2017] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:05:33.827672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf255aac-33a3-49c3-9463-ce3b8fa863e9 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:33.839784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf255aac-33a3-49c3-9463-ce3b8fa863e9 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:33.846614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02feb5-5e11-40e2-a91a-75194f0d465a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:33.847248 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02feb5-5e11-40e2-a91a-75194f0d465a admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:33.847530 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02feb5-5e11-40e2-a91a-75194f0d465a admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:33.847806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02feb5-5e11-40e2-a91a-75194f0d465a admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:33.848895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02feb5-5e11-40e2-a91a-75194f0d465a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:33.850876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02feb5-5e11-40e2-a91a-75194f0d465a admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:33.892062 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1016/2018] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:05:33 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:05:33.896940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799a7ce-8e46-4567-978a-9455dcf4c4fc admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:33.914052 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799a7ce-8e46-4567-978a-9455dcf4c4fc admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:34.042533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51fcf1-7940-404e-86cb-ad388b283c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:34.043174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51fcf1-7940-404e-86cb-ad388b283c5a admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:34.043460 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51fcf1-7940-404e-86cb-ad388b283c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:34.043737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51fcf1-7940-404e-86cb-ad388b283c5a admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:34.044430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51fcf1-7940-404e-86cb-ad388b283c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:34.047281 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d51fcf1-7940-404e-86cb-ad388b283c5a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:34.078217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1003/2019] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:05:33 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:05:34.082911 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02feb5-5e11-40e2-a91a-75194f0d465a admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:34.103817 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02feb5-5e11-40e2-a91a-75194f0d465a admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:34.110526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84856507-b24a-4ccf-8a99-65934d45b4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:34.111553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84856507-b24a-4ccf-8a99-65934d45b4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:34.112306 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84856507-b24a-4ccf-8a99-65934d45b4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:34.112859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84856507-b24a-4ccf-8a99-65934d45b4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:34.113653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84856507-b24a-4ccf-8a99-65934d45b4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:34.116663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84856507-b24a-4ccf-8a99-65934d45b4f5 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:34.135022 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1017/2020] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:05:34.140191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51fcf1-7940-404e-86cb-ad388b283c5a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:34.155235 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51fcf1-7940-404e-86cb-ad388b283c5a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:34.162000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff07624-9050-4ef6-a11e-0bf5e8ba1583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:34.163062 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff07624-9050-4ef6-a11e-0bf5e8ba1583 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:34.163929 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff07624-9050-4ef6-a11e-0bf5e8ba1583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:34.164333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff07624-9050-4ef6-a11e-0bf5e8ba1583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:34.165164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff07624-9050-4ef6-a11e-0bf5e8ba1583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:34.166914 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff07624-9050-4ef6-a11e-0bf5e8ba1583 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:34.185401 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1004/2021] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:05:34.189098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84856507-b24a-4ccf-8a99-65934d45b4f5 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:34.203042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84856507-b24a-4ccf-8a99-65934d45b4f5 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:34.210590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f0e35-f71b-4de3-ba6a-e3e897edc4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:34.211631 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f0e35-f71b-4de3-ba6a-e3e897edc4cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:34.212055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f0e35-f71b-4de3-ba6a-e3e897edc4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:34.212564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f0e35-f71b-4de3-ba6a-e3e897edc4cb admin admin] PATH_INFO: `/v3/projects/a44a179136e042fa85c1c76db6baeb08/users/477f8bb94b1a477c8c6ccfce9fc9b87f/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:34.249954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f0e35-f71b-4de3-ba6a-e3e897edc4cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44a179136e042fa85c1c76db6baeb08, user_id=477f8bb94b1a477c8c6ccfce9fc9b87f, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:34.254305 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f0e35-f71b-4de3-ba6a-e3e897edc4cb admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:34.260287 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:34.285847 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1018/2022] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:05:34 2022] PUT /identity/v3/projects/a44a179136e042fa85c1c76db6baeb08/users/477f8bb94b1a477c8c6ccfce9fc9b87f/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:05:34.300852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f94fa5-d68e-46f2-ab79-e993c3aca523 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:34.301574 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f94fa5-d68e-46f2-ab79-e993c3aca523 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:34.302448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f94fa5-d68e-46f2-ab79-e993c3aca523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:34.350628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-85f94fa5-d68e-46f2-ab79-e993c3aca523 None None] MFA Rules not processed for user `477f8bb94b1a477c8c6ccfce9fc9b87f`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:34.353447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-85f94fa5-d68e-46f2-ab79-e993c3aca523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:34.475154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1005/2023] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:34.493056 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f0e35-f71b-4de3-ba6a-e3e897edc4cb admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:34.494763 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2a4f0e35-f71b-4de3-ba6a-e3e897edc4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:34.593707 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f0e35-f71b-4de3-ba6a-e3e897edc4cb admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:34.600397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da78f38-c43e-49ce-8a8e-51d0ed98232e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:34.601520 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da78f38-c43e-49ce-8a8e-51d0ed98232e service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:34.601982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da78f38-c43e-49ce-8a8e-51d0ed98232e service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:34.602433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da78f38-c43e-49ce-8a8e-51d0ed98232e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:34.614973 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da78f38-c43e-49ce-8a8e-51d0ed98232e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:34.617095 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da78f38-c43e-49ce-8a8e-51d0ed98232e service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:34.632577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1019/2024] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:05:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:05:44.469467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:44.627550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=28 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:51.289576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f94fa5-d68e-46f2-ab79-e993c3aca523 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:51.292607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-85f94fa5-d68e-46f2-ab79-e993c3aca523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:51.446429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f94fa5-d68e-46f2-ab79-e993c3aca523 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:51.449467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb5413-c942-41b4-9846-52f941ec994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:51.450245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb5413-c942-41b4-9846-52f941ec994d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:51.450604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb5413-c942-41b4-9846-52f941ec994d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:51.450954 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb5413-c942-41b4-9846-52f941ec994d admin admin] PATH_INFO: `/v3/users/128e18cfa29b47bd9a52ec67fed8b772` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:51.452718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb5413-c942-41b4-9846-52f941ec994d admin admin] RBAC: Authorizing `identity:delete_user(user_id=128e18cfa29b47bd9a52ec67fed8b772)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:51.456071 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb5413-c942-41b4-9846-52f941ec994d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:51.536566 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-46cb5413-c942-41b4-9846-52f941ec994d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '128e18cfa29b47bd9a52ec67fed8b772'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:51.550838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-46cb5413-c942-41b4-9846-52f941ec994d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '128e18cfa29b47bd9a52ec67fed8b772'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:51.572722 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-46cb5413-c942-41b4-9846-52f941ec994d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '128e18cfa29b47bd9a52ec67fed8b772'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:51.584077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-46cb5413-c942-41b4-9846-52f941ec994d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '128e18cfa29b47bd9a52ec67fed8b772'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:51.585936 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-46cb5413-c942-41b4-9846-52f941ec994d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '128e18cfa29b47bd9a52ec67fed8b772'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:51.599757 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1006/2025] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:05:51 2022] DELETE /identity/v3/users/128e18cfa29b47bd9a52ec67fed8b772 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:51.602854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b61ff-373e-4699-a5c7-b506820bb8ce None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:51.603363 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b61ff-373e-4699-a5c7-b506820bb8ce None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:51.603449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b61ff-373e-4699-a5c7-b506820bb8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:51.640674 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-476b61ff-373e-4699-a5c7-b506820bb8ce None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:51.640674 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-476b61ff-373e-4699-a5c7-b506820bb8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:51.755860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1020/2026] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:51.796932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb5413-c942-41b4-9846-52f941ec994d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:51.798868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-46cb5413-c942-41b4-9846-52f941ec994d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:51.942068 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb5413-c942-41b4-9846-52f941ec994d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:51.947287 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07af3c-5653-4bce-9afb-6d67aa1c1f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:51.948210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07af3c-5653-4bce-9afb-6d67aa1c1f71 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:51.948840 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07af3c-5653-4bce-9afb-6d67aa1c1f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:51.948840 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07af3c-5653-4bce-9afb-6d67aa1c1f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:51.966489 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07af3c-5653-4bce-9afb-6d67aa1c1f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:51.974498 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07af3c-5653-4bce-9afb-6d67aa1c1f71 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:51.990385 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1007/2027] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:05:52.797163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b61ff-373e-4699-a5c7-b506820bb8ce None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:52.801635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-476b61ff-373e-4699-a5c7-b506820bb8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:52.851926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b61ff-373e-4699-a5c7-b506820bb8ce None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:52.866018 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b9865-425c-4a31-b469-535ce0255797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:52.866706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b9865-425c-4a31-b469-535ce0255797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:52.866989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b9865-425c-4a31-b469-535ce0255797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:52.867499 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b9865-425c-4a31-b469-535ce0255797 admin admin] PATH_INFO: `/v3/projects/3b540a89aa1d423085d0be0a423a2812` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:52.869148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b9865-425c-4a31-b469-535ce0255797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b540a89aa1d423085d0be0a423a2812)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:52.871247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b9865-425c-4a31-b469-535ce0255797 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:53.038676 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-870b9865-425c-4a31-b469-535ce0255797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b540a89aa1d423085d0be0a423a2812', 'request_id': 'req-870b9865-425c-4a31-b469-535ce0255797'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:53.052150 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-870b9865-425c-4a31-b469-535ce0255797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b540a89aa1d423085d0be0a423a2812', 'request_id': 'req-870b9865-425c-4a31-b469-535ce0255797'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:53.088232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-870b9865-425c-4a31-b469-535ce0255797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b540a89aa1d423085d0be0a423a2812', 'request_id': 'req-870b9865-425c-4a31-b469-535ce0255797'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:53.106146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-870b9865-425c-4a31-b469-535ce0255797 admin admin] The token cache is being invalidate because project 3b540a89aa1d423085d0be0a423a2812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:05:53.106634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-870b9865-425c-4a31-b469-535ce0255797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:53.107331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-870b9865-425c-4a31-b469-535ce0255797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:05:53.114407 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1021/2028] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:05:52 2022] DELETE /identity/v3/projects/3b540a89aa1d423085d0be0a423a2812 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:53.118780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652647d-b91b-4547-880d-a5989bebc986 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:53.119240 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652647d-b91b-4547-880d-a5989bebc986 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:53.119417 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652647d-b91b-4547-880d-a5989bebc986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:53.187790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1652647d-b91b-4547-880d-a5989bebc986 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:53.190369 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1652647d-b91b-4547-880d-a5989bebc986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:53.229971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:53.382712 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1008/2029] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:05:53.390663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcde9a-9b10-456f-87ee-c30d8a143fb9 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:53.391048 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcde9a-9b10-456f-87ee-c30d8a143fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:53.391393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcde9a-9b10-456f-87ee-c30d8a143fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:53.435595 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c0bcde9a-9b10-456f-87ee-c30d8a143fb9 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:53.448915 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c0bcde9a-9b10-456f-87ee-c30d8a143fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:53.471682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1022/2030] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:53.472899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652647d-b91b-4547-880d-a5989bebc986 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:53.487495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652647d-b91b-4547-880d-a5989bebc986 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:53.492640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0d86a-23e8-4e38-8163-ee82e71d6815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:53.493865 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0d86a-23e8-4e38-8163-ee82e71d6815 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:53.494028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0d86a-23e8-4e38-8163-ee82e71d6815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:53.494726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0d86a-23e8-4e38-8163-ee82e71d6815 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:53.495533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0d86a-23e8-4e38-8163-ee82e71d6815 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:05:53.495780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0d86a-23e8-4e38-8163-ee82e71d6815 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:53.498898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0d86a-23e8-4e38-8163-ee82e71d6815 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:53.519861 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1009/2031] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:05:53.523419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcde9a-9b10-456f-87ee-c30d8a143fb9 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:53.545606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcde9a-9b10-456f-87ee-c30d8a143fb9 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:53.559813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd044c70-2d42-4285-aec4-ae59c5665c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:53.560454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd044c70-2d42-4285-aec4-ae59c5665c98 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:53.560809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd044c70-2d42-4285-aec4-ae59c5665c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:53.561153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd044c70-2d42-4285-aec4-ae59c5665c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:53.561936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd044c70-2d42-4285-aec4-ae59c5665c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:53.565302 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd044c70-2d42-4285-aec4-ae59c5665c98 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:53.607978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1023/2032] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:05:53 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:05:53.612489 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0d86a-23e8-4e38-8163-ee82e71d6815 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:53.625244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0d86a-23e8-4e38-8163-ee82e71d6815 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:53.742914 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba89508-22c9-466b-b818-7ae0bc51f657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:53.743981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba89508-22c9-466b-b818-7ae0bc51f657 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:53.744471 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba89508-22c9-466b-b818-7ae0bc51f657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:53.744944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba89508-22c9-466b-b818-7ae0bc51f657 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:53.745867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba89508-22c9-466b-b818-7ae0bc51f657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:53.748679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba89508-22c9-466b-b818-7ae0bc51f657 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:53.784170 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1010/2033] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:05:53 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:05:53.785206 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd044c70-2d42-4285-aec4-ae59c5665c98 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:53.801637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd044c70-2d42-4285-aec4-ae59c5665c98 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:53.810762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca08cb-16ef-473d-b057-b8b58fe7206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:53.813320 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca08cb-16ef-473d-b057-b8b58fe7206b admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:53.814873 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca08cb-16ef-473d-b057-b8b58fe7206b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:53.815504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca08cb-16ef-473d-b057-b8b58fe7206b admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:53.817085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca08cb-16ef-473d-b057-b8b58fe7206b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:53.821013 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca08cb-16ef-473d-b057-b8b58fe7206b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:53.844467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba89508-22c9-466b-b818-7ae0bc51f657 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:53.845338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1024/2034] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:05:53.860226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba89508-22c9-466b-b818-7ae0bc51f657 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:53.868715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39661e28-6491-44a3-9c68-2922664e5088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:53.869864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39661e28-6491-44a3-9c68-2922664e5088 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:53.869864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39661e28-6491-44a3-9c68-2922664e5088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:53.870082 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39661e28-6491-44a3-9c68-2922664e5088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:53.870597 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39661e28-6491-44a3-9c68-2922664e5088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:53.872471 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39661e28-6491-44a3-9c68-2922664e5088 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:53.901821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1011/2035] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:05:53.903697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca08cb-16ef-473d-b057-b8b58fe7206b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:53.916417 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca08cb-16ef-473d-b057-b8b58fe7206b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:53.921648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694c11c-772e-4f9e-bc17-15d8826efc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:53.922596 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694c11c-772e-4f9e-bc17-15d8826efc9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:53.922876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694c11c-772e-4f9e-bc17-15d8826efc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:53.924042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694c11c-772e-4f9e-bc17-15d8826efc9a admin admin] PATH_INFO: `/v3/projects/6541d6c3e74d4ed2a72ad2656ca0352a/users/13dfed2f80d745908b0514444e535ac6/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:53.951709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694c11c-772e-4f9e-bc17-15d8826efc9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6541d6c3e74d4ed2a72ad2656ca0352a, user_id=13dfed2f80d745908b0514444e535ac6, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:53.956886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694c11c-772e-4f9e-bc17-15d8826efc9a admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:53.981880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1025/2036] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:05:53 2022] PUT /identity/v3/projects/6541d6c3e74d4ed2a72ad2656ca0352a/users/13dfed2f80d745908b0514444e535ac6/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:05:53.995210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75ba10-3bed-45f5-8d2d-8c9c1557bde9 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:53.995817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75ba10-3bed-45f5-8d2d-8c9c1557bde9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:53.996319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75ba10-3bed-45f5-8d2d-8c9c1557bde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:54.039919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7c75ba10-3bed-45f5-8d2d-8c9c1557bde9 None None] MFA Rules not processed for user `13dfed2f80d745908b0514444e535ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:05:54.041397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7c75ba10-3bed-45f5-8d2d-8c9c1557bde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:54.156319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1012/2037] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:05:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:05:54.168092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694c11c-772e-4f9e-bc17-15d8826efc9a admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:05:54.177277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5694c11c-772e-4f9e-bc17-15d8826efc9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:05:54.244620 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:05:54.313158 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694c11c-772e-4f9e-bc17-15d8826efc9a admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:05:54.317342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f94427-d562-40bd-8b0e-3c9a9ab25395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:05:54.318282 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f94427-d562-40bd-8b0e-3c9a9ab25395 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:05:54.318809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f94427-d562-40bd-8b0e-3c9a9ab25395 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:05:54.319286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f94427-d562-40bd-8b0e-3c9a9ab25395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:05:54.332883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f94427-d562-40bd-8b0e-3c9a9ab25395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:05:54.334429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f94427-d562-40bd-8b0e-3c9a9ab25395 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:05:54.358005 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1026/2038] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:05:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:06:04.147402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:04.339873 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=17 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:23.601892 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75ba10-3bed-45f5-8d2d-8c9c1557bde9 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:23.606137 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7c75ba10-3bed-45f5-8d2d-8c9c1557bde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:23.888205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75ba10-3bed-45f5-8d2d-8c9c1557bde9 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:23.894058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656772ed-6caa-4f85-9477-f13cfb4ba2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:23.895292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656772ed-6caa-4f85-9477-f13cfb4ba2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:23.895659 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656772ed-6caa-4f85-9477-f13cfb4ba2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:23.896035 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656772ed-6caa-4f85-9477-f13cfb4ba2eb admin admin] PATH_INFO: `/v3/users/477f8bb94b1a477c8c6ccfce9fc9b87f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:23.897442 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656772ed-6caa-4f85-9477-f13cfb4ba2eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=477f8bb94b1a477c8c6ccfce9fc9b87f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:23.910728 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656772ed-6caa-4f85-9477-f13cfb4ba2eb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:24.040497 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-656772ed-6caa-4f85-9477-f13cfb4ba2eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477f8bb94b1a477c8c6ccfce9fc9b87f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:24.073329 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-656772ed-6caa-4f85-9477-f13cfb4ba2eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477f8bb94b1a477c8c6ccfce9fc9b87f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:24.115820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-656772ed-6caa-4f85-9477-f13cfb4ba2eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477f8bb94b1a477c8c6ccfce9fc9b87f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:24.137014 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-656772ed-6caa-4f85-9477-f13cfb4ba2eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477f8bb94b1a477c8c6ccfce9fc9b87f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:24.137827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-656772ed-6caa-4f85-9477-f13cfb4ba2eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477f8bb94b1a477c8c6ccfce9fc9b87f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:24.151103 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1013/2039] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:06:23 2022] DELETE /identity/v3/users/477f8bb94b1a477c8c6ccfce9fc9b87f => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:06:24.155788 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2e71-b5f7-40cf-8022-62f4d6a91860 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:24.158272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2e71-b5f7-40cf-8022-62f4d6a91860 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:24.158865 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2e71-b5f7-40cf-8022-62f4d6a91860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:24.200573 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-41cb2e71-b5f7-40cf-8022-62f4d6a91860 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:24.203379 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-41cb2e71-b5f7-40cf-8022-62f4d6a91860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:24.332504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1027/2040] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:24.352403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656772ed-6caa-4f85-9477-f13cfb4ba2eb admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:24.357393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-656772ed-6caa-4f85-9477-f13cfb4ba2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:24.513468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656772ed-6caa-4f85-9477-f13cfb4ba2eb admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:24.519681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed34ca1-a942-4c15-ba29-d24c8468f323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:24.520531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed34ca1-a942-4c15-ba29-d24c8468f323 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:24.521318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed34ca1-a942-4c15-ba29-d24c8468f323 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:24.521856 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed34ca1-a942-4c15-ba29-d24c8468f323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:24.542855 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed34ca1-a942-4c15-ba29-d24c8468f323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:24.544615 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed34ca1-a942-4c15-ba29-d24c8468f323 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:24.565539 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1014/2041] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:06:25.535977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb2e71-b5f7-40cf-8022-62f4d6a91860 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:25.543397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-41cb2e71-b5f7-40cf-8022-62f4d6a91860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:25.597885 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb2e71-b5f7-40cf-8022-62f4d6a91860 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:25.607371 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd3c11-e713-4ffb-847e-2b92fa7428e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:25.608658 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd3c11-e713-4ffb-847e-2b92fa7428e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:25.609226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd3c11-e713-4ffb-847e-2b92fa7428e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:25.609924 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd3c11-e713-4ffb-847e-2b92fa7428e4 admin admin] PATH_INFO: `/v3/projects/a44a179136e042fa85c1c76db6baeb08` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:25.611694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd3c11-e713-4ffb-847e-2b92fa7428e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a44a179136e042fa85c1c76db6baeb08)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:25.614665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd3c11-e713-4ffb-847e-2b92fa7428e4 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:25.744961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9cbd3c11-e713-4ffb-847e-2b92fa7428e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a44a179136e042fa85c1c76db6baeb08', 'request_id': 'req-9cbd3c11-e713-4ffb-847e-2b92fa7428e4'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:25.763889 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9cbd3c11-e713-4ffb-847e-2b92fa7428e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a44a179136e042fa85c1c76db6baeb08', 'request_id': 'req-9cbd3c11-e713-4ffb-847e-2b92fa7428e4'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:25.793000 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9cbd3c11-e713-4ffb-847e-2b92fa7428e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a44a179136e042fa85c1c76db6baeb08', 'request_id': 'req-9cbd3c11-e713-4ffb-847e-2b92fa7428e4'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:25.830197 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9cbd3c11-e713-4ffb-847e-2b92fa7428e4 admin admin] The token cache is being invalidate because project a44a179136e042fa85c1c76db6baeb08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:06:25.830512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9cbd3c11-e713-4ffb-847e-2b92fa7428e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:25.834074 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9cbd3c11-e713-4ffb-847e-2b92fa7428e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:25.844417 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1028/2042] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:06:25 2022] DELETE /identity/v3/projects/a44a179136e042fa85c1c76db6baeb08 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:06:25.847831 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0850ca-f908-43c4-aa8d-4acc86524c60 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:25.848414 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0850ca-f908-43c4-aa8d-4acc86524c60 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:25.848414 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0850ca-f908-43c4-aa8d-4acc86524c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:25.895358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2f0850ca-f908-43c4-aa8d-4acc86524c60 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:25.896549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2f0850ca-f908-43c4-aa8d-4acc86524c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:25.956970 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:26.105111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1015/2043] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:26.106843 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56324c5d-b07e-4a31-9ac3-1312da5deccd None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:26.107132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56324c5d-b07e-4a31-9ac3-1312da5deccd None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:26.107410 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56324c5d-b07e-4a31-9ac3-1312da5deccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:26.150578 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-56324c5d-b07e-4a31-9ac3-1312da5deccd None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:26.157305 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-56324c5d-b07e-4a31-9ac3-1312da5deccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:26.169930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1029/2044] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:26.174936 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0850ca-f908-43c4-aa8d-4acc86524c60 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:26.191244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0850ca-f908-43c4-aa8d-4acc86524c60 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:26.199718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd1b5a-0030-47e5-be1a-7a9b6969360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:26.206362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd1b5a-0030-47e5-be1a-7a9b6969360d admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:26.206813 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd1b5a-0030-47e5-be1a-7a9b6969360d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:26.207236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd1b5a-0030-47e5-be1a-7a9b6969360d admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:26.208303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd1b5a-0030-47e5-be1a-7a9b6969360d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:06:26.208764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd1b5a-0030-47e5-be1a-7a9b6969360d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:26.213021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd1b5a-0030-47e5-be1a-7a9b6969360d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:26.246971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1016/2045] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:06:26.251128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56324c5d-b07e-4a31-9ac3-1312da5deccd None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:26.262524 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56324c5d-b07e-4a31-9ac3-1312da5deccd None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:26.268594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91e62e-c129-4ae0-a76d-1ac83a59e3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:26.269499 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91e62e-c129-4ae0-a76d-1ac83a59e3a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:26.270389 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91e62e-c129-4ae0-a76d-1ac83a59e3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:26.270917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91e62e-c129-4ae0-a76d-1ac83a59e3a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:26.271727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91e62e-c129-4ae0-a76d-1ac83a59e3a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:26.279464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91e62e-c129-4ae0-a76d-1ac83a59e3a4 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:26.323481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1030/2046] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:06:26 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:06:26.327271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd1b5a-0030-47e5-be1a-7a9b6969360d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:26.341771 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd1b5a-0030-47e5-be1a-7a9b6969360d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:26.473761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1e84e-e4b4-458a-8859-8a2c816cb946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:26.474627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1e84e-e4b4-458a-8859-8a2c816cb946 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:26.475210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1e84e-e4b4-458a-8859-8a2c816cb946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:26.475692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1e84e-e4b4-458a-8859-8a2c816cb946 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:26.476549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1e84e-e4b4-458a-8859-8a2c816cb946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:26.479192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1e84e-e4b4-458a-8859-8a2c816cb946 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:26.521442 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1017/2047] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:06:26 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:06:26.524784 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91e62e-c129-4ae0-a76d-1ac83a59e3a4 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:26.548163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91e62e-c129-4ae0-a76d-1ac83a59e3a4 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:26.560943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ca9a7-5c94-40d2-9f1b-7a7855016dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:26.561800 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ca9a7-5c94-40d2-9f1b-7a7855016dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:26.562230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ca9a7-5c94-40d2-9f1b-7a7855016dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:26.564087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ca9a7-5c94-40d2-9f1b-7a7855016dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:26.565466 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ca9a7-5c94-40d2-9f1b-7a7855016dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:26.569785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ca9a7-5c94-40d2-9f1b-7a7855016dbc admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:26.595996 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1031/2048] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:06:26.599956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1e84e-e4b4-458a-8859-8a2c816cb946 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:26.613701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1e84e-e4b4-458a-8859-8a2c816cb946 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:26.619232 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f51db-d293-405a-8f3e-efaebde627cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:26.620189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f51db-d293-405a-8f3e-efaebde627cb admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:26.620588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f51db-d293-405a-8f3e-efaebde627cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:26.621460 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f51db-d293-405a-8f3e-efaebde627cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:26.621980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f51db-d293-405a-8f3e-efaebde627cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:26.624118 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f51db-d293-405a-8f3e-efaebde627cb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:26.638467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1018/2049] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:06:26.643547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ca9a7-5c94-40d2-9f1b-7a7855016dbc admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:26.659740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ca9a7-5c94-40d2-9f1b-7a7855016dbc admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:26.667701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d19234-6809-46b5-8c5c-3cf7677b55c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:26.669397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d19234-6809-46b5-8c5c-3cf7677b55c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:26.669923 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d19234-6809-46b5-8c5c-3cf7677b55c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:26.670489 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d19234-6809-46b5-8c5c-3cf7677b55c4 admin admin] PATH_INFO: `/v3/projects/6ff6ba7ce31d47bbb0edeaa5599683aa/users/c6e0f037e28046ca8bbd2368de050b44/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:26.693381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d19234-6809-46b5-8c5c-3cf7677b55c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff6ba7ce31d47bbb0edeaa5599683aa, user_id=c6e0f037e28046ca8bbd2368de050b44, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:26.698125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d19234-6809-46b5-8c5c-3cf7677b55c4 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:26.720814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1032/2050] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:06:26 2022] PUT /identity/v3/projects/6ff6ba7ce31d47bbb0edeaa5599683aa/users/c6e0f037e28046ca8bbd2368de050b44/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:06:26.731329 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0663e-a770-402a-9b34-40ac35b61299 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:26.731762 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0663e-a770-402a-9b34-40ac35b61299 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:26.732208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0663e-a770-402a-9b34-40ac35b61299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:26.774938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4aa0663e-a770-402a-9b34-40ac35b61299 None None] MFA Rules not processed for user `c6e0f037e28046ca8bbd2368de050b44`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:26.776989 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4aa0663e-a770-402a-9b34-40ac35b61299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:26.884282 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1019/2051] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:27.082089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d19234-6809-46b5-8c5c-3cf7677b55c4 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:27.089326 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-90d19234-6809-46b5-8c5c-3cf7677b55c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:27.113635 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0663e-a770-402a-9b34-40ac35b61299 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:27.116129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4aa0663e-a770-402a-9b34-40ac35b61299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:27.142218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:27.164516 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:27.206093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d19234-6809-46b5-8c5c-3cf7677b55c4 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:27.211508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb0675-59fd-4e66-b08e-46a29575e5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:27.212448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb0675-59fd-4e66-b08e-46a29575e5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:27.212874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb0675-59fd-4e66-b08e-46a29575e5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:27.213244 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb0675-59fd-4e66-b08e-46a29575e5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:27.225663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb0675-59fd-4e66-b08e-46a29575e5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:27.228678 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb0675-59fd-4e66-b08e-46a29575e5c6 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:27.245118 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1033/2052] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:06:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:06:27.284884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0663e-a770-402a-9b34-40ac35b61299 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:27.290621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5993a-649f-404d-b771-55f12cd7bbbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:27.291266 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5993a-649f-404d-b771-55f12cd7bbbd service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:27.291553 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5993a-649f-404d-b771-55f12cd7bbbd service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:27.291829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5993a-649f-404d-b771-55f12cd7bbbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:27.293865 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e4b5993a-649f-404d-b771-55f12cd7bbbd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:27.308237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5993a-649f-404d-b771-55f12cd7bbbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:27.310240 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5993a-649f-404d-b771-55f12cd7bbbd service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:27.335976 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1020/2053] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:06:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:06:29.060991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb0675-59fd-4e66-b08e-46a29575e5c6 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:29.198675 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb0675-59fd-4e66-b08e-46a29575e5c6 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:29.204277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c424a-8932-48d6-bdf8-7f2f6d051014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:29.206889 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c424a-8932-48d6-bdf8-7f2f6d051014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:29.207325 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c424a-8932-48d6-bdf8-7f2f6d051014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:29.209985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c424a-8932-48d6-bdf8-7f2f6d051014 admin admin] PATH_INFO: `/v3/users/c6e0f037e28046ca8bbd2368de050b44` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:29.212870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c424a-8932-48d6-bdf8-7f2f6d051014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e0f037e28046ca8bbd2368de050b44)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:29.219536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c424a-8932-48d6-bdf8-7f2f6d051014 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:29.326245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-691c424a-8932-48d6-bdf8-7f2f6d051014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e0f037e28046ca8bbd2368de050b44'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:29.349437 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-691c424a-8932-48d6-bdf8-7f2f6d051014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e0f037e28046ca8bbd2368de050b44'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:29.384375 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-691c424a-8932-48d6-bdf8-7f2f6d051014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e0f037e28046ca8bbd2368de050b44'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:29.396989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-691c424a-8932-48d6-bdf8-7f2f6d051014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e0f037e28046ca8bbd2368de050b44'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:29.415757 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-691c424a-8932-48d6-bdf8-7f2f6d051014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e0f037e28046ca8bbd2368de050b44'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:29.449231 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e42397-4485-4cd9-bce7-0981f1bf4e4f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:29.450104 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e42397-4485-4cd9-bce7-0981f1bf4e4f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:29.450555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e42397-4485-4cd9-bce7-0981f1bf4e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:29.451143 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1034/2054] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:06:29 2022] DELETE /identity/v3/users/c6e0f037e28046ca8bbd2368de050b44 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:06:29.488874 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-49e42397-4485-4cd9-bce7-0981f1bf4e4f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:29.491652 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-49e42397-4485-4cd9-bce7-0981f1bf4e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:29.586258 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1021/2055] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:29.605050 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c424a-8932-48d6-bdf8-7f2f6d051014 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:29.607284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-691c424a-8932-48d6-bdf8-7f2f6d051014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:29.684545 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:29.708589 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c424a-8932-48d6-bdf8-7f2f6d051014 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:29.712754 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01af237-063f-47e0-8e47-416556a50646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:29.713868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01af237-063f-47e0-8e47-416556a50646 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:29.714317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01af237-063f-47e0-8e47-416556a50646 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:29.714892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01af237-063f-47e0-8e47-416556a50646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:29.726992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01af237-063f-47e0-8e47-416556a50646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:29.728920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01af237-063f-47e0-8e47-416556a50646 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:29.744430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1035/2056] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:06:32.738045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e42397-4485-4cd9-bce7-0981f1bf4e4f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:32.739537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-49e42397-4485-4cd9-bce7-0981f1bf4e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:32.767767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e42397-4485-4cd9-bce7-0981f1bf4e4f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:32.777513 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69230654-8e17-4649-8afb-9c8799efb493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:32.779046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69230654-8e17-4649-8afb-9c8799efb493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:32.779594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69230654-8e17-4649-8afb-9c8799efb493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:32.780060 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69230654-8e17-4649-8afb-9c8799efb493 admin admin] PATH_INFO: `/v3/users/13dfed2f80d745908b0514444e535ac6` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:32.781899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69230654-8e17-4649-8afb-9c8799efb493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13dfed2f80d745908b0514444e535ac6)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:32.784110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69230654-8e17-4649-8afb-9c8799efb493 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:32.813023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01af237-063f-47e0-8e47-416556a50646 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:32.814510 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e01af237-063f-47e0-8e47-416556a50646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:32.860708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01af237-063f-47e0-8e47-416556a50646 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:32.879771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970911c4-5fe5-425d-8aa4-446267789267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:32.880502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970911c4-5fe5-425d-8aa4-446267789267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:32.880781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970911c4-5fe5-425d-8aa4-446267789267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:32.881054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970911c4-5fe5-425d-8aa4-446267789267 admin admin] PATH_INFO: `/v3/projects/6ff6ba7ce31d47bbb0edeaa5599683aa` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:32.882723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970911c4-5fe5-425d-8aa4-446267789267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff6ba7ce31d47bbb0edeaa5599683aa)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:32.885923 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970911c4-5fe5-425d-8aa4-446267789267 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:32.895200 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-69230654-8e17-4649-8afb-9c8799efb493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13dfed2f80d745908b0514444e535ac6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:32.911487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-69230654-8e17-4649-8afb-9c8799efb493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13dfed2f80d745908b0514444e535ac6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:32.942852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-69230654-8e17-4649-8afb-9c8799efb493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13dfed2f80d745908b0514444e535ac6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:32.960295 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-69230654-8e17-4649-8afb-9c8799efb493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13dfed2f80d745908b0514444e535ac6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:32.961194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-69230654-8e17-4649-8afb-9c8799efb493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13dfed2f80d745908b0514444e535ac6'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:32.971982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1022/2057] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:06:32 2022] DELETE /identity/v3/users/13dfed2f80d745908b0514444e535ac6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:06:32.981796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3361fa-b9c5-47b7-9560-a4d6c5b5424d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:32.982149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3361fa-b9c5-47b7-9560-a4d6c5b5424d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:32.982359 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3361fa-b9c5-47b7-9560-a4d6c5b5424d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:33.010663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-970911c4-5fe5-425d-8aa4-446267789267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff6ba7ce31d47bbb0edeaa5599683aa', 'request_id': 'req-970911c4-5fe5-425d-8aa4-446267789267'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:33.021100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-fb3361fa-b9c5-47b7-9560-a4d6c5b5424d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:33.024942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-fb3361fa-b9c5-47b7-9560-a4d6c5b5424d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:33.026235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-970911c4-5fe5-425d-8aa4-446267789267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff6ba7ce31d47bbb0edeaa5599683aa', 'request_id': 'req-970911c4-5fe5-425d-8aa4-446267789267'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:33.045638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-970911c4-5fe5-425d-8aa4-446267789267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff6ba7ce31d47bbb0edeaa5599683aa', 'request_id': 'req-970911c4-5fe5-425d-8aa4-446267789267'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:33.057687 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:33.086183 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-970911c4-5fe5-425d-8aa4-446267789267 admin admin] The token cache is being invalidate because project 6ff6ba7ce31d47bbb0edeaa5599683aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:06:33.086779 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-970911c4-5fe5-425d-8aa4-446267789267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:33.090602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-970911c4-5fe5-425d-8aa4-446267789267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:33.097382 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1036/2058] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:06:32 2022] DELETE /identity/v3/projects/6ff6ba7ce31d47bbb0edeaa5599683aa => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:06:33.103424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ca4ed-de38-4193-9766-ce80e79c52e7 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:33.104892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ca4ed-de38-4193-9766-ce80e79c52e7 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:33.105402 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ca4ed-de38-4193-9766-ce80e79c52e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:33.154969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-4e1ca4ed-de38-4193-9766-ce80e79c52e7 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:33.160904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4e1ca4ed-de38-4193-9766-ce80e79c52e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:33.188468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1023/2059] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:33.287993 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1037/2060] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:06:33.292117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b09a6-c134-43e6-bfb8-98a4aa5bacc0 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:33.292941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b09a6-c134-43e6-bfb8-98a4aa5bacc0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:33.293407 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b09a6-c134-43e6-bfb8-98a4aa5bacc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:33.323044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ca4ed-de38-4193-9766-ce80e79c52e7 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:33.325491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4e1ca4ed-de38-4193-9766-ce80e79c52e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:33.364108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a22b09a6-c134-43e6-bfb8-98a4aa5bacc0 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:33.371102 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a22b09a6-c134-43e6-bfb8-98a4aa5bacc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:33.431704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1024/2061] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:06:33.437014 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b09a6-c134-43e6-bfb8-98a4aa5bacc0 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:33.473145 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b09a6-c134-43e6-bfb8-98a4aa5bacc0 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:33.479227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f950e-cddd-4016-b219-52261ad2f1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:33.479875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f950e-cddd-4016-b219-52261ad2f1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:33.480202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f950e-cddd-4016-b219-52261ad2f1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:33.480478 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f950e-cddd-4016-b219-52261ad2f1c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:33.481156 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f950e-cddd-4016-b219-52261ad2f1c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:06:33.481464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f950e-cddd-4016-b219-52261ad2f1c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:33.483114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f950e-cddd-4016-b219-52261ad2f1c4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:33.513372 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1025/2062] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:06:33.513690 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f950e-cddd-4016-b219-52261ad2f1c4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:33.525713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f950e-cddd-4016-b219-52261ad2f1c4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:33.530782 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f9636-3ac3-42b3-9f8c-7f23dd34203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:33.532222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f9636-3ac3-42b3-9f8c-7f23dd34203f admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:33.532590 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f9636-3ac3-42b3-9f8c-7f23dd34203f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:33.533060 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f9636-3ac3-42b3-9f8c-7f23dd34203f admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:33.533707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f9636-3ac3-42b3-9f8c-7f23dd34203f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:33.536164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f9636-3ac3-42b3-9f8c-7f23dd34203f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:33.549631 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ca4ed-de38-4193-9766-ce80e79c52e7 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:33.559849 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ec911-fd0e-4938-8441-dd010cfc110d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:33.560146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ec911-fd0e-4938-8441-dd010cfc110d service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:33.560298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ec911-fd0e-4938-8441-dd010cfc110d service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:33.560534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ec911-fd0e-4938-8441-dd010cfc110d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:33.575367 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ec911-fd0e-4938-8441-dd010cfc110d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:33.576760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ec911-fd0e-4938-8441-dd010cfc110d service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:33.589881 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1026/2063] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:06:33 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:06:33.592053 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1038/2064] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:06:33.596479 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ec911-fd0e-4938-8441-dd010cfc110d service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:33.609954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ec911-fd0e-4938-8441-dd010cfc110d service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:33.650543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:33.781224 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490809ea-f62f-4907-829c-f8e1cc684cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:33.782111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490809ea-f62f-4907-829c-f8e1cc684cea admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:33.783194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490809ea-f62f-4907-829c-f8e1cc684cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:33.783662 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490809ea-f62f-4907-829c-f8e1cc684cea admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:33.785598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490809ea-f62f-4907-829c-f8e1cc684cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:33.793290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490809ea-f62f-4907-829c-f8e1cc684cea admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:33.860887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1039/2065] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:06:33 2022] POST /identity/v3/users => generated 290 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:06:33.865174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f9636-3ac3-42b3-9f8c-7f23dd34203f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:33.876569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f9636-3ac3-42b3-9f8c-7f23dd34203f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:33.892002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee007b4e-ee28-4566-b6a1-68e0f660f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:33.892790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee007b4e-ee28-4566-b6a1-68e0f660f2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:33.893146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee007b4e-ee28-4566-b6a1-68e0f660f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:33.893515 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee007b4e-ee28-4566-b6a1-68e0f660f2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:33.894257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee007b4e-ee28-4566-b6a1-68e0f660f2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:33.896000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee007b4e-ee28-4566-b6a1-68e0f660f2b6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:33.913189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1027/2066] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:06:33.915285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490809ea-f62f-4907-829c-f8e1cc684cea admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:33.969643 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490809ea-f62f-4907-829c-f8e1cc684cea admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:33.993135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764227f-6892-4a13-bb45-476ad7fee705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:33.993789 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764227f-6892-4a13-bb45-476ad7fee705 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:33.994167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764227f-6892-4a13-bb45-476ad7fee705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:33.994440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764227f-6892-4a13-bb45-476ad7fee705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:33.995443 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764227f-6892-4a13-bb45-476ad7fee705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:33.997251 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764227f-6892-4a13-bb45-476ad7fee705 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:34.023729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1040/2067] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:06:34.028367 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee007b4e-ee28-4566-b6a1-68e0f660f2b6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:34.054333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee007b4e-ee28-4566-b6a1-68e0f660f2b6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:34.069967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b1cb6-1ab3-4272-89ef-f84cce5c03cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:34.070830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b1cb6-1ab3-4272-89ef-f84cce5c03cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:34.071690 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b1cb6-1ab3-4272-89ef-f84cce5c03cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:34.074667 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b1cb6-1ab3-4272-89ef-f84cce5c03cc admin admin] PATH_INFO: `/v3/projects/d387d6236e984424ba1bd292bfc7b652/users/817af3d4eeda4716858499ea7dd84f00/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:34.131793 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b1cb6-1ab3-4272-89ef-f84cce5c03cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d387d6236e984424ba1bd292bfc7b652, user_id=817af3d4eeda4716858499ea7dd84f00, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:34.137630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b1cb6-1ab3-4272-89ef-f84cce5c03cc admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:34.192733 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1028/2068] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:06:34 2022] PUT /identity/v3/projects/d387d6236e984424ba1bd292bfc7b652/users/817af3d4eeda4716858499ea7dd84f00/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:06:34.198222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441f766-138a-4df0-8e63-3a379e007c6a None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:34.198554 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441f766-138a-4df0-8e63-3a379e007c6a None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:34.198890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441f766-138a-4df0-8e63-3a379e007c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:34.239788 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c441f766-138a-4df0-8e63-3a379e007c6a None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:34.241100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c441f766-138a-4df0-8e63-3a379e007c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:34.467825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1041/2069] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:34.511192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b1cb6-1ab3-4272-89ef-f84cce5c03cc admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:34.513106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a98b1cb6-1ab3-4272-89ef-f84cce5c03cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:34.668480 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b1cb6-1ab3-4272-89ef-f84cce5c03cc admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:34.689456 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b2794-831f-4904-9d60-74950a8dab08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:34.690591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b2794-831f-4904-9d60-74950a8dab08 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:34.691257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b2794-831f-4904-9d60-74950a8dab08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:34.691880 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b2794-831f-4904-9d60-74950a8dab08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:34.728495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b2794-831f-4904-9d60-74950a8dab08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:34.730211 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b2794-831f-4904-9d60-74950a8dab08 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:34.752426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1029/2070] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:06:34.775529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441f766-138a-4df0-8e63-3a379e007c6a None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:34.777038 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c441f766-138a-4df0-8e63-3a379e007c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:34.792142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441f766-138a-4df0-8e63-3a379e007c6a None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:34.806735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e4141-91c7-4e69-9526-c5da92acf734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:34.808312 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e4141-91c7-4e69-9526-c5da92acf734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:34.808312 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e4141-91c7-4e69-9526-c5da92acf734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:34.808312 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e4141-91c7-4e69-9526-c5da92acf734 admin admin] PATH_INFO: `/v3/projects/6541d6c3e74d4ed2a72ad2656ca0352a` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:34.811537 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e4141-91c7-4e69-9526-c5da92acf734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6541d6c3e74d4ed2a72ad2656ca0352a)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:34.813961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e4141-91c7-4e69-9526-c5da92acf734 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:34.919573 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-164e4141-91c7-4e69-9526-c5da92acf734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6541d6c3e74d4ed2a72ad2656ca0352a', 'request_id': 'req-164e4141-91c7-4e69-9526-c5da92acf734'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:34.929611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-164e4141-91c7-4e69-9526-c5da92acf734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6541d6c3e74d4ed2a72ad2656ca0352a', 'request_id': 'req-164e4141-91c7-4e69-9526-c5da92acf734'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:34.944754 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-164e4141-91c7-4e69-9526-c5da92acf734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6541d6c3e74d4ed2a72ad2656ca0352a', 'request_id': 'req-164e4141-91c7-4e69-9526-c5da92acf734'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:34.973926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-164e4141-91c7-4e69-9526-c5da92acf734 admin admin] The token cache is being invalidate because project 6541d6c3e74d4ed2a72ad2656ca0352a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:06:34.974318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-164e4141-91c7-4e69-9526-c5da92acf734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:34.975868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-164e4141-91c7-4e69-9526-c5da92acf734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:34.977891 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1042/2071] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:06:34 2022] DELETE /identity/v3/projects/6541d6c3e74d4ed2a72ad2656ca0352a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:06:34.982693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b02f0c-eabb-4faf-aae8-e32c4d048f13 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:34.983196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b02f0c-eabb-4faf-aae8-e32c4d048f13 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:34.983303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b02f0c-eabb-4faf-aae8-e32c4d048f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:35.014453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-17b02f0c-eabb-4faf-aae8-e32c4d048f13 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:35.018956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-17b02f0c-eabb-4faf-aae8-e32c4d048f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:35.108486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:35.137149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1030/2072] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:35.145820 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662642ca-59ba-4117-9edb-5846754289aa None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:35.146098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662642ca-59ba-4117-9edb-5846754289aa None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:35.146366 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662642ca-59ba-4117-9edb-5846754289aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:35.191288 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-662642ca-59ba-4117-9edb-5846754289aa None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:35.194114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-662642ca-59ba-4117-9edb-5846754289aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:35.218087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1043/2073] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:35.220346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b02f0c-eabb-4faf-aae8-e32c4d048f13 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:35.249030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b02f0c-eabb-4faf-aae8-e32c4d048f13 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:35.257227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4319965-fd22-4627-9e77-a87969d199f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:35.257998 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4319965-fd22-4627-9e77-a87969d199f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:35.258377 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4319965-fd22-4627-9e77-a87969d199f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:35.258863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4319965-fd22-4627-9e77-a87969d199f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:35.259663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4319965-fd22-4627-9e77-a87969d199f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:06:35.260131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4319965-fd22-4627-9e77-a87969d199f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:35.263689 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4319965-fd22-4627-9e77-a87969d199f8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:35.295550 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1031/2074] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:06:35.296379 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662642ca-59ba-4117-9edb-5846754289aa None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:35.308892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662642ca-59ba-4117-9edb-5846754289aa None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:35.314119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481b50c-8b89-494f-9d41-f78cf26af700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:35.314901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481b50c-8b89-494f-9d41-f78cf26af700 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:35.315093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481b50c-8b89-494f-9d41-f78cf26af700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:35.315316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481b50c-8b89-494f-9d41-f78cf26af700 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:35.316001 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481b50c-8b89-494f-9d41-f78cf26af700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:35.318888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481b50c-8b89-494f-9d41-f78cf26af700 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:35.325165 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:35.371769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1044/2075] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:06:35 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:06:35.377886 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4319965-fd22-4627-9e77-a87969d199f8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:35.409412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4319965-fd22-4627-9e77-a87969d199f8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:35.501183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbd0e1-e8a8-4ea8-bf4d-89b234d2b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:35.502046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbd0e1-e8a8-4ea8-bf4d-89b234d2b2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:35.502399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbd0e1-e8a8-4ea8-bf4d-89b234d2b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:35.502733 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbd0e1-e8a8-4ea8-bf4d-89b234d2b2c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:35.503479 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbd0e1-e8a8-4ea8-bf4d-89b234d2b2c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:35.505873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbd0e1-e8a8-4ea8-bf4d-89b234d2b2c8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:35.540537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1032/2076] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:06:35 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:06:35.545189 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481b50c-8b89-494f-9d41-f78cf26af700 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:35.565755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481b50c-8b89-494f-9d41-f78cf26af700 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:35.571428 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489a830-d301-4dfe-885f-c8eb823f2960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:35.572380 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489a830-d301-4dfe-885f-c8eb823f2960 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:35.572735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489a830-d301-4dfe-885f-c8eb823f2960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:35.573441 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489a830-d301-4dfe-885f-c8eb823f2960 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:35.573848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489a830-d301-4dfe-885f-c8eb823f2960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:35.575628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489a830-d301-4dfe-885f-c8eb823f2960 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:35.591197 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1045/2077] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:06:35.592557 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbd0e1-e8a8-4ea8-bf4d-89b234d2b2c8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:35.605260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbd0e1-e8a8-4ea8-bf4d-89b234d2b2c8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:35.614030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a41d3f-7d4c-4166-b4e5-35e04fe4d4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:35.614389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a41d3f-7d4c-4166-b4e5-35e04fe4d4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:35.614490 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a41d3f-7d4c-4166-b4e5-35e04fe4d4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:35.614716 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a41d3f-7d4c-4166-b4e5-35e04fe4d4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:35.615501 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a41d3f-7d4c-4166-b4e5-35e04fe4d4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:35.617696 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a41d3f-7d4c-4166-b4e5-35e04fe4d4c1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:35.639265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1033/2078] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:06:35.640748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489a830-d301-4dfe-885f-c8eb823f2960 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:35.656533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489a830-d301-4dfe-885f-c8eb823f2960 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:35.667537 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d4c4e-ae32-48f7-b002-18eece332b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:35.668757 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d4c4e-ae32-48f7-b002-18eece332b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:35.669266 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d4c4e-ae32-48f7-b002-18eece332b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:35.670292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d4c4e-ae32-48f7-b002-18eece332b23 admin admin] PATH_INFO: `/v3/projects/c1b318714ed541c891ea51675da73736/users/7bb1da3181fc4eacb1be9b96d76d92ed/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:35.720168 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d4c4e-ae32-48f7-b002-18eece332b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b318714ed541c891ea51675da73736, user_id=7bb1da3181fc4eacb1be9b96d76d92ed, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:35.724581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d4c4e-ae32-48f7-b002-18eece332b23 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:35.782962 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1046/2079] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:06:35 2022] PUT /identity/v3/projects/c1b318714ed541c891ea51675da73736/users/7bb1da3181fc4eacb1be9b96d76d92ed/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:06:35.789500 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17708a4-4b8c-4453-a97a-b9eabccbde31 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:35.790130 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17708a4-4b8c-4453-a97a-b9eabccbde31 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:35.790585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17708a4-4b8c-4453-a97a-b9eabccbde31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:35.857791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b17708a4-4b8c-4453-a97a-b9eabccbde31 None None] MFA Rules not processed for user `7bb1da3181fc4eacb1be9b96d76d92ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:35.860023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b17708a4-4b8c-4453-a97a-b9eabccbde31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:36.127637 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1034/2080] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:36.200227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d4c4e-ae32-48f7-b002-18eece332b23 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:36.205623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-434d4c4e-ae32-48f7-b002-18eece332b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:36.441778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d4c4e-ae32-48f7-b002-18eece332b23 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:36.447588 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cae91-2353-4e7b-b588-0418ea3dbfc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:36.448448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cae91-2353-4e7b-b588-0418ea3dbfc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:36.449077 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cae91-2353-4e7b-b588-0418ea3dbfc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:36.450762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cae91-2353-4e7b-b588-0418ea3dbfc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:36.479597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cae91-2353-4e7b-b588-0418ea3dbfc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:36.482277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cae91-2353-4e7b-b588-0418ea3dbfc1 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:36.503341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1047/2081] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:06:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:06:40.248012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01766c1b-26e1-4bee-abba-21c05f5aabc4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:40.248519 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01766c1b-26e1-4bee-abba-21c05f5aabc4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:40.248615 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01766c1b-26e1-4bee-abba-21c05f5aabc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:40.346079 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-01766c1b-26e1-4bee-abba-21c05f5aabc4 None None] MFA Rules not processed for user `817af3d4eeda4716858499ea7dd84f00`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:40.347854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-01766c1b-26e1-4bee-abba-21c05f5aabc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:40.445539 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:40.589737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1035/2082] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:40.595641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cae91-2353-4e7b-b588-0418ea3dbfc1 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:40.597205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ca8cae91-2353-4e7b-b588-0418ea3dbfc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:40.777305 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cae91-2353-4e7b-b588-0418ea3dbfc1 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:40.793946 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47aa6c-c3da-47ce-b7a7-18771b0cd600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:40.800108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47aa6c-c3da-47ce-b7a7-18771b0cd600 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:40.800809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47aa6c-c3da-47ce-b7a7-18771b0cd600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:40.801285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47aa6c-c3da-47ce-b7a7-18771b0cd600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:40.805444 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47aa6c-c3da-47ce-b7a7-18771b0cd600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:40.815832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47aa6c-c3da-47ce-b7a7-18771b0cd600 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:40.897177 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1048/2083] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:06:40 2022] POST /identity/v3/projects => generated 377 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:06:40.901843 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01766c1b-26e1-4bee-abba-21c05f5aabc4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:40.931464 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01766c1b-26e1-4bee-abba-21c05f5aabc4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:41.009673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124cb3b-faa2-4406-a974-48f9e4db7193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:41.010647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124cb3b-faa2-4406-a974-48f9e4db7193 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:41.011033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124cb3b-faa2-4406-a974-48f9e4db7193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:41.011409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124cb3b-faa2-4406-a974-48f9e4db7193 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:41.012422 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124cb3b-faa2-4406-a974-48f9e4db7193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:41.016043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124cb3b-faa2-4406-a974-48f9e4db7193 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:41.054218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1036/2084] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:06:40 2022] POST /identity/v3/users => generated 295 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:06:41.055182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47aa6c-c3da-47ce-b7a7-18771b0cd600 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:41.074483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47aa6c-c3da-47ce-b7a7-18771b0cd600 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:41.090063 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705aee6b-d5f3-427f-b0cf-cf7e8b72dfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:41.090711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705aee6b-d5f3-427f-b0cf-cf7e8b72dfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:41.090992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705aee6b-d5f3-427f-b0cf-cf7e8b72dfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:41.091278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705aee6b-d5f3-427f-b0cf-cf7e8b72dfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:41.091961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705aee6b-d5f3-427f-b0cf-cf7e8b72dfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:41.094395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705aee6b-d5f3-427f-b0cf-cf7e8b72dfe5 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:41.116796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1049/2085] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:06:41.120457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124cb3b-faa2-4406-a974-48f9e4db7193 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:41.149227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124cb3b-faa2-4406-a974-48f9e4db7193 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:41.165910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77d3b8-d3a7-42cb-8a4c-63b603690fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:41.166780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77d3b8-d3a7-42cb-8a4c-63b603690fef admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:41.167643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77d3b8-d3a7-42cb-8a4c-63b603690fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:41.167643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77d3b8-d3a7-42cb-8a4c-63b603690fef admin admin] PATH_INFO: `/v3/projects/79100dd39d8a46cc922ee53416aa4818/users/371e35ae51f6492f979983d080476dca/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:41.190529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77d3b8-d3a7-42cb-8a4c-63b603690fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=79100dd39d8a46cc922ee53416aa4818, user_id=371e35ae51f6492f979983d080476dca, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:41.197842 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77d3b8-d3a7-42cb-8a4c-63b603690fef admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:41.254996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1037/2086] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:06:41 2022] PUT /identity/v3/projects/79100dd39d8a46cc922ee53416aa4818/users/371e35ae51f6492f979983d080476dca/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:06:41.256540 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705aee6b-d5f3-427f-b0cf-cf7e8b72dfe5 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:41.278156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705aee6b-d5f3-427f-b0cf-cf7e8b72dfe5 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:41.337499 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:41.440671 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b80d02-02d7-4cda-b3b2-83cc8f00d3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:41.441737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80d02-02d7-4cda-b3b2-83cc8f00d3dd admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:41.442250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80d02-02d7-4cda-b3b2-83cc8f00d3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:41.442886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80d02-02d7-4cda-b3b2-83cc8f00d3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:41.443774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b80d02-02d7-4cda-b3b2-83cc8f00d3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:41.448211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b80d02-02d7-4cda-b3b2-83cc8f00d3dd admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:41.466703 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1050/2087] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:06:41.473017 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77d3b8-d3a7-42cb-8a4c-63b603690fef admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:41.488316 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77d3b8-d3a7-42cb-8a4c-63b603690fef admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:41.526297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838b8f6-6104-439e-afcb-a89ea717bbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:41.527042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838b8f6-6104-439e-afcb-a89ea717bbae admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:41.527338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838b8f6-6104-439e-afcb-a89ea717bbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:41.527601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838b8f6-6104-439e-afcb-a89ea717bbae admin admin] PATH_INFO: `/v3/projects/79100dd39d8a46cc922ee53416aa4818/users/371e35ae51f6492f979983d080476dca/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:41.533542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838b8f6-6104-439e-afcb-a89ea717bbae admin admin] RBAC: Authorizing `identity:create_grant(project_id=79100dd39d8a46cc922ee53416aa4818, user_id=371e35ae51f6492f979983d080476dca, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:41.539779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838b8f6-6104-439e-afcb-a89ea717bbae admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:41.569499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1038/2088] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:06:41 2022] PUT /identity/v3/projects/79100dd39d8a46cc922ee53416aa4818/users/371e35ae51f6492f979983d080476dca/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:06:49.297312 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec30407-cff5-4fab-acfc-7d7ffbb899c9 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:49.297801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec30407-cff5-4fab-acfc-7d7ffbb899c9 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:49.298313 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec30407-cff5-4fab-acfc-7d7ffbb899c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:49.340058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-9ec30407-cff5-4fab-acfc-7d7ffbb899c9 None None] MFA Rules not processed for user `371e35ae51f6492f979983d080476dca`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:49.341305 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9ec30407-cff5-4fab-acfc-7d7ffbb899c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:49.444001 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1051/2089] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:49.455570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c246-0185-4ab1-8c7a-ae9bc52d53da None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:49.456661 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c246-0185-4ab1-8c7a-ae9bc52d53da None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:49.457149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c246-0185-4ab1-8c7a-ae9bc52d53da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:49.491739 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e193c246-0185-4ab1-8c7a-ae9bc52d53da None None] MFA Rules not processed for user `817af3d4eeda4716858499ea7dd84f00`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:49.493191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e193c246-0185-4ab1-8c7a-ae9bc52d53da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:49.597431 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1039/2090] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:49.606181 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec30407-cff5-4fab-acfc-7d7ffbb899c9 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:49.608686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9ec30407-cff5-4fab-acfc-7d7ffbb899c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:49.737173 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec30407-cff5-4fab-acfc-7d7ffbb899c9 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:49.743972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9474b6-f8e8-4d32-9b1e-33bb0f3e1f6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:49.744670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9474b6-f8e8-4d32-9b1e-33bb0f3e1f6a service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:49.745255 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9474b6-f8e8-4d32-9b1e-33bb0f3e1f6a service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:49.745255 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9474b6-f8e8-4d32-9b1e-33bb0f3e1f6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:49.759401 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9474b6-f8e8-4d32-9b1e-33bb0f3e1f6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:49.761959 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9474b6-f8e8-4d32-9b1e-33bb0f3e1f6a service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:49.780131 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1052/2091] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:06:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:06:50.616913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193c246-0185-4ab1-8c7a-ae9bc52d53da None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:50.618380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e193c246-0185-4ab1-8c7a-ae9bc52d53da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:50.704118 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:50.767250 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193c246-0185-4ab1-8c7a-ae9bc52d53da None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:50.774105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5f328-96ad-47de-8cf6-2a9312341c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:50.774774 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5f328-96ad-47de-8cf6-2a9312341c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:50.775052 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5f328-96ad-47de-8cf6-2a9312341c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:50.775322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5f328-96ad-47de-8cf6-2a9312341c52 admin admin] PATH_INFO: `/v3/users/219a6829c2ae4de59af799110590d106` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:50.776541 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5f328-96ad-47de-8cf6-2a9312341c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=219a6829c2ae4de59af799110590d106)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:50.778518 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5f328-96ad-47de-8cf6-2a9312341c52 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:50.864082 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cbd5f328-96ad-47de-8cf6-2a9312341c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219a6829c2ae4de59af799110590d106'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:50.878487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cbd5f328-96ad-47de-8cf6-2a9312341c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219a6829c2ae4de59af799110590d106'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:50.915514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cbd5f328-96ad-47de-8cf6-2a9312341c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219a6829c2ae4de59af799110590d106'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:50.928926 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cbd5f328-96ad-47de-8cf6-2a9312341c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219a6829c2ae4de59af799110590d106'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:50.930089 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cbd5f328-96ad-47de-8cf6-2a9312341c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219a6829c2ae4de59af799110590d106'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:50.942380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1040/2092] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:06:50 2022] DELETE /identity/v3/users/219a6829c2ae4de59af799110590d106 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:06:51.959273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9474b6-f8e8-4d32-9b1e-33bb0f3e1f6a service nova] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:51.979529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9474b6-f8e8-4d32-9b1e-33bb0f3e1f6a service nova] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:52.119843 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:52.211018 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412fc83-cee9-476a-82d7-a7fef8831d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:52.212378 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412fc83-cee9-476a-82d7-a7fef8831d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:52.212956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412fc83-cee9-476a-82d7-a7fef8831d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:52.213495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412fc83-cee9-476a-82d7-a7fef8831d5b admin admin] PATH_INFO: `/v3/projects/f19d01eeb6c14947ac9e68216200e707` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:52.215054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412fc83-cee9-476a-82d7-a7fef8831d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19d01eeb6c14947ac9e68216200e707)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:52.217367 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412fc83-cee9-476a-82d7-a7fef8831d5b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:52.338710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6412fc83-cee9-476a-82d7-a7fef8831d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19d01eeb6c14947ac9e68216200e707', 'request_id': 'req-6412fc83-cee9-476a-82d7-a7fef8831d5b'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:52.352612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6412fc83-cee9-476a-82d7-a7fef8831d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19d01eeb6c14947ac9e68216200e707', 'request_id': 'req-6412fc83-cee9-476a-82d7-a7fef8831d5b'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:52.366621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6412fc83-cee9-476a-82d7-a7fef8831d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19d01eeb6c14947ac9e68216200e707', 'request_id': 'req-6412fc83-cee9-476a-82d7-a7fef8831d5b'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:52.394034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6412fc83-cee9-476a-82d7-a7fef8831d5b admin admin] The token cache is being invalidate because project f19d01eeb6c14947ac9e68216200e707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:06:52.398055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6412fc83-cee9-476a-82d7-a7fef8831d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:52.399236 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6412fc83-cee9-476a-82d7-a7fef8831d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:52.407927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be679db3-7d5a-4457-a901-1bc081825b00 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:52.409294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1053/2093] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:06:51 2022] DELETE /identity/v3/projects/f19d01eeb6c14947ac9e68216200e707 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:06:52.409863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be679db3-7d5a-4457-a901-1bc081825b00 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:52.410039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be679db3-7d5a-4457-a901-1bc081825b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:52.485565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-be679db3-7d5a-4457-a901-1bc081825b00 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:52.489012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-be679db3-7d5a-4457-a901-1bc081825b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:52.685771 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1041/2094] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:52.691763 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb8507-e120-401f-8186-ab54510b051f None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:52.691763 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb8507-e120-401f-8186-ab54510b051f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:52.691763 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb8507-e120-401f-8186-ab54510b051f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:52.781297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-70cb8507-e120-401f-8186-ab54510b051f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:52.786814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-70cb8507-e120-401f-8186-ab54510b051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:52.827657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be679db3-7d5a-4457-a901-1bc081825b00 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:52.829364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1054/2095] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:52.843427 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be679db3-7d5a-4457-a901-1bc081825b00 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:52.860615 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a8bf2-408f-4e34-af9b-f84e063ff288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:52.861623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a8bf2-408f-4e34-af9b-f84e063ff288 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:52.862160 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a8bf2-408f-4e34-af9b-f84e063ff288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:52.862649 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a8bf2-408f-4e34-af9b-f84e063ff288 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:52.863822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a8bf2-408f-4e34-af9b-f84e063ff288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:06:52.864417 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a8bf2-408f-4e34-af9b-f84e063ff288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:52.866344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a8bf2-408f-4e34-af9b-f84e063ff288 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:52.905370 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1042/2096] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:06:52.911823 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb8507-e120-401f-8186-ab54510b051f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:52.926402 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb8507-e120-401f-8186-ab54510b051f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:52.958031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9a167-da44-4a99-b830-7655dc0c6390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:52.959315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9a167-da44-4a99-b830-7655dc0c6390 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:52.959887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9a167-da44-4a99-b830-7655dc0c6390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:52.960567 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9a167-da44-4a99-b830-7655dc0c6390 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:52.962738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9a167-da44-4a99-b830-7655dc0c6390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:52.968641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9a167-da44-4a99-b830-7655dc0c6390 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:53.047594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a8bf2-408f-4e34-af9b-f84e063ff288 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:53.058217 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1055/2097] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:06:52 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:06:53.090358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a8bf2-408f-4e34-af9b-f84e063ff288 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:53.229289 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:53.317273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a577fd4-29f6-4c08-acb7-fccd71030405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:53.318710 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a577fd4-29f6-4c08-acb7-fccd71030405 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:53.319454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a577fd4-29f6-4c08-acb7-fccd71030405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:53.320210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a577fd4-29f6-4c08-acb7-fccd71030405 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:53.321628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a577fd4-29f6-4c08-acb7-fccd71030405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:53.325682 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a577fd4-29f6-4c08-acb7-fccd71030405 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:53.416606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1043/2098] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:06:53 2022] POST /identity/v3/users => generated 288 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:06:53.423616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9a167-da44-4a99-b830-7655dc0c6390 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:53.446047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9a167-da44-4a99-b830-7655dc0c6390 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:53.452541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b71e3-4cb5-4f88-ae81-4d69b301b1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:53.453487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b71e3-4cb5-4f88-ae81-4d69b301b1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:53.453773 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b71e3-4cb5-4f88-ae81-4d69b301b1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:53.454046 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b71e3-4cb5-4f88-ae81-4d69b301b1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:53.454869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b71e3-4cb5-4f88-ae81-4d69b301b1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:53.456807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b71e3-4cb5-4f88-ae81-4d69b301b1e5 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:53.478210 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1056/2099] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:06:53.479544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a577fd4-29f6-4c08-acb7-fccd71030405 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:53.494937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a577fd4-29f6-4c08-acb7-fccd71030405 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:53.509086 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b0f40-8039-45ec-b7b9-86a578311fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:53.509735 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b0f40-8039-45ec-b7b9-86a578311fda admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:53.510014 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b0f40-8039-45ec-b7b9-86a578311fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:53.510521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b0f40-8039-45ec-b7b9-86a578311fda admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:53.512192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b0f40-8039-45ec-b7b9-86a578311fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:53.516459 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b0f40-8039-45ec-b7b9-86a578311fda admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:53.542481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1044/2100] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:06:53.547689 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b71e3-4cb5-4f88-ae81-4d69b301b1e5 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:53.585557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b71e3-4cb5-4f88-ae81-4d69b301b1e5 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:53.605440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea75df7-cd99-49ea-9bbe-aa9295b57fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:53.606638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea75df7-cd99-49ea-9bbe-aa9295b57fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:53.607101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea75df7-cd99-49ea-9bbe-aa9295b57fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:53.608086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea75df7-cd99-49ea-9bbe-aa9295b57fc8 admin admin] PATH_INFO: `/v3/projects/5f0cbe633fdf41f19f8f36d17e80fc65/users/195ea64d8edf4b279a356aa4c01f2211/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:53.641149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea75df7-cd99-49ea-9bbe-aa9295b57fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0cbe633fdf41f19f8f36d17e80fc65, user_id=195ea64d8edf4b279a356aa4c01f2211, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:53.643892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea75df7-cd99-49ea-9bbe-aa9295b57fc8 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:53.674713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1057/2101] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:06:53 2022] PUT /identity/v3/projects/5f0cbe633fdf41f19f8f36d17e80fc65/users/195ea64d8edf4b279a356aa4c01f2211/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:06:53.688889 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496071c-5479-41b5-8ce9-5c277a7be27b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:53.689747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496071c-5479-41b5-8ce9-5c277a7be27b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:53.690465 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496071c-5479-41b5-8ce9-5c277a7be27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:53.791808 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3496071c-5479-41b5-8ce9-5c277a7be27b None None] MFA Rules not processed for user `195ea64d8edf4b279a356aa4c01f2211`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:53.799600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3496071c-5479-41b5-8ce9-5c277a7be27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:54.061077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1045/2102] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:54.067835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea75df7-cd99-49ea-9bbe-aa9295b57fc8 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:54.205824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea75df7-cd99-49ea-9bbe-aa9295b57fc8 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:54.227558 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e10e9-ffa8-4b19-8987-ac6c649e7972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:54.229235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e10e9-ffa8-4b19-8987-ac6c649e7972 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:54.229807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e10e9-ffa8-4b19-8987-ac6c649e7972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:54.230662 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e10e9-ffa8-4b19-8987-ac6c649e7972 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:54.235824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e10e9-ffa8-4b19-8987-ac6c649e7972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:54.239552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e10e9-ffa8-4b19-8987-ac6c649e7972 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:54.247870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:54.296286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1058/2103] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:06:54 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:06:54.300589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496071c-5479-41b5-8ce9-5c277a7be27b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:54.318162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496071c-5479-41b5-8ce9-5c277a7be27b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:54.469715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d32ed-6ef0-4b3a-a31d-43c99d6d27a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:54.470741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d32ed-6ef0-4b3a-a31d-43c99d6d27a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:54.470947 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d32ed-6ef0-4b3a-a31d-43c99d6d27a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:54.471325 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d32ed-6ef0-4b3a-a31d-43c99d6d27a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:54.473301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d32ed-6ef0-4b3a-a31d-43c99d6d27a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:54.506744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d32ed-6ef0-4b3a-a31d-43c99d6d27a0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:54.565669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1046/2104] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:06:54 2022] POST /identity/v3/users => generated 294 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:06:54.567652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e10e9-ffa8-4b19-8987-ac6c649e7972 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:54.594621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e10e9-ffa8-4b19-8987-ac6c649e7972 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:54.603574 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319f811-dd19-4f7c-a500-dd7370942db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:54.610056 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319f811-dd19-4f7c-a500-dd7370942db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:54.610890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319f811-dd19-4f7c-a500-dd7370942db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:54.611342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319f811-dd19-4f7c-a500-dd7370942db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:54.613963 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319f811-dd19-4f7c-a500-dd7370942db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:54.616025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319f811-dd19-4f7c-a500-dd7370942db2 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:54.643321 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1059/2105] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:06:54.649740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d32ed-6ef0-4b3a-a31d-43c99d6d27a0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:54.664707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d32ed-6ef0-4b3a-a31d-43c99d6d27a0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:54.671176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d7dad-a48d-4943-a44b-f47bdae1bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:54.671867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d7dad-a48d-4943-a44b-f47bdae1bb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:54.672177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d7dad-a48d-4943-a44b-f47bdae1bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:54.672450 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d7dad-a48d-4943-a44b-f47bdae1bb6b admin admin] PATH_INFO: `/v3/projects/c11bc56b474b41f1bb0f0e4c16fdaf47/users/cb5aed99def24042a118443cf89026d4/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:54.705907 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d7dad-a48d-4943-a44b-f47bdae1bb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11bc56b474b41f1bb0f0e4c16fdaf47, user_id=cb5aed99def24042a118443cf89026d4, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:54.709629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d7dad-a48d-4943-a44b-f47bdae1bb6b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:54.729453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1047/2106] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:06:54 2022] PUT /identity/v3/projects/c11bc56b474b41f1bb0f0e4c16fdaf47/users/cb5aed99def24042a118443cf89026d4/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:06:54.735028 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319f811-dd19-4f7c-a500-dd7370942db2 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:54.864521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319f811-dd19-4f7c-a500-dd7370942db2 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:55.031840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4481354-a28b-410e-ac44-cd7e342ac263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:55.033641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4481354-a28b-410e-ac44-cd7e342ac263 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:55.034116 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4481354-a28b-410e-ac44-cd7e342ac263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:55.034573 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4481354-a28b-410e-ac44-cd7e342ac263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:55.035747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4481354-a28b-410e-ac44-cd7e342ac263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:55.040433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4481354-a28b-410e-ac44-cd7e342ac263 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:55.090631 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1060/2107] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:06:55.092144 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d7dad-a48d-4943-a44b-f47bdae1bb6b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:55.112948 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d7dad-a48d-4943-a44b-f47bdae1bb6b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:55.122309 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d012c-5b61-44c1-a1bc-64aeeec91a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:55.127055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d012c-5b61-44c1-a1bc-64aeeec91a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:55.127656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d012c-5b61-44c1-a1bc-64aeeec91a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:55.127656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d012c-5b61-44c1-a1bc-64aeeec91a33 admin admin] PATH_INFO: `/v3/projects/c11bc56b474b41f1bb0f0e4c16fdaf47/users/cb5aed99def24042a118443cf89026d4/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:55.131175 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d012c-5b61-44c1-a1bc-64aeeec91a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11bc56b474b41f1bb0f0e4c16fdaf47, user_id=cb5aed99def24042a118443cf89026d4, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:55.135968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d012c-5b61-44c1-a1bc-64aeeec91a33 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:55.147403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:55.169558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1048/2108] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:06:55 2022] PUT /identity/v3/projects/c11bc56b474b41f1bb0f0e4c16fdaf47/users/cb5aed99def24042a118443cf89026d4/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:06:55.171965 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d59bc-3934-44a3-bebd-58a2e786ad8e None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:55.172373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d59bc-3934-44a3-bebd-58a2e786ad8e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:55.172776 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d59bc-3934-44a3-bebd-58a2e786ad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:55.249795 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-1a6d59bc-3934-44a3-bebd-58a2e786ad8e None None] MFA Rules not processed for user `cb5aed99def24042a118443cf89026d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:55.251344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1a6d59bc-3934-44a3-bebd-58a2e786ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:55.419534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1061/2109] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:55.465921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d012c-5b61-44c1-a1bc-64aeeec91a33 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:55.469266 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-307d012c-5b61-44c1-a1bc-64aeeec91a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:55.616194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d012c-5b61-44c1-a1bc-64aeeec91a33 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:55.623564 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93b41c-3831-4569-a881-085988980747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:55.626040 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93b41c-3831-4569-a881-085988980747 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:55.626507 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93b41c-3831-4569-a881-085988980747 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:55.626837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93b41c-3831-4569-a881-085988980747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:55.648310 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93b41c-3831-4569-a881-085988980747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:55.649767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93b41c-3831-4569-a881-085988980747 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:55.671221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1049/2110] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:06:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:06:59.153321 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d59bc-3934-44a3-bebd-58a2e786ad8e None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:59.155362 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1a6d59bc-3934-44a3-bebd-58a2e786ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:59.288335 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:06:59.297731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d59bc-3934-44a3-bebd-58a2e786ad8e None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:06:59.305135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73139ba2-f5e9-488b-bb7a-c944ab8a1ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:06:59.306012 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73139ba2-f5e9-488b-bb7a-c944ab8a1ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:59.306912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73139ba2-f5e9-488b-bb7a-c944ab8a1ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:59.306912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73139ba2-f5e9-488b-bb7a-c944ab8a1ecf admin admin] PATH_INFO: `/v3/users/9ef9e622419343ba9377d6143e43ab58` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:59.309016 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73139ba2-f5e9-488b-bb7a-c944ab8a1ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef9e622419343ba9377d6143e43ab58)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:06:59.311621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73139ba2-f5e9-488b-bb7a-c944ab8a1ecf admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:06:59.524220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-73139ba2-f5e9-488b-bb7a-c944ab8a1ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef9e622419343ba9377d6143e43ab58'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:59.543656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-73139ba2-f5e9-488b-bb7a-c944ab8a1ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef9e622419343ba9377d6143e43ab58'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:59.582754 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-73139ba2-f5e9-488b-bb7a-c944ab8a1ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef9e622419343ba9377d6143e43ab58'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:59.584615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-73139ba2-f5e9-488b-bb7a-c944ab8a1ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef9e622419343ba9377d6143e43ab58'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:59.587571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-73139ba2-f5e9-488b-bb7a-c944ab8a1ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef9e622419343ba9377d6143e43ab58'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:06:59.633681 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1062/2111] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:06:59 2022] DELETE /identity/v3/users/9ef9e622419343ba9377d6143e43ab58 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:06:59.638838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac915b-9c07-4d5d-bebb-d001b3d8f6b1 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:06:59.640046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac915b-9c07-4d5d-bebb-d001b3d8f6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:06:59.640479 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac915b-9c07-4d5d-bebb-d001b3d8f6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:06:59.689139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d1ac915b-9c07-4d5d-bebb-d001b3d8f6b1 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:06:59.690404 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d1ac915b-9c07-4d5d-bebb-d001b3d8f6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:06:59.868315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1050/2112] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:06:59.903544 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73139ba2-f5e9-488b-bb7a-c944ab8a1ecf admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:06:59.908773 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-73139ba2-f5e9-488b-bb7a-c944ab8a1ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:00.059331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73139ba2-f5e9-488b-bb7a-c944ab8a1ecf admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:00.065929 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55d737-898c-46cc-b85f-b75f261214c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:00.066851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55d737-898c-46cc-b85f-b75f261214c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:00.067283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55d737-898c-46cc-b85f-b75f261214c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:00.067895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55d737-898c-46cc-b85f-b75f261214c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:00.083234 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55d737-898c-46cc-b85f-b75f261214c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:00.085393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55d737-898c-46cc-b85f-b75f261214c5 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:00.114637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1063/2113] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:06:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:01.274312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac915b-9c07-4d5d-bebb-d001b3d8f6b1 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:01.276537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d1ac915b-9c07-4d5d-bebb-d001b3d8f6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:01.302069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac915b-9c07-4d5d-bebb-d001b3d8f6b1 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:01.331387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79d0e8-34ac-4731-b4b5-4ca1ebdfa7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:01.332767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79d0e8-34ac-4731-b4b5-4ca1ebdfa7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:01.333345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79d0e8-34ac-4731-b4b5-4ca1ebdfa7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:01.333854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79d0e8-34ac-4731-b4b5-4ca1ebdfa7d8 admin admin] PATH_INFO: `/v3/users/195ea64d8edf4b279a356aa4c01f2211` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:01.335317 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79d0e8-34ac-4731-b4b5-4ca1ebdfa7d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=195ea64d8edf4b279a356aa4c01f2211)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:01.354672 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79d0e8-34ac-4731-b4b5-4ca1ebdfa7d8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:01.534725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9a79d0e8-34ac-4731-b4b5-4ca1ebdfa7d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195ea64d8edf4b279a356aa4c01f2211'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:01.552049 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9a79d0e8-34ac-4731-b4b5-4ca1ebdfa7d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195ea64d8edf4b279a356aa4c01f2211'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:01.582821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9a79d0e8-34ac-4731-b4b5-4ca1ebdfa7d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195ea64d8edf4b279a356aa4c01f2211'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:01.601352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9a79d0e8-34ac-4731-b4b5-4ca1ebdfa7d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195ea64d8edf4b279a356aa4c01f2211'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:01.609855 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9a79d0e8-34ac-4731-b4b5-4ca1ebdfa7d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195ea64d8edf4b279a356aa4c01f2211'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:01.653923 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1051/2114] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:07:01 2022] DELETE /identity/v3/users/195ea64d8edf4b279a356aa4c01f2211 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:01.659266 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac253a1-0b7b-4557-9bd2-34f82520ee08 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:01.659777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac253a1-0b7b-4557-9bd2-34f82520ee08 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:01.660050 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac253a1-0b7b-4557-9bd2-34f82520ee08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:01.705215 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-7ac253a1-0b7b-4557-9bd2-34f82520ee08 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:01.707190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7ac253a1-0b7b-4557-9bd2-34f82520ee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:01.804122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1064/2115] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:01.883699 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79d0e8-34ac-4731-b4b5-4ca1ebdfa7d8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:01.885992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9a79d0e8-34ac-4731-b4b5-4ca1ebdfa7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:01.922895 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:02.086441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79d0e8-34ac-4731-b4b5-4ca1ebdfa7d8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:02.096800 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290751-274a-4f9d-a9f4-b335c9793e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:02.097367 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290751-274a-4f9d-a9f4-b335c9793e77 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:02.097654 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290751-274a-4f9d-a9f4-b335c9793e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:02.097930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290751-274a-4f9d-a9f4-b335c9793e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:02.139311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a290751-274a-4f9d-a9f4-b335c9793e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:02.140553 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a290751-274a-4f9d-a9f4-b335c9793e77 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:02.152695 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1052/2116] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:02.354394 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac253a1-0b7b-4557-9bd2-34f82520ee08 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:02.356508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7ac253a1-0b7b-4557-9bd2-34f82520ee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:02.385504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac253a1-0b7b-4557-9bd2-34f82520ee08 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:02.403192 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c58a2-8fae-4372-bd4d-ec33a9d5a998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:02.404778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c58a2-8fae-4372-bd4d-ec33a9d5a998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:02.404778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c58a2-8fae-4372-bd4d-ec33a9d5a998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:02.405524 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c58a2-8fae-4372-bd4d-ec33a9d5a998 admin admin] PATH_INFO: `/v3/projects/69590172b92b4d12b412a8953a7dab9c` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:02.408618 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c58a2-8fae-4372-bd4d-ec33a9d5a998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69590172b92b4d12b412a8953a7dab9c)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:02.431133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c58a2-8fae-4372-bd4d-ec33a9d5a998 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:02.505512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:02.623017 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-279c58a2-8fae-4372-bd4d-ec33a9d5a998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69590172b92b4d12b412a8953a7dab9c', 'request_id': 'req-279c58a2-8fae-4372-bd4d-ec33a9d5a998'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:02.669265 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-279c58a2-8fae-4372-bd4d-ec33a9d5a998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69590172b92b4d12b412a8953a7dab9c', 'request_id': 'req-279c58a2-8fae-4372-bd4d-ec33a9d5a998'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:02.710957 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-279c58a2-8fae-4372-bd4d-ec33a9d5a998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69590172b92b4d12b412a8953a7dab9c', 'request_id': 'req-279c58a2-8fae-4372-bd4d-ec33a9d5a998'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:02.734170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-279c58a2-8fae-4372-bd4d-ec33a9d5a998 admin admin] The token cache is being invalidate because project 69590172b92b4d12b412a8953a7dab9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:07:02.735597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-279c58a2-8fae-4372-bd4d-ec33a9d5a998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:02.736813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-279c58a2-8fae-4372-bd4d-ec33a9d5a998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:02.743731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1065/2117] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:07:02 2022] DELETE /identity/v3/projects/69590172b92b4d12b412a8953a7dab9c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:02.744154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7044e14-190c-434a-b721-091692e3add4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:02.744600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7044e14-190c-434a-b721-091692e3add4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:02.746614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7044e14-190c-434a-b721-091692e3add4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:02.794107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c7044e14-190c-434a-b721-091692e3add4 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:02.802515 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c7044e14-190c-434a-b721-091692e3add4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:02.927564 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1053/2118] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:02.935638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1540d2-e0c7-461b-928f-97b8ee5f4a16 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:02.935949 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1540d2-e0c7-461b-928f-97b8ee5f4a16 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:02.936464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1540d2-e0c7-461b-928f-97b8ee5f4a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:02.963610 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-0b1540d2-e0c7-461b-928f-97b8ee5f4a16 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:02.965144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-0b1540d2-e0c7-461b-928f-97b8ee5f4a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:02.978179 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1066/2119] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:02.984498 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7044e14-190c-434a-b721-091692e3add4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:03.009151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7044e14-190c-434a-b721-091692e3add4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:03.016567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760ce18-27a3-436b-92b8-1a00f7d5846b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:03.017437 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760ce18-27a3-436b-92b8-1a00f7d5846b admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:03.017880 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760ce18-27a3-436b-92b8-1a00f7d5846b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:03.018356 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760ce18-27a3-436b-92b8-1a00f7d5846b admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:03.019199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760ce18-27a3-436b-92b8-1a00f7d5846b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:07:03.019673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760ce18-27a3-436b-92b8-1a00f7d5846b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:03.021713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760ce18-27a3-436b-92b8-1a00f7d5846b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:03.049974 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1054/2120] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:07:03.062090 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1540d2-e0c7-461b-928f-97b8ee5f4a16 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:03.085286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1540d2-e0c7-461b-928f-97b8ee5f4a16 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:03.093726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3e74f-a39d-4edd-87b1-5597a1f3cb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:03.094777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3e74f-a39d-4edd-87b1-5597a1f3cb2b admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:03.095215 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3e74f-a39d-4edd-87b1-5597a1f3cb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:03.095699 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3e74f-a39d-4edd-87b1-5597a1f3cb2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:03.096581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3e74f-a39d-4edd-87b1-5597a1f3cb2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:03.100918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3e74f-a39d-4edd-87b1-5597a1f3cb2b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:03.201902 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1067/2121] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:07:03 2022] POST /identity/v3/projects => generated 361 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:03.208005 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760ce18-27a3-436b-92b8-1a00f7d5846b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:03.223170 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760ce18-27a3-436b-92b8-1a00f7d5846b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:03.377475 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9a5de-0262-46cd-9982-1f8544f1fb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:03.378295 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a5de-0262-46cd-9982-1f8544f1fb0a admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:03.378964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a5de-0262-46cd-9982-1f8544f1fb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:03.379253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a5de-0262-46cd-9982-1f8544f1fb0a admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:03.379930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9a5de-0262-46cd-9982-1f8544f1fb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:03.382088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9a5de-0262-46cd-9982-1f8544f1fb0a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:03.416354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1055/2122] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:07:03 2022] POST /identity/v3/users => generated 281 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:03.420200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3e74f-a39d-4edd-87b1-5597a1f3cb2b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:03.453278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3e74f-a39d-4edd-87b1-5597a1f3cb2b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:03.459101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fafa00-779d-463d-9045-e4b2cdd1b255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:03.466658 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fafa00-779d-463d-9045-e4b2cdd1b255 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:03.466930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fafa00-779d-463d-9045-e4b2cdd1b255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:03.467361 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fafa00-779d-463d-9045-e4b2cdd1b255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:03.468775 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fafa00-779d-463d-9045-e4b2cdd1b255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:03.470475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fafa00-779d-463d-9045-e4b2cdd1b255 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:03.527174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1068/2123] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:03.528860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9a5de-0262-46cd-9982-1f8544f1fb0a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:03.584963 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9a5de-0262-46cd-9982-1f8544f1fb0a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:03.610661 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68124392-d0d7-4f23-9824-7aeb10f34e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:03.611302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68124392-d0d7-4f23-9824-7aeb10f34e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:03.611589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68124392-d0d7-4f23-9824-7aeb10f34e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:03.611864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68124392-d0d7-4f23-9824-7aeb10f34e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:03.612577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68124392-d0d7-4f23-9824-7aeb10f34e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:03.614399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68124392-d0d7-4f23-9824-7aeb10f34e6a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:03.650801 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1056/2124] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:03.657149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fafa00-779d-463d-9045-e4b2cdd1b255 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:03.681016 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fafa00-779d-463d-9045-e4b2cdd1b255 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:03.685722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206a9e8-208a-4b48-9607-837fec18f6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:03.687259 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206a9e8-208a-4b48-9607-837fec18f6f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:03.687931 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206a9e8-208a-4b48-9607-837fec18f6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:03.689129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206a9e8-208a-4b48-9607-837fec18f6f8 admin admin] PATH_INFO: `/v3/projects/9bc836ba456543d1988272be0047b297/users/d88d3916d21c42f4a82317b320002d18/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:03.734391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206a9e8-208a-4b48-9607-837fec18f6f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc836ba456543d1988272be0047b297, user_id=d88d3916d21c42f4a82317b320002d18, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:03.738557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206a9e8-208a-4b48-9607-837fec18f6f8 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:03.773503 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1069/2125] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:07:03 2022] PUT /identity/v3/projects/9bc836ba456543d1988272be0047b297/users/d88d3916d21c42f4a82317b320002d18/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:07:03.789611 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f446f-f26d-417a-b070-31cb34065850 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:03.792780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f446f-f26d-417a-b070-31cb34065850 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:03.793329 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f446f-f26d-417a-b070-31cb34065850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:03.882908 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a53f446f-f26d-417a-b070-31cb34065850 None None] MFA Rules not processed for user `d88d3916d21c42f4a82317b320002d18`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:03.886214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a53f446f-f26d-417a-b070-31cb34065850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:03.925682 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:04.108753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1057/2126] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:04.223761 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206a9e8-208a-4b48-9607-837fec18f6f8 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:04.226374 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7206a9e8-208a-4b48-9607-837fec18f6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:04.415004 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206a9e8-208a-4b48-9607-837fec18f6f8 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:04.424297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c7dd0-c4b1-4674-b654-01d36e0d22f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:04.424953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c7dd0-c4b1-4674-b654-01d36e0d22f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:04.425235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c7dd0-c4b1-4674-b654-01d36e0d22f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:04.425515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c7dd0-c4b1-4674-b654-01d36e0d22f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:04.449261 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c7dd0-c4b1-4674-b654-01d36e0d22f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:04.450819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c7dd0-c4b1-4674-b654-01d36e0d22f5 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:04.478764 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1070/2127] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:05.524574 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f446f-f26d-417a-b070-31cb34065850 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:05.527898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a53f446f-f26d-417a-b070-31cb34065850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:05.636972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f446f-f26d-417a-b070-31cb34065850 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:05.651724 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:05.652596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:05.653109 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:05.653479 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87 admin admin] PATH_INFO: `/v3/projects/5f0cbe633fdf41f19f8f36d17e80fc65` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:05.655725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0cbe633fdf41f19f8f36d17e80fc65)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:05.660719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:05.827674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0cbe633fdf41f19f8f36d17e80fc65', 'request_id': 'req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:05.842719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0cbe633fdf41f19f8f36d17e80fc65', 'request_id': 'req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:05.861123 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0cbe633fdf41f19f8f36d17e80fc65', 'request_id': 'req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:05.880373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87 admin admin] The token cache is being invalidate because project 5f0cbe633fdf41f19f8f36d17e80fc65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:07:05.880666 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:05.884050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:05.889889 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1058/2128] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:07:05 2022] DELETE /identity/v3/projects/5f0cbe633fdf41f19f8f36d17e80fc65 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:07:05.894666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c7dd0-c4b1-4674-b654-01d36e0d22f5 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:05.915461 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c7dd0-c4b1-4674-b654-01d36e0d22f5 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:06.025467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:06.105410 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bd391-fcd0-4580-888d-ec7d6c1742c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:06.107831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bd391-fcd0-4580-888d-ec7d6c1742c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:06.109142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bd391-fcd0-4580-888d-ec7d6c1742c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:06.109575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bd391-fcd0-4580-888d-ec7d6c1742c7 admin admin] PATH_INFO: `/v3/users/cb5aed99def24042a118443cf89026d4` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:06.111187 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5bd391-fcd0-4580-888d-ec7d6c1742c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb5aed99def24042a118443cf89026d4)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:06.115767 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5bd391-fcd0-4580-888d-ec7d6c1742c7 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:06.206465 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9b5bd391-fcd0-4580-888d-ec7d6c1742c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb5aed99def24042a118443cf89026d4'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:06.222606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9b5bd391-fcd0-4580-888d-ec7d6c1742c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb5aed99def24042a118443cf89026d4'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:06.260266 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9b5bd391-fcd0-4580-888d-ec7d6c1742c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb5aed99def24042a118443cf89026d4'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:06.261016 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9b5bd391-fcd0-4580-888d-ec7d6c1742c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb5aed99def24042a118443cf89026d4'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:06.261626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9b5bd391-fcd0-4580-888d-ec7d6c1742c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb5aed99def24042a118443cf89026d4'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:06.284222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1071/2129] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:07:05 2022] DELETE /identity/v3/users/cb5aed99def24042a118443cf89026d4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:07:08.172430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:08.175790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:08.206784 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bfc94-1b28-4ab8-9d4a-fc6bd229dd87 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:08.310493 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:08.344981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7688d6-262a-4383-afcd-c31220ec0fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:08.346094 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7688d6-262a-4383-afcd-c31220ec0fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:08.346094 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7688d6-262a-4383-afcd-c31220ec0fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:08.346363 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7688d6-262a-4383-afcd-c31220ec0fe1 admin admin] PATH_INFO: `/v3/projects/c11bc56b474b41f1bb0f0e4c16fdaf47` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:08.347665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7688d6-262a-4383-afcd-c31220ec0fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11bc56b474b41f1bb0f0e4c16fdaf47)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:08.350673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7688d6-262a-4383-afcd-c31220ec0fe1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:08.423712 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1d7688d6-262a-4383-afcd-c31220ec0fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11bc56b474b41f1bb0f0e4c16fdaf47', 'request_id': 'req-1d7688d6-262a-4383-afcd-c31220ec0fe1'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:08.431988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1d7688d6-262a-4383-afcd-c31220ec0fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11bc56b474b41f1bb0f0e4c16fdaf47', 'request_id': 'req-1d7688d6-262a-4383-afcd-c31220ec0fe1'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:08.444053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1d7688d6-262a-4383-afcd-c31220ec0fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11bc56b474b41f1bb0f0e4c16fdaf47', 'request_id': 'req-1d7688d6-262a-4383-afcd-c31220ec0fe1'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:08.461942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1d7688d6-262a-4383-afcd-c31220ec0fe1 admin admin] The token cache is being invalidate because project c11bc56b474b41f1bb0f0e4c16fdaf47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:07:08.462168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1d7688d6-262a-4383-afcd-c31220ec0fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:08.463227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1d7688d6-262a-4383-afcd-c31220ec0fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:08.466715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1059/2130] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:07:08 2022] DELETE /identity/v3/projects/c11bc56b474b41f1bb0f0e4c16fdaf47 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:08.471841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537dec4-114a-4080-b8f9-d06d4699488c None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:08.472508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537dec4-114a-4080-b8f9-d06d4699488c None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:08.472620 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537dec4-114a-4080-b8f9-d06d4699488c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:08.504534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-b537dec4-114a-4080-b8f9-d06d4699488c None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:08.506383 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b537dec4-114a-4080-b8f9-d06d4699488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:08.653512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1072/2131] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:08.657901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aee6ce-ca7a-4427-b3e2-a4ac46841394 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:08.658300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aee6ce-ca7a-4427-b3e2-a4ac46841394 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:08.658965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aee6ce-ca7a-4427-b3e2-a4ac46841394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:08.693769 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-21aee6ce-ca7a-4427-b3e2-a4ac46841394 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:08.696468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-21aee6ce-ca7a-4427-b3e2-a4ac46841394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:08.713554 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1060/2132] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:08.714496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537dec4-114a-4080-b8f9-d06d4699488c None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:08.728875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537dec4-114a-4080-b8f9-d06d4699488c None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:08.736290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e515187-366c-4978-8780-562ca5eaacca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:08.736976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e515187-366c-4978-8780-562ca5eaacca admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:08.738513 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e515187-366c-4978-8780-562ca5eaacca admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:08.739032 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e515187-366c-4978-8780-562ca5eaacca admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:08.739925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e515187-366c-4978-8780-562ca5eaacca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:07:08.740416 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e515187-366c-4978-8780-562ca5eaacca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:08.743079 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e515187-366c-4978-8780-562ca5eaacca admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:08.765725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aee6ce-ca7a-4427-b3e2-a4ac46841394 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:08.773654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1073/2133] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:07:08.780655 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aee6ce-ca7a-4427-b3e2-a4ac46841394 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:08.785982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20018f-9a31-46f0-aa4c-0feba951a5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:08.786866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20018f-9a31-46f0-aa4c-0feba951a5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:08.787304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20018f-9a31-46f0-aa4c-0feba951a5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:08.788031 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20018f-9a31-46f0-aa4c-0feba951a5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:08.789578 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20018f-9a31-46f0-aa4c-0feba951a5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:08.792132 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20018f-9a31-46f0-aa4c-0feba951a5d9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:08.906867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1061/2134] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:07:08 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:07:08.915055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e515187-366c-4978-8780-562ca5eaacca admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:08.962214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e515187-366c-4978-8780-562ca5eaacca admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:09.041890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:09.083870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a2630-d540-40de-a6fa-8466d2d90a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:09.084874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a2630-d540-40de-a6fa-8466d2d90a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:09.085268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a2630-d540-40de-a6fa-8466d2d90a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:09.085723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a2630-d540-40de-a6fa-8466d2d90a89 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:09.086545 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a2630-d540-40de-a6fa-8466d2d90a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:09.089831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a2630-d540-40de-a6fa-8466d2d90a89 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:09.140078 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1074/2135] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:07:08 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:09.141449 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20018f-9a31-46f0-aa4c-0feba951a5d9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:09.158576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20018f-9a31-46f0-aa4c-0feba951a5d9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:09.165444 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b794bf4-3669-43f5-9220-3f5bb2436494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:09.166143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b794bf4-3669-43f5-9220-3f5bb2436494 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:09.166423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b794bf4-3669-43f5-9220-3f5bb2436494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:09.166695 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b794bf4-3669-43f5-9220-3f5bb2436494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:09.167351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b794bf4-3669-43f5-9220-3f5bb2436494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:09.169166 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b794bf4-3669-43f5-9220-3f5bb2436494 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:09.192442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a2630-d540-40de-a6fa-8466d2d90a89 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:09.204841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1062/2136] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:09.207357 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a2630-d540-40de-a6fa-8466d2d90a89 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:09.213946 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bc8a3-8d28-41d9-b005-bf1948f5364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:09.214672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bc8a3-8d28-41d9-b005-bf1948f5364c admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:09.215159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bc8a3-8d28-41d9-b005-bf1948f5364c admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:09.215481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bc8a3-8d28-41d9-b005-bf1948f5364c admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:09.216795 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bc8a3-8d28-41d9-b005-bf1948f5364c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:09.222061 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bc8a3-8d28-41d9-b005-bf1948f5364c admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:09.243313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b794bf4-3669-43f5-9220-3f5bb2436494 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:09.254951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1075/2137] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:09.257587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b794bf4-3669-43f5-9220-3f5bb2436494 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:09.265598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e56b5-d892-439c-afd5-cc9b600a1e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:09.266426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e56b5-d892-439c-afd5-cc9b600a1e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:09.266704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e56b5-d892-439c-afd5-cc9b600a1e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:09.266972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e56b5-d892-439c-afd5-cc9b600a1e53 admin admin] PATH_INFO: `/v3/projects/44800615c32f4565bffddcce1442b80d/users/583ad46077954680b86ec2aab010f1b3/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:09.303228 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e56b5-d892-439c-afd5-cc9b600a1e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44800615c32f4565bffddcce1442b80d, user_id=583ad46077954680b86ec2aab010f1b3, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:09.307412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e56b5-d892-439c-afd5-cc9b600a1e53 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:09.344405 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1063/2138] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:07:09 2022] PUT /identity/v3/projects/44800615c32f4565bffddcce1442b80d/users/583ad46077954680b86ec2aab010f1b3/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:09.345393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f0ef5-99df-4b1f-9a60-51a2c3e39d8e None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:09.345685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f0ef5-99df-4b1f-9a60-51a2c3e39d8e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:09.345954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f0ef5-99df-4b1f-9a60-51a2c3e39d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:09.387534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-fe0f0ef5-99df-4b1f-9a60-51a2c3e39d8e None None] MFA Rules not processed for user `583ad46077954680b86ec2aab010f1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:09.406659 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-fe0f0ef5-99df-4b1f-9a60-51a2c3e39d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:09.517910 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1076/2139] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:09.522424 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e56b5-d892-439c-afd5-cc9b600a1e53 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:09.702223 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e56b5-d892-439c-afd5-cc9b600a1e53 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:09.718734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e3f6d-701d-4927-a196-10dc1b68e6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:09.720083 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e3f6d-701d-4927-a196-10dc1b68e6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:09.720247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e3f6d-701d-4927-a196-10dc1b68e6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:09.720586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e3f6d-701d-4927-a196-10dc1b68e6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:09.721331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e3f6d-701d-4927-a196-10dc1b68e6f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:09.723528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e3f6d-701d-4927-a196-10dc1b68e6f7 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:09.740434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:09.783102 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1064/2140] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:07:09 2022] POST /identity/v3/projects => generated 371 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:07:09.787420 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f0ef5-99df-4b1f-9a60-51a2c3e39d8e None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:09.806514 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f0ef5-99df-4b1f-9a60-51a2c3e39d8e None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:09.967583 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42199e2-2f93-46ba-9e4f-8c6db4503998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:09.968579 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42199e2-2f93-46ba-9e4f-8c6db4503998 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:09.969066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42199e2-2f93-46ba-9e4f-8c6db4503998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:09.969435 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42199e2-2f93-46ba-9e4f-8c6db4503998 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:09.970181 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42199e2-2f93-46ba-9e4f-8c6db4503998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:09.973564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42199e2-2f93-46ba-9e4f-8c6db4503998 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:10.045884 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1077/2141] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:07:09 2022] POST /identity/v3/users => generated 292 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:10.049975 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e3f6d-701d-4927-a196-10dc1b68e6f7 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:10.065882 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e3f6d-701d-4927-a196-10dc1b68e6f7 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:10.071399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53117125-ee35-4cca-a709-c0b9a70542f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:10.072583 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53117125-ee35-4cca-a709-c0b9a70542f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:10.073058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53117125-ee35-4cca-a709-c0b9a70542f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:10.073534 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53117125-ee35-4cca-a709-c0b9a70542f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:10.074498 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53117125-ee35-4cca-a709-c0b9a70542f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:10.077531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53117125-ee35-4cca-a709-c0b9a70542f0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:10.093318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1065/2142] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:10.097402 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42199e2-2f93-46ba-9e4f-8c6db4503998 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:10.112687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42199e2-2f93-46ba-9e4f-8c6db4503998 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:10.120804 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e52a53-a41e-4b16-a53e-69d17b2b3b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:10.121462 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e52a53-a41e-4b16-a53e-69d17b2b3b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:10.121841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e52a53-a41e-4b16-a53e-69d17b2b3b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:10.122940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e52a53-a41e-4b16-a53e-69d17b2b3b82 admin admin] PATH_INFO: `/v3/projects/fc8d9d9c772145478d3a68ab0a1e0ccb/users/d80396e86ca2450d88b9d08c7567b53c/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:10.156272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e52a53-a41e-4b16-a53e-69d17b2b3b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc8d9d9c772145478d3a68ab0a1e0ccb, user_id=d80396e86ca2450d88b9d08c7567b53c, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:10.159961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e52a53-a41e-4b16-a53e-69d17b2b3b82 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:10.182992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1078/2143] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:07:10 2022] PUT /identity/v3/projects/fc8d9d9c772145478d3a68ab0a1e0ccb/users/d80396e86ca2450d88b9d08c7567b53c/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:10.188762 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53117125-ee35-4cca-a709-c0b9a70542f0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:10.203857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53117125-ee35-4cca-a709-c0b9a70542f0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:10.301620 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765ba90-cae9-4dba-a69c-cb95dc6ce781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:10.303232 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765ba90-cae9-4dba-a69c-cb95dc6ce781 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:10.303727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765ba90-cae9-4dba-a69c-cb95dc6ce781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:10.304239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765ba90-cae9-4dba-a69c-cb95dc6ce781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:10.306282 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765ba90-cae9-4dba-a69c-cb95dc6ce781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:10.308448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765ba90-cae9-4dba-a69c-cb95dc6ce781 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:10.326833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1066/2144] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:07:10.334509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e52a53-a41e-4b16-a53e-69d17b2b3b82 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:10.348143 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e52a53-a41e-4b16-a53e-69d17b2b3b82 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:10.353113 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dded1d-cfcc-469b-b1b4-ebf5ed45dd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:10.354032 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dded1d-cfcc-469b-b1b4-ebf5ed45dd5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:10.354315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dded1d-cfcc-469b-b1b4-ebf5ed45dd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:10.354586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dded1d-cfcc-469b-b1b4-ebf5ed45dd5f admin admin] PATH_INFO: `/v3/projects/fc8d9d9c772145478d3a68ab0a1e0ccb/users/d80396e86ca2450d88b9d08c7567b53c/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:10.356569 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dded1d-cfcc-469b-b1b4-ebf5ed45dd5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc8d9d9c772145478d3a68ab0a1e0ccb, user_id=d80396e86ca2450d88b9d08c7567b53c, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:10.360232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dded1d-cfcc-469b-b1b4-ebf5ed45dd5f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:10.385361 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1079/2145] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:07:10 2022] PUT /identity/v3/projects/fc8d9d9c772145478d3a68ab0a1e0ccb/users/d80396e86ca2450d88b9d08c7567b53c/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:10.386764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fe352-9a2f-4d6e-ba81-6926a6151ca5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:10.387253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fe352-9a2f-4d6e-ba81-6926a6151ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:10.387677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fe352-9a2f-4d6e-ba81-6926a6151ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:10.425728 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-347fe352-9a2f-4d6e-ba81-6926a6151ca5 None None] MFA Rules not processed for user `d80396e86ca2450d88b9d08c7567b53c`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:10.427347 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-347fe352-9a2f-4d6e-ba81-6926a6151ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:10.611247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1067/2146] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:07:10.616106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dded1d-cfcc-469b-b1b4-ebf5ed45dd5f admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:10.633926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dded1d-cfcc-469b-b1b4-ebf5ed45dd5f admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:10.656812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf53db0-da2a-4b1a-92de-26f058cdb729 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80396e86ca2450d88b9d08c7567b53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc8d9d9c772145478d3a68ab0a1e0ccb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:10.657456 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf53db0-da2a-4b1a-92de-26f058cdb729 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:10.657738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf53db0-da2a-4b1a-92de-26f058cdb729 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:10.658011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf53db0-da2a-4b1a-92de-26f058cdb729 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:10.658722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf53db0-da2a-4b1a-92de-26f058cdb729 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:07:10.659024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf53db0-da2a-4b1a-92de-26f058cdb729 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:10.660727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf53db0-da2a-4b1a-92de-26f058cdb729 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:10.662798 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:10.692373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1080/2147] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:07:10.693543 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fe352-9a2f-4d6e-ba81-6926a6151ca5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:10.712795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fe352-9a2f-4d6e-ba81-6926a6151ca5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:10.724811 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86b662-eec4-4311-9617-28f930516f5e tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80396e86ca2450d88b9d08c7567b53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc8d9d9c772145478d3a68ab0a1e0ccb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:10.725458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86b662-eec4-4311-9617-28f930516f5e tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:10.725745 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86b662-eec4-4311-9617-28f930516f5e tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:10.726552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86b662-eec4-4311-9617-28f930516f5e tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:10.728191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86b662-eec4-4311-9617-28f930516f5e tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:10.730221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86b662-eec4-4311-9617-28f930516f5e tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:10.781421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf53db0-da2a-4b1a-92de-26f058cdb729 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:10.783255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1068/2148] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:07:10 2022] POST /identity/v3/projects => generated 349 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:10.800058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf53db0-da2a-4b1a-92de-26f058cdb729 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:10.954552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990e57f-2257-4e0a-935b-42a987990a34 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80396e86ca2450d88b9d08c7567b53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc8d9d9c772145478d3a68ab0a1e0ccb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:10.955524 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990e57f-2257-4e0a-935b-42a987990a34 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:10.955809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990e57f-2257-4e0a-935b-42a987990a34 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:10.956233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990e57f-2257-4e0a-935b-42a987990a34 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:10.957419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990e57f-2257-4e0a-935b-42a987990a34 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:07:10.957733 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990e57f-2257-4e0a-935b-42a987990a34 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:10.960101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990e57f-2257-4e0a-935b-42a987990a34 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:10.983365 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1081/2149] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:07:11.033496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86b662-eec4-4311-9617-28f930516f5e tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:11.035824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8f86b662-eec4-4311-9617-28f930516f5e tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:11.157719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:11.193187 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86b662-eec4-4311-9617-28f930516f5e tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:11.209771 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866738b-e5e4-4434-a15d-fd48200cbfdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:11.210422 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866738b-e5e4-4434-a15d-fd48200cbfdd service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:11.210702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866738b-e5e4-4434-a15d-fd48200cbfdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:11.210975 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866738b-e5e4-4434-a15d-fd48200cbfdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:11.240621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866738b-e5e4-4434-a15d-fd48200cbfdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:11.242097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866738b-e5e4-4434-a15d-fd48200cbfdd service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:11.275740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1069/2150] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:20.564058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990e57f-2257-4e0a-935b-42a987990a34 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:20.581720 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990e57f-2257-4e0a-935b-42a987990a34 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:20.604514 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710d610-ea40-4547-acc1-9db49ee3a0f1 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd80396e86ca2450d88b9d08c7567b53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc8d9d9c772145478d3a68ab0a1e0ccb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:20.623560 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710d610-ea40-4547-acc1-9db49ee3a0f1 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:20.624427 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710d610-ea40-4547-acc1-9db49ee3a0f1 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:20.629602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710d610-ea40-4547-acc1-9db49ee3a0f1 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] PATH_INFO: `/v3/projects/8da0fe69ade5433e94b3de0afdb84c2f` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:20.635682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710d610-ea40-4547-acc1-9db49ee3a0f1 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8da0fe69ade5433e94b3de0afdb84c2f)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:20.651618 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710d610-ea40-4547-acc1-9db49ee3a0f1 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:20.832351 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e710d610-ea40-4547-acc1-9db49ee3a0f1 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da0fe69ade5433e94b3de0afdb84c2f', 'request_id': 'req-e710d610-ea40-4547-acc1-9db49ee3a0f1'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:20.850365 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e710d610-ea40-4547-acc1-9db49ee3a0f1 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da0fe69ade5433e94b3de0afdb84c2f', 'request_id': 'req-e710d610-ea40-4547-acc1-9db49ee3a0f1'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:20.870101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e710d610-ea40-4547-acc1-9db49ee3a0f1 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da0fe69ade5433e94b3de0afdb84c2f', 'request_id': 'req-e710d610-ea40-4547-acc1-9db49ee3a0f1'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:20.886584 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e710d610-ea40-4547-acc1-9db49ee3a0f1 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] The token cache is being invalidate because project 8da0fe69ade5433e94b3de0afdb84c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:07:20.887178 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e710d610-ea40-4547-acc1-9db49ee3a0f1 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:20.892556 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e710d610-ea40-4547-acc1-9db49ee3a0f1 tempest-QuotasNegativeTest-161407913 tempest-QuotasNegativeTest-161407913-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:20.903129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1082/2151] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:07:20 2022] DELETE /identity/v3/projects/8da0fe69ade5433e94b3de0afdb84c2f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:07:20.909632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866738b-e5e4-4434-a15d-fd48200cbfdd service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:21.101333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866738b-e5e4-4434-a15d-fd48200cbfdd service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:21.203443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f42da2-e296-43e9-b83d-8c33589e03d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:21.205795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f42da2-e296-43e9-b83d-8c33589e03d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:21.206261 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f42da2-e296-43e9-b83d-8c33589e03d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:21.206719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f42da2-e296-43e9-b83d-8c33589e03d7 admin admin] PATH_INFO: `/v3/users/583ad46077954680b86ec2aab010f1b3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:21.210607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f42da2-e296-43e9-b83d-8c33589e03d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=583ad46077954680b86ec2aab010f1b3)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:21.213866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f42da2-e296-43e9-b83d-8c33589e03d7 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:21.280861 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f9f42da2-e296-43e9-b83d-8c33589e03d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583ad46077954680b86ec2aab010f1b3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:21.294218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f9f42da2-e296-43e9-b83d-8c33589e03d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583ad46077954680b86ec2aab010f1b3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:21.310018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f9f42da2-e296-43e9-b83d-8c33589e03d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583ad46077954680b86ec2aab010f1b3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:21.319858 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f9f42da2-e296-43e9-b83d-8c33589e03d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583ad46077954680b86ec2aab010f1b3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:21.320759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f9f42da2-e296-43e9-b83d-8c33589e03d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583ad46077954680b86ec2aab010f1b3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:21.331992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1070/2152] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:07:20 2022] DELETE /identity/v3/users/583ad46077954680b86ec2aab010f1b3 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:21.335826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61450abb-b86f-4cdb-987f-ff63fe56bb64 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:21.336354 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61450abb-b86f-4cdb-987f-ff63fe56bb64 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:21.336627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61450abb-b86f-4cdb-987f-ff63fe56bb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:21.377195 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-61450abb-b86f-4cdb-987f-ff63fe56bb64 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:21.377789 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-61450abb-b86f-4cdb-987f-ff63fe56bb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:21.554997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1083/2153] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:21.583626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f42da2-e296-43e9-b83d-8c33589e03d7 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:21.585098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f9f42da2-e296-43e9-b83d-8c33589e03d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:21.604669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:21.684720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f42da2-e296-43e9-b83d-8c33589e03d7 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:21.691330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805bf5b-b92c-4596-8f14-108de336eaf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:21.692841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805bf5b-b92c-4596-8f14-108de336eaf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:21.693409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805bf5b-b92c-4596-8f14-108de336eaf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:21.694038 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805bf5b-b92c-4596-8f14-108de336eaf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:21.706558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805bf5b-b92c-4596-8f14-108de336eaf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:21.708994 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805bf5b-b92c-4596-8f14-108de336eaf8 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:21.722586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1071/2154] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:23.454240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61450abb-b86f-4cdb-987f-ff63fe56bb64 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:23.455818 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-61450abb-b86f-4cdb-987f-ff63fe56bb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:23.486115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61450abb-b86f-4cdb-987f-ff63fe56bb64 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:23.498532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beab470-0f2f-4906-8301-7b566c848402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:23.499190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beab470-0f2f-4906-8301-7b566c848402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:23.499640 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beab470-0f2f-4906-8301-7b566c848402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:23.500127 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beab470-0f2f-4906-8301-7b566c848402 admin admin] PATH_INFO: `/v3/projects/44800615c32f4565bffddcce1442b80d` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:23.501466 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beab470-0f2f-4906-8301-7b566c848402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44800615c32f4565bffddcce1442b80d)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:23.506169 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beab470-0f2f-4906-8301-7b566c848402 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:23.514455 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:23.595354 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5beab470-0f2f-4906-8301-7b566c848402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44800615c32f4565bffddcce1442b80d', 'request_id': 'req-5beab470-0f2f-4906-8301-7b566c848402'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:23.605685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5beab470-0f2f-4906-8301-7b566c848402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44800615c32f4565bffddcce1442b80d', 'request_id': 'req-5beab470-0f2f-4906-8301-7b566c848402'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:23.617636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5beab470-0f2f-4906-8301-7b566c848402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44800615c32f4565bffddcce1442b80d', 'request_id': 'req-5beab470-0f2f-4906-8301-7b566c848402'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:23.633131 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5beab470-0f2f-4906-8301-7b566c848402 admin admin] The token cache is being invalidate because project 44800615c32f4565bffddcce1442b80d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:07:23.633387 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5beab470-0f2f-4906-8301-7b566c848402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:23.634384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5beab470-0f2f-4906-8301-7b566c848402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:23.639158 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1084/2155] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:07:23 2022] DELETE /identity/v3/projects/44800615c32f4565bffddcce1442b80d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:23.641180 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805bf5b-b92c-4596-8f14-108de336eaf8 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:23.690307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805bf5b-b92c-4596-8f14-108de336eaf8 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:23.786753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fe2c7-b806-4064-a908-b1cf9eff912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:23.787839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fe2c7-b806-4064-a908-b1cf9eff912a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:23.788235 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fe2c7-b806-4064-a908-b1cf9eff912a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:23.788607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fe2c7-b806-4064-a908-b1cf9eff912a admin admin] PATH_INFO: `/v3/users/d80396e86ca2450d88b9d08c7567b53c` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:23.792119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fe2c7-b806-4064-a908-b1cf9eff912a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d80396e86ca2450d88b9d08c7567b53c)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:23.792537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fe2c7-b806-4064-a908-b1cf9eff912a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:23.890252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a08fe2c7-b806-4064-a908-b1cf9eff912a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd80396e86ca2450d88b9d08c7567b53c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:23.912185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a08fe2c7-b806-4064-a908-b1cf9eff912a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd80396e86ca2450d88b9d08c7567b53c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:23.943613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a08fe2c7-b806-4064-a908-b1cf9eff912a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd80396e86ca2450d88b9d08c7567b53c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:23.961429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a08fe2c7-b806-4064-a908-b1cf9eff912a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd80396e86ca2450d88b9d08c7567b53c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:23.962761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a08fe2c7-b806-4064-a908-b1cf9eff912a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd80396e86ca2450d88b9d08c7567b53c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:23.976914 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1072/2156] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:07:23 2022] DELETE /identity/v3/users/d80396e86ca2450d88b9d08c7567b53c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:24.050488 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beab470-0f2f-4906-8301-7b566c848402 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:24.052081 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5beab470-0f2f-4906-8301-7b566c848402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:24.068691 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beab470-0f2f-4906-8301-7b566c848402 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:24.168641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d246fcc-d589-47a5-9c00-b9d63e068c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:24.170803 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d246fcc-d589-47a5-9c00-b9d63e068c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:24.171264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d246fcc-d589-47a5-9c00-b9d63e068c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:24.171699 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d246fcc-d589-47a5-9c00-b9d63e068c80 admin admin] PATH_INFO: `/v3/users/7bb1da3181fc4eacb1be9b96d76d92ed` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:24.174395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d246fcc-d589-47a5-9c00-b9d63e068c80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb1da3181fc4eacb1be9b96d76d92ed)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:24.178542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d246fcc-d589-47a5-9c00-b9d63e068c80 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:24.252785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9d246fcc-d589-47a5-9c00-b9d63e068c80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb1da3181fc4eacb1be9b96d76d92ed'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:24.262617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9d246fcc-d589-47a5-9c00-b9d63e068c80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb1da3181fc4eacb1be9b96d76d92ed'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:24.284662 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9d246fcc-d589-47a5-9c00-b9d63e068c80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb1da3181fc4eacb1be9b96d76d92ed'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:24.285653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9d246fcc-d589-47a5-9c00-b9d63e068c80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb1da3181fc4eacb1be9b96d76d92ed'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:24.286440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9d246fcc-d589-47a5-9c00-b9d63e068c80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb1da3181fc4eacb1be9b96d76d92ed'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:24.308678 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1085/2157] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:07:24 2022] DELETE /identity/v3/users/7bb1da3181fc4eacb1be9b96d76d92ed => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:24.316631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944c646-6293-4c8d-a90f-330c2f6959e9 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:24.317064 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944c646-6293-4c8d-a90f-330c2f6959e9 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:24.317285 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944c646-6293-4c8d-a90f-330c2f6959e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:24.340221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c944c646-6293-4c8d-a90f-330c2f6959e9 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:24.341549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c944c646-6293-4c8d-a90f-330c2f6959e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:24.400780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:24.452448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1073/2158] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:07:24.479959 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d246fcc-d589-47a5-9c00-b9d63e068c80 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:24.481647 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9d246fcc-d589-47a5-9c00-b9d63e068c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:24.502790 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:24.576861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d246fcc-d589-47a5-9c00-b9d63e068c80 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:24.582756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52558c-9ecb-4df6-a095-4902555a6c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:24.583679 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52558c-9ecb-4df6-a095-4902555a6c50 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:24.584093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52558c-9ecb-4df6-a095-4902555a6c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:24.584461 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52558c-9ecb-4df6-a095-4902555a6c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:24.595704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52558c-9ecb-4df6-a095-4902555a6c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:24.600439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52558c-9ecb-4df6-a095-4902555a6c50 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:24.648392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1086/2159] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:25.345979 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944c646-6293-4c8d-a90f-330c2f6959e9 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:25.347755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c944c646-6293-4c8d-a90f-330c2f6959e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:25.369021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944c646-6293-4c8d-a90f-330c2f6959e9 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:25.383302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9e6e2-e69e-4c1b-88e4-863e82d98c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:25.400101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9e6e2-e69e-4c1b-88e4-863e82d98c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:25.400101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9e6e2-e69e-4c1b-88e4-863e82d98c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:25.400101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9e6e2-e69e-4c1b-88e4-863e82d98c97 admin admin] PATH_INFO: `/v3/projects/fc8d9d9c772145478d3a68ab0a1e0ccb` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:25.405819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9e6e2-e69e-4c1b-88e4-863e82d98c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc8d9d9c772145478d3a68ab0a1e0ccb)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:25.407836 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9e6e2-e69e-4c1b-88e4-863e82d98c97 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:25.458735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52558c-9ecb-4df6-a095-4902555a6c50 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:25.468621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-dd52558c-9ecb-4df6-a095-4902555a6c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:25.522347 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ecc9e6e2-e69e-4c1b-88e4-863e82d98c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc8d9d9c772145478d3a68ab0a1e0ccb', 'request_id': 'req-ecc9e6e2-e69e-4c1b-88e4-863e82d98c97'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:25.536388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52558c-9ecb-4df6-a095-4902555a6c50 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:25.537349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ecc9e6e2-e69e-4c1b-88e4-863e82d98c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc8d9d9c772145478d3a68ab0a1e0ccb', 'request_id': 'req-ecc9e6e2-e69e-4c1b-88e4-863e82d98c97'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:25.550958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ecc9e6e2-e69e-4c1b-88e4-863e82d98c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc8d9d9c772145478d3a68ab0a1e0ccb', 'request_id': 'req-ecc9e6e2-e69e-4c1b-88e4-863e82d98c97'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:25.592641 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ecc9e6e2-e69e-4c1b-88e4-863e82d98c97 admin admin] The token cache is being invalidate because project fc8d9d9c772145478d3a68ab0a1e0ccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:07:25.604822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ecc9e6e2-e69e-4c1b-88e4-863e82d98c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:25.608829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ecc9e6e2-e69e-4c1b-88e4-863e82d98c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:25.615422 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1074/2160] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:07:25 2022] DELETE /identity/v3/projects/fc8d9d9c772145478d3a68ab0a1e0ccb => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:25.620820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0f641-1792-4857-a988-4b787331268a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:25.621938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0f641-1792-4857-a988-4b787331268a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:25.622345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0f641-1792-4857-a988-4b787331268a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:25.693795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-81b0f641-1792-4857-a988-4b787331268a None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:25.695077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-81b0f641-1792-4857-a988-4b787331268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:25.788113 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8ae96-e73c-4d28-8e39-5c756bd09c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:25.788765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8ae96-e73c-4d28-8e39-5c756bd09c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:25.789047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8ae96-e73c-4d28-8e39-5c756bd09c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:25.789329 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8ae96-e73c-4d28-8e39-5c756bd09c99 admin admin] PATH_INFO: `/v3/projects/c1b318714ed541c891ea51675da73736` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:25.792970 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8ae96-e73c-4d28-8e39-5c756bd09c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b318714ed541c891ea51675da73736)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:25.796896 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8ae96-e73c-4d28-8e39-5c756bd09c99 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:25.932535 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1075/2161] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:25.945016 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-25b8ae96-e73c-4d28-8e39-5c756bd09c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b318714ed541c891ea51675da73736', 'request_id': 'req-25b8ae96-e73c-4d28-8e39-5c756bd09c99'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:25.962783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-25b8ae96-e73c-4d28-8e39-5c756bd09c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b318714ed541c891ea51675da73736', 'request_id': 'req-25b8ae96-e73c-4d28-8e39-5c756bd09c99'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:25.977910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab3cad-86b7-49b7-b7b2-aebf195b63a3 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:25.980623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-25b8ae96-e73c-4d28-8e39-5c756bd09c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b318714ed541c891ea51675da73736', 'request_id': 'req-25b8ae96-e73c-4d28-8e39-5c756bd09c99'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:25.984906 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab3cad-86b7-49b7-b7b2-aebf195b63a3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:25.985538 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab3cad-86b7-49b7-b7b2-aebf195b63a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:26.017199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-25b8ae96-e73c-4d28-8e39-5c756bd09c99 admin admin] The token cache is being invalidate because project c1b318714ed541c891ea51675da73736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:07:26.017490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-25b8ae96-e73c-4d28-8e39-5c756bd09c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:26.022868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-25b8ae96-e73c-4d28-8e39-5c756bd09c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:26.033326 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1087/2162] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:07:25 2022] DELETE /identity/v3/projects/c1b318714ed541c891ea51675da73736 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:26.039071 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c1d22-681e-45f1-ad0c-a332f447d696 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:26.039385 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c1d22-681e-45f1-ad0c-a332f447d696 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:26.039667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c1d22-681e-45f1-ad0c-a332f447d696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:26.061686 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f9ab3cad-86b7-49b7-b7b2-aebf195b63a3 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:26.066844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f9ab3cad-86b7-49b7-b7b2-aebf195b63a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:26.080162 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-601c1d22-681e-45f1-ad0c-a332f447d696 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:26.088091 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-601c1d22-681e-45f1-ad0c-a332f447d696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:26.183097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:26.188688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:26.220502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1076/2163] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:07:26.225748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab3cad-86b7-49b7-b7b2-aebf195b63a3 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:26.236794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1088/2164] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:26.239162 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b82ab9-6a59-4104-840a-3f73f08baa18 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:26.240195 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b82ab9-6a59-4104-840a-3f73f08baa18 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:26.240195 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b82ab9-6a59-4104-840a-3f73f08baa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:26.250688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab3cad-86b7-49b7-b7b2-aebf195b63a3 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:26.264393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e2324-b46d-406d-a131-e9f9603e12d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:26.266602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e2324-b46d-406d-a131-e9f9603e12d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:26.266602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e2324-b46d-406d-a131-e9f9603e12d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:26.266602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e2324-b46d-406d-a131-e9f9603e12d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:26.266602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e2324-b46d-406d-a131-e9f9603e12d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:07:26.266954 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e2324-b46d-406d-a131-e9f9603e12d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:26.268362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e2324-b46d-406d-a131-e9f9603e12d9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:26.280111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-67b82ab9-6a59-4104-840a-3f73f08baa18 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:26.281633 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-67b82ab9-6a59-4104-840a-3f73f08baa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:26.298537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1077/2165] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:07:26.302662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e2324-b46d-406d-a131-e9f9603e12d9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:26.308760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1089/2166] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:26.311290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b82ab9-6a59-4104-840a-3f73f08baa18 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:26.323104 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e2324-b46d-406d-a131-e9f9603e12d9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:26.340065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb0a73-0794-4896-8b1e-bb18e88a4217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:26.340648 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb0a73-0794-4896-8b1e-bb18e88a4217 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:26.341052 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb0a73-0794-4896-8b1e-bb18e88a4217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:26.341178 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb0a73-0794-4896-8b1e-bb18e88a4217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:26.343194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb0a73-0794-4896-8b1e-bb18e88a4217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:26.345157 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb0a73-0794-4896-8b1e-bb18e88a4217 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:26.354526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b82ab9-6a59-4104-840a-3f73f08baa18 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:26.363855 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0e87b-83eb-4307-9dcd-8f54ed5db394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:26.373298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0e87b-83eb-4307-9dcd-8f54ed5db394 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:26.373551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0e87b-83eb-4307-9dcd-8f54ed5db394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:26.374093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0e87b-83eb-4307-9dcd-8f54ed5db394 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:26.375006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0e87b-83eb-4307-9dcd-8f54ed5db394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:07:26.375006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0e87b-83eb-4307-9dcd-8f54ed5db394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:26.386836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0e87b-83eb-4307-9dcd-8f54ed5db394 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:26.415274 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1078/2167] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:07:26 2022] POST /identity/v3/projects => generated 355 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:07:26.423766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1090/2168] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:07:26.423998 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb0a73-0794-4896-8b1e-bb18e88a4217 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:26.428926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0e87b-83eb-4307-9dcd-8f54ed5db394 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:26.461817 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0e87b-83eb-4307-9dcd-8f54ed5db394 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:26.575326 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb0a73-0794-4896-8b1e-bb18e88a4217 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:26.586455 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa2a4d-d23d-4dce-b907-e0176b851990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:26.586455 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa2a4d-d23d-4dce-b907-e0176b851990 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:26.586778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa2a4d-d23d-4dce-b907-e0176b851990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:26.586967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa2a4d-d23d-4dce-b907-e0176b851990 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:26.587752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa2a4d-d23d-4dce-b907-e0176b851990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:26.590019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa2a4d-d23d-4dce-b907-e0176b851990 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:26.604886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dafcc-4390-46ad-9858-955dc2a2db7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:26.607635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dafcc-4390-46ad-9858-955dc2a2db7f admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:26.608316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dafcc-4390-46ad-9858-955dc2a2db7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:26.610122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dafcc-4390-46ad-9858-955dc2a2db7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:26.611134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dafcc-4390-46ad-9858-955dc2a2db7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:26.614522 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dafcc-4390-46ad-9858-955dc2a2db7f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:26.656702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1079/2169] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:07:26 2022] POST /identity/v3/users => generated 278 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:07:26.664349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa2a4d-d23d-4dce-b907-e0176b851990 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:26.697511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1091/2170] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:07:26 2022] POST /identity/v3/projects => generated 379 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:26.703502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dafcc-4390-46ad-9858-955dc2a2db7f admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:26.704469 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa2a4d-d23d-4dce-b907-e0176b851990 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:26.854867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1abe6-c4ea-4308-9afa-f7794efda448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:26.856168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1abe6-c4ea-4308-9afa-f7794efda448 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:26.856632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1abe6-c4ea-4308-9afa-f7794efda448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:26.858664 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1abe6-c4ea-4308-9afa-f7794efda448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:26.860265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1abe6-c4ea-4308-9afa-f7794efda448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:26.866405 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1abe6-c4ea-4308-9afa-f7794efda448 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:26.886738 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1080/2171] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:07:26.890710 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1abe6-c4ea-4308-9afa-f7794efda448 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:26.923425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1abe6-c4ea-4308-9afa-f7794efda448 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:26.926590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dafcc-4390-46ad-9858-955dc2a2db7f admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:26.934782 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b3df6-45cb-405a-8237-6ae075cc20f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:26.936906 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b3df6-45cb-405a-8237-6ae075cc20f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:26.941340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b3df6-45cb-405a-8237-6ae075cc20f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:26.941879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b3df6-45cb-405a-8237-6ae075cc20f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:26.945706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b3df6-45cb-405a-8237-6ae075cc20f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:26.947484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b3df6-45cb-405a-8237-6ae075cc20f6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:26.948184 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb31a2-e885-4d6e-a651-3cbb514e0b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:26.948886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb31a2-e885-4d6e-a651-3cbb514e0b62 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:26.949168 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb31a2-e885-4d6e-a651-3cbb514e0b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:26.949735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb31a2-e885-4d6e-a651-3cbb514e0b62 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:26.951223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb31a2-e885-4d6e-a651-3cbb514e0b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:26.957180 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb31a2-e885-4d6e-a651-3cbb514e0b62 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:26.975698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1081/2172] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:26.979862 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b3df6-45cb-405a-8237-6ae075cc20f6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:27.004608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b3df6-45cb-405a-8237-6ae075cc20f6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:27.017648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1092/2173] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:07:26 2022] POST /identity/v3/users => generated 290 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:27.017866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9df1ba-1a08-42e3-94b8-cc60963d93fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:27.018524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9df1ba-1a08-42e3-94b8-cc60963d93fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:27.018809 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9df1ba-1a08-42e3-94b8-cc60963d93fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:27.019081 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9df1ba-1a08-42e3-94b8-cc60963d93fb admin admin] PATH_INFO: `/v3/projects/0aa99d779d274af394077738f9a0e94b/users/3b392d28ee3043a097e08c9473eef521/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:27.026065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb31a2-e885-4d6e-a651-3cbb514e0b62 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:27.057470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9df1ba-1a08-42e3-94b8-cc60963d93fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa99d779d274af394077738f9a0e94b, user_id=3b392d28ee3043a097e08c9473eef521, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:27.061122 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9df1ba-1a08-42e3-94b8-cc60963d93fb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:27.063465 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb31a2-e885-4d6e-a651-3cbb514e0b62 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:27.076458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b932070-e9b7-4136-baab-b5895b05827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:27.077094 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b932070-e9b7-4136-baab-b5895b05827c admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:27.077537 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b932070-e9b7-4136-baab-b5895b05827c admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:27.077814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b932070-e9b7-4136-baab-b5895b05827c admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:27.078475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b932070-e9b7-4136-baab-b5895b05827c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:27.080124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b932070-e9b7-4136-baab-b5895b05827c admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:27.088674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1082/2174] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:07:26 2022] PUT /identity/v3/projects/0aa99d779d274af394077738f9a0e94b/users/3b392d28ee3043a097e08c9473eef521/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:27.099667 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b6968-597f-426a-b01d-39ff6ea9fe59 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:27.100002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b6968-597f-426a-b01d-39ff6ea9fe59 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:27.100248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b6968-597f-426a-b01d-39ff6ea9fe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:27.102418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1093/2175] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:27.106433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b932070-e9b7-4136-baab-b5895b05827c admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:27.134857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b932070-e9b7-4136-baab-b5895b05827c admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:27.138906 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:27.153740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-162b6968-597f-426a-b01d-39ff6ea9fe59 None None] MFA Rules not processed for user `3b392d28ee3043a097e08c9473eef521`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:27.156363 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-162b6968-597f-426a-b01d-39ff6ea9fe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:27.193868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:27.258136 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7cc3b-027e-4ae1-8ba5-df39e3d43e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:27.261567 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7cc3b-027e-4ae1-8ba5-df39e3d43e9b admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:27.262881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7cc3b-027e-4ae1-8ba5-df39e3d43e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:27.263340 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7cc3b-027e-4ae1-8ba5-df39e3d43e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:27.265918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7cc3b-027e-4ae1-8ba5-df39e3d43e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:27.272504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7cc3b-027e-4ae1-8ba5-df39e3d43e9b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:27.325731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1094/2176] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:07:27.331001 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7cc3b-027e-4ae1-8ba5-df39e3d43e9b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:27.340534 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1083/2177] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:07:27.346433 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b6968-597f-426a-b01d-39ff6ea9fe59 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:27.355458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7cc3b-027e-4ae1-8ba5-df39e3d43e9b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:27.372270 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b6968-597f-426a-b01d-39ff6ea9fe59 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:27.373281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa05db-7d45-4ad1-bdb2-982a1e05cb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:27.374167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa05db-7d45-4ad1-bdb2-982a1e05cb7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:27.374450 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa05db-7d45-4ad1-bdb2-982a1e05cb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:27.374723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa05db-7d45-4ad1-bdb2-982a1e05cb7c admin admin] PATH_INFO: `/v3/projects/7a9dde70c53f45bc97d8371e4289050f/users/59f8797a423b434fa51568f7075f56e3/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:27.380278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2371c-2662-4151-bf4b-b0715a0af5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:27.381154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2371c-2662-4151-bf4b-b0715a0af5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:27.381610 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2371c-2662-4151-bf4b-b0715a0af5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:27.382046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2371c-2662-4151-bf4b-b0715a0af5b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:27.382993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2371c-2662-4151-bf4b-b0715a0af5b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:27.386039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2371c-2662-4151-bf4b-b0715a0af5b0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:27.399262 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa05db-7d45-4ad1-bdb2-982a1e05cb7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9dde70c53f45bc97d8371e4289050f, user_id=59f8797a423b434fa51568f7075f56e3, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:27.401765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa05db-7d45-4ad1-bdb2-982a1e05cb7c admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:27.434086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1095/2178] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:07:27 2022] PUT /identity/v3/projects/7a9dde70c53f45bc97d8371e4289050f/users/59f8797a423b434fa51568f7075f56e3/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:07:27.436649 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1084/2179] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:07:27 2022] POST /identity/v3/projects => generated 357 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:27.443414 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa734f-cdc8-400a-8c2b-6d02d45ea97a None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:27.443697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa734f-cdc8-400a-8c2b-6d02d45ea97a None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:27.443971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2371c-2662-4151-bf4b-b0715a0af5b0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:27.444101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa734f-cdc8-400a-8c2b-6d02d45ea97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:27.500288 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3faa734f-cdc8-400a-8c2b-6d02d45ea97a None None] MFA Rules not processed for user `59f8797a423b434fa51568f7075f56e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:27.502180 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3faa734f-cdc8-400a-8c2b-6d02d45ea97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:27.549130 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2371c-2662-4151-bf4b-b0715a0af5b0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:27.563069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fd199-4fba-46db-ba2a-eab62ba5baa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:27.565263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fd199-4fba-46db-ba2a-eab62ba5baa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:27.565814 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fd199-4fba-46db-ba2a-eab62ba5baa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:27.566796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fd199-4fba-46db-ba2a-eab62ba5baa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:27.569058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fd199-4fba-46db-ba2a-eab62ba5baa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:27.573767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fd199-4fba-46db-ba2a-eab62ba5baa4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:27.632230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1096/2180] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:27.633003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1085/2181] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:07:27 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:27.636861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa734f-cdc8-400a-8c2b-6d02d45ea97a None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:27.651888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa734f-cdc8-400a-8c2b-6d02d45ea97a None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:27.659665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a02d0d-f95a-4bec-8c88-25fbde9c1f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:27.660988 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a02d0d-f95a-4bec-8c88-25fbde9c1f1c admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:27.661372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a02d0d-f95a-4bec-8c88-25fbde9c1f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:27.661743 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a02d0d-f95a-4bec-8c88-25fbde9c1f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:27.662768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a02d0d-f95a-4bec-8c88-25fbde9c1f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:27.664646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a02d0d-f95a-4bec-8c88-25fbde9c1f1c admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:27.682422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1097/2182] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:27.686288 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fd199-4fba-46db-ba2a-eab62ba5baa4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:27.699367 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a02d0d-f95a-4bec-8c88-25fbde9c1f1c admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:27.706621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-19a02d0d-f95a-4bec-8c88-25fbde9c1f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:27.710076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fd199-4fba-46db-ba2a-eab62ba5baa4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:27.723424 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ee4f2-d40f-43ee-a2df-af7337d623cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:27.725927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ee4f2-d40f-43ee-a2df-af7337d623cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:27.726214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ee4f2-d40f-43ee-a2df-af7337d623cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:27.729411 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ee4f2-d40f-43ee-a2df-af7337d623cb admin admin] PATH_INFO: `/v3/projects/29350e322361438ca7ada678e73d221e/users/b6e806a804184b1c942f7347d0c15163/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:27.770387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ee4f2-d40f-43ee-a2df-af7337d623cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=29350e322361438ca7ada678e73d221e, user_id=b6e806a804184b1c942f7347d0c15163, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:27.779386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ee4f2-d40f-43ee-a2df-af7337d623cb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:27.825440 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1086/2183] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:07:27 2022] PUT /identity/v3/projects/29350e322361438ca7ada678e73d221e/users/b6e806a804184b1c942f7347d0c15163/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:07:27.830621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ee4f2-d40f-43ee-a2df-af7337d623cb admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:27.909611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a02d0d-f95a-4bec-8c88-25fbde9c1f1c admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:27.957401 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:27.972910 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:28.004982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ee4f2-d40f-43ee-a2df-af7337d623cb admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:28.011941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5845d95-057e-4e91-af06-cb400e5ac816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:28.012706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759f0cd-e3e5-4a45-ab36-f7e7cdb15b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:28.012942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5845d95-057e-4e91-af06-cb400e5ac816 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:28.013364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5845d95-057e-4e91-af06-cb400e5ac816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:28.013746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5845d95-057e-4e91-af06-cb400e5ac816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:28.014372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759f0cd-e3e5-4a45-ab36-f7e7cdb15b6c service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:28.014792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5845d95-057e-4e91-af06-cb400e5ac816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:28.015735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759f0cd-e3e5-4a45-ab36-f7e7cdb15b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:28.016198 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759f0cd-e3e5-4a45-ab36-f7e7cdb15b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:28.016908 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5845d95-057e-4e91-af06-cb400e5ac816 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:28.052365 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1087/2184] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:28.058124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5845d95-057e-4e91-af06-cb400e5ac816 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:28.077023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5845d95-057e-4e91-af06-cb400e5ac816 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:28.086802 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45be6f-21f0-45bb-8bbe-29e0553b6069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:28.089153 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45be6f-21f0-45bb-8bbe-29e0553b6069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:28.089450 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45be6f-21f0-45bb-8bbe-29e0553b6069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:28.089734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45be6f-21f0-45bb-8bbe-29e0553b6069 admin admin] PATH_INFO: `/v3/projects/29350e322361438ca7ada678e73d221e/users/b6e806a804184b1c942f7347d0c15163/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:28.097632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45be6f-21f0-45bb-8bbe-29e0553b6069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29350e322361438ca7ada678e73d221e, user_id=b6e806a804184b1c942f7347d0c15163, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:28.105075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45be6f-21f0-45bb-8bbe-29e0553b6069 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:28.109815 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759f0cd-e3e5-4a45-ab36-f7e7cdb15b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:28.112171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759f0cd-e3e5-4a45-ab36-f7e7cdb15b6c service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:28.133976 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1088/2185] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:07:28 2022] PUT /identity/v3/projects/29350e322361438ca7ada678e73d221e/users/b6e806a804184b1c942f7347d0c15163/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:28.144338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14379142-6dca-426f-b746-ff214b5a3b08 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:28.144717 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14379142-6dca-426f-b746-ff214b5a3b08 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:28.144930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14379142-6dca-426f-b746-ff214b5a3b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:28.145049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1098/2186] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:28.181435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-14379142-6dca-426f-b746-ff214b5a3b08 None None] MFA Rules not processed for user `b6e806a804184b1c942f7347d0c15163`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:28.183416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-14379142-6dca-426f-b746-ff214b5a3b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:28.280821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759f0cd-e3e5-4a45-ab36-f7e7cdb15b6c service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:28.283506 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1089/2187] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:07:28.397412 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759f0cd-e3e5-4a45-ab36-f7e7cdb15b6c service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:28.406444 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73b2dc-d450-4b7a-8de1-59cd5e0dd172 tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e806a804184b1c942f7347d0c15163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29350e322361438ca7ada678e73d221e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:28.408270 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73b2dc-d450-4b7a-8de1-59cd5e0dd172 tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:28.408883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73b2dc-d450-4b7a-8de1-59cd5e0dd172 tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:28.410004 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73b2dc-d450-4b7a-8de1-59cd5e0dd172 tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:28.411455 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73b2dc-d450-4b7a-8de1-59cd5e0dd172 tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:07:28.412060 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73b2dc-d450-4b7a-8de1-59cd5e0dd172 tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:28.414232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73b2dc-d450-4b7a-8de1-59cd5e0dd172 tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:28.440905 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1099/2188] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:07:28.445347 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14379142-6dca-426f-b746-ff214b5a3b08 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:28.458287 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14379142-6dca-426f-b746-ff214b5a3b08 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:28.463939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90b46a-9b08-4ee1-845d-5341a90f89ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e806a804184b1c942f7347d0c15163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29350e322361438ca7ada678e73d221e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:28.465105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90b46a-9b08-4ee1-845d-5341a90f89ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:28.465105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90b46a-9b08-4ee1-845d-5341a90f89ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:28.465622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90b46a-9b08-4ee1-845d-5341a90f89ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:28.466165 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90b46a-9b08-4ee1-845d-5341a90f89ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:28.469397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90b46a-9b08-4ee1-845d-5341a90f89ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:28.514499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1090/2189] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:07:28 2022] POST /identity/v3/projects => generated 350 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:28.515525 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73b2dc-d450-4b7a-8de1-59cd5e0dd172 tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:28.530496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73b2dc-d450-4b7a-8de1-59cd5e0dd172 tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:28.702928 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830ee93-c513-433f-9848-b7fe11cc47ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e806a804184b1c942f7347d0c15163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29350e322361438ca7ada678e73d221e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:28.703617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830ee93-c513-433f-9848-b7fe11cc47ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:28.703936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830ee93-c513-433f-9848-b7fe11cc47ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:28.704203 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830ee93-c513-433f-9848-b7fe11cc47ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:28.712883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830ee93-c513-433f-9848-b7fe11cc47ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:07:28.713425 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830ee93-c513-433f-9848-b7fe11cc47ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:28.715843 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830ee93-c513-433f-9848-b7fe11cc47ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:28.743743 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1100/2190] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:07:28.754725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90b46a-9b08-4ee1-845d-5341a90f89ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:28.845290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90b46a-9b08-4ee1-845d-5341a90f89ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:28.850337 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8b12a-d2de-4730-a1cb-255b07766c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:28.851105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8b12a-d2de-4730-a1cb-255b07766c06 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:28.851614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8b12a-d2de-4730-a1cb-255b07766c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:28.852012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8b12a-d2de-4730-a1cb-255b07766c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:28.867544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8b12a-d2de-4730-a1cb-255b07766c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:28.870725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8b12a-d2de-4730-a1cb-255b07766c06 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:28.897549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1091/2191] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:07:30.386369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830ee93-c513-433f-9848-b7fe11cc47ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:30.401502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830ee93-c513-433f-9848-b7fe11cc47ce tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:30.416652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c6cf8-1fd6-4877-86f6-880857bd3b0d tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6e806a804184b1c942f7347d0c15163', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29350e322361438ca7ada678e73d221e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:30.417457 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c6cf8-1fd6-4877-86f6-880857bd3b0d tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:30.417742 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c6cf8-1fd6-4877-86f6-880857bd3b0d tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:30.418211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c6cf8-1fd6-4877-86f6-880857bd3b0d tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] PATH_INFO: `/v3/projects/368b1d7f6bb74f04985149a3ca67ac2d` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:30.420131 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c6cf8-1fd6-4877-86f6-880857bd3b0d tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] RBAC: Authorizing `identity:delete_project(project_id=368b1d7f6bb74f04985149a3ca67ac2d)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:30.422269 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c6cf8-1fd6-4877-86f6-880857bd3b0d tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:30.477049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:30.620174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7f2c6cf8-1fd6-4877-86f6-880857bd3b0d tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368b1d7f6bb74f04985149a3ca67ac2d', 'request_id': 'req-7f2c6cf8-1fd6-4877-86f6-880857bd3b0d'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:30.648087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7f2c6cf8-1fd6-4877-86f6-880857bd3b0d tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368b1d7f6bb74f04985149a3ca67ac2d', 'request_id': 'req-7f2c6cf8-1fd6-4877-86f6-880857bd3b0d'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:30.696746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7f2c6cf8-1fd6-4877-86f6-880857bd3b0d tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368b1d7f6bb74f04985149a3ca67ac2d', 'request_id': 'req-7f2c6cf8-1fd6-4877-86f6-880857bd3b0d'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:30.738753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7f2c6cf8-1fd6-4877-86f6-880857bd3b0d tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] The token cache is being invalidate because project 368b1d7f6bb74f04985149a3ca67ac2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:07:30.739117 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7f2c6cf8-1fd6-4877-86f6-880857bd3b0d tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:30.743671 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7f2c6cf8-1fd6-4877-86f6-880857bd3b0d tempest-QuotasTest-1368979183 tempest-QuotasTest-1368979183-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:30.754717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1101/2192] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:07:30 2022] DELETE /identity/v3/projects/368b1d7f6bb74f04985149a3ca67ac2d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:32.562791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8b12a-d2de-4730-a1cb-255b07766c06 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:32.687939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:32.781680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8b12a-d2de-4730-a1cb-255b07766c06 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:32.948061 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f490bf-2a2e-4433-86c1-b375f9c7a34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:32.948493 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f490bf-2a2e-4433-86c1-b375f9c7a34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:32.948774 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f490bf-2a2e-4433-86c1-b375f9c7a34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:32.949050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f490bf-2a2e-4433-86c1-b375f9c7a34a admin admin] PATH_INFO: `/v3/users/3b392d28ee3043a097e08c9473eef521` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:32.952777 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f490bf-2a2e-4433-86c1-b375f9c7a34a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b392d28ee3043a097e08c9473eef521)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:32.956764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f490bf-2a2e-4433-86c1-b375f9c7a34a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:33.081360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-70f490bf-2a2e-4433-86c1-b375f9c7a34a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b392d28ee3043a097e08c9473eef521'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:33.093063 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-70f490bf-2a2e-4433-86c1-b375f9c7a34a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b392d28ee3043a097e08c9473eef521'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:33.130851 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-70f490bf-2a2e-4433-86c1-b375f9c7a34a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b392d28ee3043a097e08c9473eef521'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:33.152137 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-70f490bf-2a2e-4433-86c1-b375f9c7a34a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b392d28ee3043a097e08c9473eef521'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:33.154686 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-70f490bf-2a2e-4433-86c1-b375f9c7a34a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b392d28ee3043a097e08c9473eef521'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:33.186593 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1092/2193] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:07:32 2022] DELETE /identity/v3/users/3b392d28ee3043a097e08c9473eef521 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:33.188389 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd78e0-292c-4d6b-9d2c-e2623e34941d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:33.188893 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd78e0-292c-4d6b-9d2c-e2623e34941d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:33.189009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd78e0-292c-4d6b-9d2c-e2623e34941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:33.262417 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-1abd78e0-292c-4d6b-9d2c-e2623e34941d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:33.264193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1abd78e0-292c-4d6b-9d2c-e2623e34941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:33.422908 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1102/2194] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:33.546863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f490bf-2a2e-4433-86c1-b375f9c7a34a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:33.549424 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-70f490bf-2a2e-4433-86c1-b375f9c7a34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:33.689329 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f490bf-2a2e-4433-86c1-b375f9c7a34a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:33.700714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a92eb0-2a6d-4649-8f1b-aad6bfb89ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:33.701505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a92eb0-2a6d-4649-8f1b-aad6bfb89ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:33.701899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a92eb0-2a6d-4649-8f1b-aad6bfb89ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:33.702283 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a92eb0-2a6d-4649-8f1b-aad6bfb89ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:33.723467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a92eb0-2a6d-4649-8f1b-aad6bfb89ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:33.725141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a92eb0-2a6d-4649-8f1b-aad6bfb89ee9 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:33.747297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1093/2195] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:35.988250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd78e0-292c-4d6b-9d2c-e2623e34941d None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:35.990647 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1abd78e0-292c-4d6b-9d2c-e2623e34941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:36.015522 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd78e0-292c-4d6b-9d2c-e2623e34941d None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:36.021373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0272b-13df-47ed-b985-ddaea5d491ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:36.022478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0272b-13df-47ed-b985-ddaea5d491ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:36.022763 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0272b-13df-47ed-b985-ddaea5d491ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:36.023296 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0272b-13df-47ed-b985-ddaea5d491ac admin admin] PATH_INFO: `/v3/projects/0aa99d779d274af394077738f9a0e94b` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:36.024917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0272b-13df-47ed-b985-ddaea5d491ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa99d779d274af394077738f9a0e94b)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:36.027435 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0272b-13df-47ed-b985-ddaea5d491ac admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:36.124962 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b8a0272b-13df-47ed-b985-ddaea5d491ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa99d779d274af394077738f9a0e94b', 'request_id': 'req-b8a0272b-13df-47ed-b985-ddaea5d491ac'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:36.136413 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b8a0272b-13df-47ed-b985-ddaea5d491ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa99d779d274af394077738f9a0e94b', 'request_id': 'req-b8a0272b-13df-47ed-b985-ddaea5d491ac'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:36.150075 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b8a0272b-13df-47ed-b985-ddaea5d491ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa99d779d274af394077738f9a0e94b', 'request_id': 'req-b8a0272b-13df-47ed-b985-ddaea5d491ac'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:36.188603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b8a0272b-13df-47ed-b985-ddaea5d491ac admin admin] The token cache is being invalidate because project 0aa99d779d274af394077738f9a0e94b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:07:36.189329 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b8a0272b-13df-47ed-b985-ddaea5d491ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:36.192344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b8a0272b-13df-47ed-b985-ddaea5d491ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:36.195673 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1103/2196] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:07:35 2022] DELETE /identity/v3/projects/0aa99d779d274af394077738f9a0e94b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:36.199541 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a92eb0-2a6d-4649-8f1b-aad6bfb89ee9 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:36.209333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:36.218661 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a92eb0-2a6d-4649-8f1b-aad6bfb89ee9 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:36.338726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053cdb6-f8bc-42a6-98de-525096250fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:36.340502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053cdb6-f8bc-42a6-98de-525096250fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:36.340793 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053cdb6-f8bc-42a6-98de-525096250fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:36.341113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053cdb6-f8bc-42a6-98de-525096250fc2 admin admin] PATH_INFO: `/v3/users/b6e806a804184b1c942f7347d0c15163` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:36.344301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053cdb6-f8bc-42a6-98de-525096250fc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6e806a804184b1c942f7347d0c15163)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:36.347290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053cdb6-f8bc-42a6-98de-525096250fc2 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:36.483669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2053cdb6-f8bc-42a6-98de-525096250fc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6e806a804184b1c942f7347d0c15163'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:36.498226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2053cdb6-f8bc-42a6-98de-525096250fc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6e806a804184b1c942f7347d0c15163'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:36.523633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2053cdb6-f8bc-42a6-98de-525096250fc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6e806a804184b1c942f7347d0c15163'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:36.542661 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2053cdb6-f8bc-42a6-98de-525096250fc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6e806a804184b1c942f7347d0c15163'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:36.543639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-2053cdb6-f8bc-42a6-98de-525096250fc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6e806a804184b1c942f7347d0c15163'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:36.559423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1094/2197] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:07:36 2022] DELETE /identity/v3/users/b6e806a804184b1c942f7347d0c15163 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:38.852837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0272b-13df-47ed-b985-ddaea5d491ac admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:38.854318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b8a0272b-13df-47ed-b985-ddaea5d491ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:38.878918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0272b-13df-47ed-b985-ddaea5d491ac admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:38.966708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:39.062369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bd364-b6df-4958-ae07-4b66ac395f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:39.063023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bd364-b6df-4958-ae07-4b66ac395f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:39.063309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bd364-b6df-4958-ae07-4b66ac395f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:39.063584 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bd364-b6df-4958-ae07-4b66ac395f9b admin admin] PATH_INFO: `/v3/projects/29350e322361438ca7ada678e73d221e` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:39.064886 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bd364-b6df-4958-ae07-4b66ac395f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=29350e322361438ca7ada678e73d221e)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:39.066842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bd364-b6df-4958-ae07-4b66ac395f9b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:39.170354 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4d7bd364-b6df-4958-ae07-4b66ac395f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29350e322361438ca7ada678e73d221e', 'request_id': 'req-4d7bd364-b6df-4958-ae07-4b66ac395f9b'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:39.189348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4d7bd364-b6df-4958-ae07-4b66ac395f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29350e322361438ca7ada678e73d221e', 'request_id': 'req-4d7bd364-b6df-4958-ae07-4b66ac395f9b'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:39.214050 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4d7bd364-b6df-4958-ae07-4b66ac395f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29350e322361438ca7ada678e73d221e', 'request_id': 'req-4d7bd364-b6df-4958-ae07-4b66ac395f9b'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:39.239484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4d7bd364-b6df-4958-ae07-4b66ac395f9b admin admin] The token cache is being invalidate because project 29350e322361438ca7ada678e73d221e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:07:39.239776 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4d7bd364-b6df-4958-ae07-4b66ac395f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:39.240804 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4d7bd364-b6df-4958-ae07-4b66ac395f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:39.243383 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1104/2198] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:07:38 2022] DELETE /identity/v3/projects/29350e322361438ca7ada678e73d221e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:39.251981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09238f-8431-4f72-b4e6-a56f3117ece0 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:39.252549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09238f-8431-4f72-b4e6-a56f3117ece0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:39.252549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09238f-8431-4f72-b4e6-a56f3117ece0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:39.294280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6f09238f-8431-4f72-b4e6-a56f3117ece0 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:39.295522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6f09238f-8431-4f72-b4e6-a56f3117ece0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:39.432553 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1095/2199] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:39.442990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41434d1-e00e-41a9-973c-3342b8b9ea44 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:39.443363 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41434d1-e00e-41a9-973c-3342b8b9ea44 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:39.444943 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41434d1-e00e-41a9-973c-3342b8b9ea44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:39.485790 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c41434d1-e00e-41a9-973c-3342b8b9ea44 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:39.487646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c41434d1-e00e-41a9-973c-3342b8b9ea44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:39.513501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1105/2200] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:39.514236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09238f-8431-4f72-b4e6-a56f3117ece0 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:39.531297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09238f-8431-4f72-b4e6-a56f3117ece0 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:39.541769 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e049a-2399-4afe-bb71-b7369fb5a4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:39.542591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e049a-2399-4afe-bb71-b7369fb5a4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:39.543120 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e049a-2399-4afe-bb71-b7369fb5a4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:39.543577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e049a-2399-4afe-bb71-b7369fb5a4c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:39.545319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e049a-2399-4afe-bb71-b7369fb5a4c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:07:39.545823 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e049a-2399-4afe-bb71-b7369fb5a4c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:39.550351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e049a-2399-4afe-bb71-b7369fb5a4c1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:39.580132 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1096/2201] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:07:39.581593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41434d1-e00e-41a9-973c-3342b8b9ea44 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:39.596729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41434d1-e00e-41a9-973c-3342b8b9ea44 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:39.610798 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d9888-3fcc-40c5-be53-e0a4e059307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:39.612220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d9888-3fcc-40c5-be53-e0a4e059307f admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:39.612725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d9888-3fcc-40c5-be53-e0a4e059307f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:39.613211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d9888-3fcc-40c5-be53-e0a4e059307f admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:39.614165 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d9888-3fcc-40c5-be53-e0a4e059307f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:39.616607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d9888-3fcc-40c5-be53-e0a4e059307f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:39.687291 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e049a-2399-4afe-bb71-b7369fb5a4c1 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:39.688489 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1106/2202] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:07:39 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:39.700799 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e049a-2399-4afe-bb71-b7369fb5a4c1 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:39.718039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:39.880882 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ade30-0a00-4a54-a0f0-18b8701016ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:39.882736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ade30-0a00-4a54-a0f0-18b8701016ae admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:39.883288 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ade30-0a00-4a54-a0f0-18b8701016ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:39.886558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ade30-0a00-4a54-a0f0-18b8701016ae admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:39.887719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ade30-0a00-4a54-a0f0-18b8701016ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:39.891120 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ade30-0a00-4a54-a0f0-18b8701016ae admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:39.983713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d9888-3fcc-40c5-be53-e0a4e059307f admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:40.000748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1097/2203] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:07:39 2022] POST /identity/v3/users => generated 288 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:40.005895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d9888-3fcc-40c5-be53-e0a4e059307f admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:40.016054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac28320-57fc-4f16-9e18-0d34fbd0158b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:40.017354 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac28320-57fc-4f16-9e18-0d34fbd0158b admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:40.017932 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac28320-57fc-4f16-9e18-0d34fbd0158b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:40.018468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac28320-57fc-4f16-9e18-0d34fbd0158b admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:40.019440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac28320-57fc-4f16-9e18-0d34fbd0158b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:40.023101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac28320-57fc-4f16-9e18-0d34fbd0158b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:40.077713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1107/2204] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:40.078208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ade30-0a00-4a54-a0f0-18b8701016ae admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:40.096540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ade30-0a00-4a54-a0f0-18b8701016ae admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:40.114353 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ac832-0444-4c22-b79e-c361b01ad833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:40.115006 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ac832-0444-4c22-b79e-c361b01ad833 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:40.115289 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ac832-0444-4c22-b79e-c361b01ad833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:40.115566 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ac832-0444-4c22-b79e-c361b01ad833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:40.116272 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ac832-0444-4c22-b79e-c361b01ad833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:40.117898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ac832-0444-4c22-b79e-c361b01ad833 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:40.137428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1098/2205] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:40.144061 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac28320-57fc-4f16-9e18-0d34fbd0158b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:40.163350 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac28320-57fc-4f16-9e18-0d34fbd0158b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:40.180256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0f233-6f7f-46a4-b569-918ae17a1470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:40.181217 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f233-6f7f-46a4-b569-918ae17a1470 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:40.181830 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f233-6f7f-46a4-b569-918ae17a1470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:40.183841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f233-6f7f-46a4-b569-918ae17a1470 admin admin] PATH_INFO: `/v3/projects/ac19f63a387c48c890842d83234e274e/users/dc8c1cf1e1e241bd9d9505ce3fde7211/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:40.231460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0f233-6f7f-46a4-b569-918ae17a1470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac19f63a387c48c890842d83234e274e, user_id=dc8c1cf1e1e241bd9d9505ce3fde7211, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:40.239403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0f233-6f7f-46a4-b569-918ae17a1470 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:40.273399 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1108/2206] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:07:40 2022] PUT /identity/v3/projects/ac19f63a387c48c890842d83234e274e/users/dc8c1cf1e1e241bd9d9505ce3fde7211/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:40.287400 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d33ce6-92d3-4166-87e1-ba54b1b16621 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:40.288266 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d33ce6-92d3-4166-87e1-ba54b1b16621 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:40.288266 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d33ce6-92d3-4166-87e1-ba54b1b16621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:40.335877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-27d33ce6-92d3-4166-87e1-ba54b1b16621 None None] MFA Rules not processed for user `dc8c1cf1e1e241bd9d9505ce3fde7211`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:40.337457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-27d33ce6-92d3-4166-87e1-ba54b1b16621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:40.522789 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0f233-6f7f-46a4-b569-918ae17a1470 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:40.524560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1099/2207] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:40.630705 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:40.650193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0f233-6f7f-46a4-b569-918ae17a1470 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:40.659270 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a25c7-7a6d-49d7-87d7-e35cd3acbe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:40.660362 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a25c7-7a6d-49d7-87d7-e35cd3acbe29 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:40.662751 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a25c7-7a6d-49d7-87d7-e35cd3acbe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:40.664317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a25c7-7a6d-49d7-87d7-e35cd3acbe29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:40.665245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a25c7-7a6d-49d7-87d7-e35cd3acbe29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:40.668547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a25c7-7a6d-49d7-87d7-e35cd3acbe29 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:40.729859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1109/2208] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:07:40 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:40.735549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d33ce6-92d3-4166-87e1-ba54b1b16621 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:40.748299 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d33ce6-92d3-4166-87e1-ba54b1b16621 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:40.914519 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb6e09-b95f-4840-a3ad-c64573bc03aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:40.915318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb6e09-b95f-4840-a3ad-c64573bc03aa admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:40.915724 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb6e09-b95f-4840-a3ad-c64573bc03aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:40.916142 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb6e09-b95f-4840-a3ad-c64573bc03aa admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:40.916884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb6e09-b95f-4840-a3ad-c64573bc03aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:40.922330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb6e09-b95f-4840-a3ad-c64573bc03aa admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:40.957714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1100/2209] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:07:40 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:40.961837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a25c7-7a6d-49d7-87d7-e35cd3acbe29 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:40.984452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a25c7-7a6d-49d7-87d7-e35cd3acbe29 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:41.004729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f51ff-16e0-402b-bb74-fbfb40902c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:41.005373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f51ff-16e0-402b-bb74-fbfb40902c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:41.005656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f51ff-16e0-402b-bb74-fbfb40902c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:41.005936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f51ff-16e0-402b-bb74-fbfb40902c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:41.006608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f51ff-16e0-402b-bb74-fbfb40902c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:41.008277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f51ff-16e0-402b-bb74-fbfb40902c51 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:41.052797 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1110/2210] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:41.056788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb6e09-b95f-4840-a3ad-c64573bc03aa admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:41.077759 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb6e09-b95f-4840-a3ad-c64573bc03aa admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:41.089911 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f5e9a-b94c-4532-9aa4-30706ce2ed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:41.090811 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f5e9a-b94c-4532-9aa4-30706ce2ed13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:41.091330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f5e9a-b94c-4532-9aa4-30706ce2ed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:41.091761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f5e9a-b94c-4532-9aa4-30706ce2ed13 admin admin] PATH_INFO: `/v3/projects/684d73dbf6a5482cbb5916c23a1b7171/users/06bf8acaaacb4ae193e141980353cc8e/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:41.101866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:41.142322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f5e9a-b94c-4532-9aa4-30706ce2ed13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684d73dbf6a5482cbb5916c23a1b7171, user_id=06bf8acaaacb4ae193e141980353cc8e, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:41.145377 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f5e9a-b94c-4532-9aa4-30706ce2ed13 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:41.177392 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1101/2211] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:07:41 2022] PUT /identity/v3/projects/684d73dbf6a5482cbb5916c23a1b7171/users/06bf8acaaacb4ae193e141980353cc8e/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:41.180801 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f51ff-16e0-402b-bb74-fbfb40902c51 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:41.196834 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f51ff-16e0-402b-bb74-fbfb40902c51 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:41.366039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1466d7-f77e-4e58-8bdf-b29ebe2655a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:41.366687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1466d7-f77e-4e58-8bdf-b29ebe2655a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:41.366969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1466d7-f77e-4e58-8bdf-b29ebe2655a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:41.367247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1466d7-f77e-4e58-8bdf-b29ebe2655a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:41.367954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1466d7-f77e-4e58-8bdf-b29ebe2655a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:41.369812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1466d7-f77e-4e58-8bdf-b29ebe2655a8 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:41.395715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f5e9a-b94c-4532-9aa4-30706ce2ed13 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:41.402064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1111/2212] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:41.410166 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f5e9a-b94c-4532-9aa4-30706ce2ed13 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:41.425486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc53f86-f157-4bac-9638-231c477fa17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:41.426542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc53f86-f157-4bac-9638-231c477fa17c admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:41.427116 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc53f86-f157-4bac-9638-231c477fa17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:41.427559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc53f86-f157-4bac-9638-231c477fa17c admin admin] PATH_INFO: `/v3/projects/684d73dbf6a5482cbb5916c23a1b7171/users/06bf8acaaacb4ae193e141980353cc8e/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:41.436449 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc53f86-f157-4bac-9638-231c477fa17c admin admin] RBAC: Authorizing `identity:create_grant(project_id=684d73dbf6a5482cbb5916c23a1b7171, user_id=06bf8acaaacb4ae193e141980353cc8e, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:41.439488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc53f86-f157-4bac-9638-231c477fa17c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:41.475528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1102/2213] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:07:41 2022] PUT /identity/v3/projects/684d73dbf6a5482cbb5916c23a1b7171/users/06bf8acaaacb4ae193e141980353cc8e/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:41.486754 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31524a09-0949-46c9-8e65-a9f3f7f38e2a None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:41.487566 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31524a09-0949-46c9-8e65-a9f3f7f38e2a None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:41.488049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31524a09-0949-46c9-8e65-a9f3f7f38e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:41.553995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-31524a09-0949-46c9-8e65-a9f3f7f38e2a None None] MFA Rules not processed for user `06bf8acaaacb4ae193e141980353cc8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:41.555440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-31524a09-0949-46c9-8e65-a9f3f7f38e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:41.707918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1112/2214] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:41.840612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc53f86-f157-4bac-9638-231c477fa17c admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:41.845991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3dc53f86-f157-4bac-9638-231c477fa17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:41.952717 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc53f86-f157-4bac-9638-231c477fa17c admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:41.960072 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fe865-c987-4640-865a-c904c21ff8f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:41.961795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fe865-c987-4640-865a-c904c21ff8f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:41.962305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fe865-c987-4640-865a-c904c21ff8f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:41.962868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fe865-c987-4640-865a-c904c21ff8f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:41.999856 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fe865-c987-4640-865a-c904c21ff8f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:42.002239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fe865-c987-4640-865a-c904c21ff8f8 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:42.026836 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1103/2215] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:42.718196 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31524a09-0949-46c9-8e65-a9f3f7f38e2a None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:42.721546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-31524a09-0949-46c9-8e65-a9f3f7f38e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:42.887564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:42.911626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31524a09-0949-46c9-8e65-a9f3f7f38e2a None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:42.918492 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea5965-51a5-4cf5-a294-e43a99710cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:42.920077 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea5965-51a5-4cf5-a294-e43a99710cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:42.920428 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea5965-51a5-4cf5-a294-e43a99710cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:42.920765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea5965-51a5-4cf5-a294-e43a99710cc8 admin admin] PATH_INFO: `/v3/users/c8238b59d0ee46b0a0f09e170a9510ec` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:42.922240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea5965-51a5-4cf5-a294-e43a99710cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8238b59d0ee46b0a0f09e170a9510ec)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:42.924711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea5965-51a5-4cf5-a294-e43a99710cc8 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:43.007268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d5ea5965-51a5-4cf5-a294-e43a99710cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8238b59d0ee46b0a0f09e170a9510ec'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:43.023039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d5ea5965-51a5-4cf5-a294-e43a99710cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8238b59d0ee46b0a0f09e170a9510ec'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:43.083270 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d5ea5965-51a5-4cf5-a294-e43a99710cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8238b59d0ee46b0a0f09e170a9510ec'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:43.084130 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d5ea5965-51a5-4cf5-a294-e43a99710cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8238b59d0ee46b0a0f09e170a9510ec'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:43.084803 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d5ea5965-51a5-4cf5-a294-e43a99710cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8238b59d0ee46b0a0f09e170a9510ec'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:43.117118 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1113/2216] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:07:42 2022] DELETE /identity/v3/users/c8238b59d0ee46b0a0f09e170a9510ec => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:43.118520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3e0e4-392b-4b25-92da-7762a6186d8d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:43.118993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3e0e4-392b-4b25-92da-7762a6186d8d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:43.119078 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3e0e4-392b-4b25-92da-7762a6186d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:43.147647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-8fc3e0e4-392b-4b25-92da-7762a6186d8d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:43.148929 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8fc3e0e4-392b-4b25-92da-7762a6186d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:43.285268 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1104/2217] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:43.623135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea5965-51a5-4cf5-a294-e43a99710cc8 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:43.625413 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d5ea5965-51a5-4cf5-a294-e43a99710cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:43.812564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea5965-51a5-4cf5-a294-e43a99710cc8 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:43.826433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59341432-2b4a-4be6-be84-996cadacfeea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:43.826959 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59341432-2b4a-4be6-be84-996cadacfeea service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:43.827049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59341432-2b4a-4be6-be84-996cadacfeea service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:43.827274 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59341432-2b4a-4be6-be84-996cadacfeea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:43.852755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59341432-2b4a-4be6-be84-996cadacfeea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:43.856663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59341432-2b4a-4be6-be84-996cadacfeea service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:43.884030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1114/2218] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:45.550477 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3e0e4-392b-4b25-92da-7762a6186d8d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:45.552616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8fc3e0e4-392b-4b25-92da-7762a6186d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:45.582340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3e0e4-392b-4b25-92da-7762a6186d8d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:45.606090 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed93ef-7742-45f9-ad79-f5c6a67de575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:45.606813 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed93ef-7742-45f9-ad79-f5c6a67de575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:45.607101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed93ef-7742-45f9-ad79-f5c6a67de575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:45.607376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed93ef-7742-45f9-ad79-f5c6a67de575 admin admin] PATH_INFO: `/v3/projects/15fa784a7ad94c7caf3b7e7cd2ab42d6` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:45.608578 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed93ef-7742-45f9-ad79-f5c6a67de575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15fa784a7ad94c7caf3b7e7cd2ab42d6)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:45.610679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed93ef-7742-45f9-ad79-f5c6a67de575 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:45.746895 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f7ed93ef-7742-45f9-ad79-f5c6a67de575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15fa784a7ad94c7caf3b7e7cd2ab42d6', 'request_id': 'req-f7ed93ef-7742-45f9-ad79-f5c6a67de575'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:45.771783 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f7ed93ef-7742-45f9-ad79-f5c6a67de575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15fa784a7ad94c7caf3b7e7cd2ab42d6', 'request_id': 'req-f7ed93ef-7742-45f9-ad79-f5c6a67de575'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:45.793313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f7ed93ef-7742-45f9-ad79-f5c6a67de575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15fa784a7ad94c7caf3b7e7cd2ab42d6', 'request_id': 'req-f7ed93ef-7742-45f9-ad79-f5c6a67de575'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:45.804110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:45.824409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f7ed93ef-7742-45f9-ad79-f5c6a67de575 admin admin] The token cache is being invalidate because project 15fa784a7ad94c7caf3b7e7cd2ab42d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:07:45.824520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f7ed93ef-7742-45f9-ad79-f5c6a67de575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:45.825988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f7ed93ef-7742-45f9-ad79-f5c6a67de575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:45.829882 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1105/2219] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:07:45 2022] DELETE /identity/v3/projects/15fa784a7ad94c7caf3b7e7cd2ab42d6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:45.834792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a271ba8-175a-44b3-b1d3-a0393a2d8b0a None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:45.835275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a271ba8-175a-44b3-b1d3-a0393a2d8b0a None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:45.841424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a271ba8-175a-44b3-b1d3-a0393a2d8b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:45.891041 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-1a271ba8-175a-44b3-b1d3-a0393a2d8b0a None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:45.893057 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1a271ba8-175a-44b3-b1d3-a0393a2d8b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:46.080415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1115/2220] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:46.082173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66b701-8116-49f2-9571-3ca62fb98fd2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:46.082521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66b701-8116-49f2-9571-3ca62fb98fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:46.082850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66b701-8116-49f2-9571-3ca62fb98fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:46.115966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1b66b701-8116-49f2-9571-3ca62fb98fd2 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:46.117228 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1b66b701-8116-49f2-9571-3ca62fb98fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:46.142746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a271ba8-175a-44b3-b1d3-a0393a2d8b0a None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:46.149086 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1106/2221] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:46.160025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a271ba8-175a-44b3-b1d3-a0393a2d8b0a None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:46.168095 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee428f-7719-486e-94ba-0669e80cb7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:46.170128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee428f-7719-486e-94ba-0669e80cb7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:46.170735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee428f-7719-486e-94ba-0669e80cb7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:46.171280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee428f-7719-486e-94ba-0669e80cb7b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:46.173470 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee428f-7719-486e-94ba-0669e80cb7b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:07:46.173960 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee428f-7719-486e-94ba-0669e80cb7b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:46.178554 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee428f-7719-486e-94ba-0669e80cb7b1 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:46.194276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:46.197851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1116/2222] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:07:46.203325 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66b701-8116-49f2-9571-3ca62fb98fd2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:46.219248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66b701-8116-49f2-9571-3ca62fb98fd2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:46.241367 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1cccb-5c73-4d94-a089-1839cd675f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:46.242286 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1cccb-5c73-4d94-a089-1839cd675f53 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:46.242752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1cccb-5c73-4d94-a089-1839cd675f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:46.243176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1cccb-5c73-4d94-a089-1839cd675f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:46.244004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1cccb-5c73-4d94-a089-1839cd675f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:46.246407 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1cccb-5c73-4d94-a089-1839cd675f53 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:46.307065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1107/2223] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:07:46 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:46.311693 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee428f-7719-486e-94ba-0669e80cb7b1 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:46.323282 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee428f-7719-486e-94ba-0669e80cb7b1 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:46.431303 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15d4d3-2854-4500-b135-06796c417a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:46.431988 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15d4d3-2854-4500-b135-06796c417a38 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:46.433600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15d4d3-2854-4500-b135-06796c417a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:46.433958 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15d4d3-2854-4500-b135-06796c417a38 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:46.434848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15d4d3-2854-4500-b135-06796c417a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:46.437319 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15d4d3-2854-4500-b135-06796c417a38 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:46.486033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1cccb-5c73-4d94-a089-1839cd675f53 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:46.486507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1117/2224] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:07:46 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:46.500928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1cccb-5c73-4d94-a089-1839cd675f53 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:46.525373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b5cab-cd66-4960-8886-85c06a1c2923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:46.526038 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b5cab-cd66-4960-8886-85c06a1c2923 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:46.526321 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b5cab-cd66-4960-8886-85c06a1c2923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:46.526596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b5cab-cd66-4960-8886-85c06a1c2923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:46.527276 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b5cab-cd66-4960-8886-85c06a1c2923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:46.531352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b5cab-cd66-4960-8886-85c06a1c2923 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:46.572620 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1108/2225] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:07:46.577573 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15d4d3-2854-4500-b135-06796c417a38 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:46.598810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15d4d3-2854-4500-b135-06796c417a38 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:46.604892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684530e5-173e-496c-ba39-61d4a6a630a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:46.605610 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684530e5-173e-496c-ba39-61d4a6a630a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:46.605994 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684530e5-173e-496c-ba39-61d4a6a630a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:46.606384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684530e5-173e-496c-ba39-61d4a6a630a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:46.607839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684530e5-173e-496c-ba39-61d4a6a630a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:46.610157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684530e5-173e-496c-ba39-61d4a6a630a7 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:46.630691 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b5cab-cd66-4960-8886-85c06a1c2923 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:46.630901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1118/2226] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:46.660886 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b5cab-cd66-4960-8886-85c06a1c2923 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:46.667340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af6402-1fba-4a95-8e32-fc93c295b564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:46.668821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af6402-1fba-4a95-8e32-fc93c295b564 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:46.669271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af6402-1fba-4a95-8e32-fc93c295b564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:46.669653 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af6402-1fba-4a95-8e32-fc93c295b564 admin admin] PATH_INFO: `/v3/projects/3ec30b8e9d4a47179f1493d592b5f5e2/users/b9cb22635f4a48048cd0d4c51355134e/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:46.703758 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af6402-1fba-4a95-8e32-fc93c295b564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec30b8e9d4a47179f1493d592b5f5e2, user_id=b9cb22635f4a48048cd0d4c51355134e, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:46.708891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af6402-1fba-4a95-8e32-fc93c295b564 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:46.742706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1109/2227] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:07:46 2022] PUT /identity/v3/projects/3ec30b8e9d4a47179f1493d592b5f5e2/users/b9cb22635f4a48048cd0d4c51355134e/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:46.755933 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335c84c-0525-48ed-9075-6aee7bdb8583 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:46.755933 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335c84c-0525-48ed-9075-6aee7bdb8583 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:46.755933 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335c84c-0525-48ed-9075-6aee7bdb8583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:46.796170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c335c84c-0525-48ed-9075-6aee7bdb8583 None None] MFA Rules not processed for user `b9cb22635f4a48048cd0d4c51355134e`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:46.797617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c335c84c-0525-48ed-9075-6aee7bdb8583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:47.124604 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1119/2228] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:47.169457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af6402-1fba-4a95-8e32-fc93c295b564 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:47.172487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-26af6402-1fba-4a95-8e32-fc93c295b564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:47.363619 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af6402-1fba-4a95-8e32-fc93c295b564 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:47.376680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d041476-3821-46cd-ad66-389c4a3e8388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:47.377317 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d041476-3821-46cd-ad66-389c4a3e8388 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:47.377595 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d041476-3821-46cd-ad66-389c4a3e8388 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:47.377863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d041476-3821-46cd-ad66-389c4a3e8388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:47.406323 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d041476-3821-46cd-ad66-389c4a3e8388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:47.407928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d041476-3821-46cd-ad66-389c4a3e8388 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:47.438945 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1110/2229] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:07:50.549965 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335c84c-0525-48ed-9075-6aee7bdb8583 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:50.551649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c335c84c-0525-48ed-9075-6aee7bdb8583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:50.629250 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d041476-3821-46cd-ad66-389c4a3e8388 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:50.630860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1d041476-3821-46cd-ad66-389c4a3e8388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:50.664174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335c84c-0525-48ed-9075-6aee7bdb8583 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:50.672910 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8ebca-a89d-4fdd-bbf9-d6a1f1ede890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:50.674147 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ebca-a89d-4fdd-bbf9-d6a1f1ede890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:50.675732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ebca-a89d-4fdd-bbf9-d6a1f1ede890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:50.676981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8ebca-a89d-4fdd-bbf9-d6a1f1ede890 admin admin] PATH_INFO: `/v3/users/817af3d4eeda4716858499ea7dd84f00` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:50.678526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8ebca-a89d-4fdd-bbf9-d6a1f1ede890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=817af3d4eeda4716858499ea7dd84f00)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:50.681724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8ebca-a89d-4fdd-bbf9-d6a1f1ede890 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:50.700863 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:50.823724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43f8ebca-a89d-4fdd-bbf9-d6a1f1ede890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '817af3d4eeda4716858499ea7dd84f00'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:50.839546 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d041476-3821-46cd-ad66-389c4a3e8388 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:50.840159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43f8ebca-a89d-4fdd-bbf9-d6a1f1ede890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '817af3d4eeda4716858499ea7dd84f00'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:50.861785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c509509-1fd5-4f42-9f78-088d4dd84908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:50.864769 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c509509-1fd5-4f42-9f78-088d4dd84908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:50.865529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c509509-1fd5-4f42-9f78-088d4dd84908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:50.865807 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c509509-1fd5-4f42-9f78-088d4dd84908 admin admin] PATH_INFO: `/v3/users/7bc9686351144413ba97ad8c03c88e9c` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:50.871416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c509509-1fd5-4f42-9f78-088d4dd84908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bc9686351144413ba97ad8c03c88e9c)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:50.876224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c509509-1fd5-4f42-9f78-088d4dd84908 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:50.881656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43f8ebca-a89d-4fdd-bbf9-d6a1f1ede890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '817af3d4eeda4716858499ea7dd84f00'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:50.882942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43f8ebca-a89d-4fdd-bbf9-d6a1f1ede890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '817af3d4eeda4716858499ea7dd84f00'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:50.884811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43f8ebca-a89d-4fdd-bbf9-d6a1f1ede890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '817af3d4eeda4716858499ea7dd84f00'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:50.926130 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1120/2230] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:07:50 2022] DELETE /identity/v3/users/817af3d4eeda4716858499ea7dd84f00 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:50.981997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:50.997719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4c509509-1fd5-4f42-9f78-088d4dd84908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bc9686351144413ba97ad8c03c88e9c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:51.008356 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4c509509-1fd5-4f42-9f78-088d4dd84908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bc9686351144413ba97ad8c03c88e9c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:51.045065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4c509509-1fd5-4f42-9f78-088d4dd84908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bc9686351144413ba97ad8c03c88e9c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:51.059591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4c509509-1fd5-4f42-9f78-088d4dd84908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bc9686351144413ba97ad8c03c88e9c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:51.060650 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4c509509-1fd5-4f42-9f78-088d4dd84908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bc9686351144413ba97ad8c03c88e9c'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:51.077839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9445fc-75d3-43b9-bc9e-1518052000e0 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:51.079878 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9445fc-75d3-43b9-bc9e-1518052000e0 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:51.080367 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9445fc-75d3-43b9-bc9e-1518052000e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:51.084003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1111/2231] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:07:50 2022] DELETE /identity/v3/users/7bc9686351144413ba97ad8c03c88e9c => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:51.117257 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-6e9445fc-75d3-43b9-bc9e-1518052000e0 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:51.123110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-6e9445fc-75d3-43b9-bc9e-1518052000e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:51.212490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1121/2232] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:51.243305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c509509-1fd5-4f42-9f78-088d4dd84908 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:51.245144 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4c509509-1fd5-4f42-9f78-088d4dd84908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:51.362064 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c509509-1fd5-4f42-9f78-088d4dd84908 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:51.370944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cf5e9-e91e-44a6-b4a8-70064714712a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:51.372961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cf5e9-e91e-44a6-b4a8-70064714712a service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:51.373471 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cf5e9-e91e-44a6-b4a8-70064714712a service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:51.373946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cf5e9-e91e-44a6-b4a8-70064714712a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:51.388897 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563cf5e9-e91e-44a6-b4a8-70064714712a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:51.390658 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563cf5e9-e91e-44a6-b4a8-70064714712a service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:51.407298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1112/2233] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:52.847432 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9445fc-75d3-43b9-bc9e-1518052000e0 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:52.849769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-6e9445fc-75d3-43b9-bc9e-1518052000e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:52.868291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9445fc-75d3-43b9-bc9e-1518052000e0 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:52.889993 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715763f9-846c-48c1-9bc6-f2f60094505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:52.890786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715763f9-846c-48c1-9bc6-f2f60094505f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:52.891135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715763f9-846c-48c1-9bc6-f2f60094505f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:52.891564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715763f9-846c-48c1-9bc6-f2f60094505f admin admin] PATH_INFO: `/v3/projects/d387d6236e984424ba1bd292bfc7b652` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:52.893523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715763f9-846c-48c1-9bc6-f2f60094505f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d387d6236e984424ba1bd292bfc7b652)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:52.896299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715763f9-846c-48c1-9bc6-f2f60094505f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:52.996656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-715763f9-846c-48c1-9bc6-f2f60094505f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd387d6236e984424ba1bd292bfc7b652', 'request_id': 'req-715763f9-846c-48c1-9bc6-f2f60094505f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:53.013786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-715763f9-846c-48c1-9bc6-f2f60094505f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd387d6236e984424ba1bd292bfc7b652', 'request_id': 'req-715763f9-846c-48c1-9bc6-f2f60094505f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:53.028680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-715763f9-846c-48c1-9bc6-f2f60094505f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd387d6236e984424ba1bd292bfc7b652', 'request_id': 'req-715763f9-846c-48c1-9bc6-f2f60094505f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:53.049616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-715763f9-846c-48c1-9bc6-f2f60094505f admin admin] The token cache is being invalidate because project d387d6236e984424ba1bd292bfc7b652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:07:53.050476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-715763f9-846c-48c1-9bc6-f2f60094505f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:53.052031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-715763f9-846c-48c1-9bc6-f2f60094505f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:53.069291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1122/2234] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:07:52 2022] DELETE /identity/v3/projects/d387d6236e984424ba1bd292bfc7b652 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:53.073166 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cf5e9-e91e-44a6-b4a8-70064714712a service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:53.086058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cf5e9-e91e-44a6-b4a8-70064714712a service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:53.259429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf75a2-0c1f-42af-85c8-d3d30c35521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:53.262171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf75a2-0c1f-42af-85c8-d3d30c35521a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:53.264348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf75a2-0c1f-42af-85c8-d3d30c35521a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:53.264863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf75a2-0c1f-42af-85c8-d3d30c35521a admin admin] PATH_INFO: `/v3/users/371e35ae51f6492f979983d080476dca` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:53.268260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf75a2-0c1f-42af-85c8-d3d30c35521a admin admin] RBAC: Authorizing `identity:delete_user(user_id=371e35ae51f6492f979983d080476dca)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:53.272429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf75a2-0c1f-42af-85c8-d3d30c35521a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:53.360056 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715763f9-846c-48c1-9bc6-f2f60094505f admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:53.362260 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-715763f9-846c-48c1-9bc6-f2f60094505f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:53.401648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715763f9-846c-48c1-9bc6-f2f60094505f admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:53.408147 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9baf75a2-0c1f-42af-85c8-d3d30c35521a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371e35ae51f6492f979983d080476dca'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:53.419275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf118db1-9dda-41c3-9e67-c0d0de70b0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:53.419275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf118db1-9dda-41c3-9e67-c0d0de70b0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:53.420588 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf118db1-9dda-41c3-9e67-c0d0de70b0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:53.420588 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf118db1-9dda-41c3-9e67-c0d0de70b0d2 admin admin] PATH_INFO: `/v3/projects/2a03b7ca6be2414085e89c22732bffca` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:53.421880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf118db1-9dda-41c3-9e67-c0d0de70b0d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a03b7ca6be2414085e89c22732bffca)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:53.426456 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf118db1-9dda-41c3-9e67-c0d0de70b0d2 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:53.429966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9baf75a2-0c1f-42af-85c8-d3d30c35521a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371e35ae51f6492f979983d080476dca'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:53.434033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:53.439402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:53.460524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9baf75a2-0c1f-42af-85c8-d3d30c35521a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371e35ae51f6492f979983d080476dca'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:53.474747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9baf75a2-0c1f-42af-85c8-d3d30c35521a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371e35ae51f6492f979983d080476dca'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:53.477022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9baf75a2-0c1f-42af-85c8-d3d30c35521a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371e35ae51f6492f979983d080476dca'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:53.494065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1113/2235] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:07:53 2022] DELETE /identity/v3/users/371e35ae51f6492f979983d080476dca => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:53.554978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-cf118db1-9dda-41c3-9e67-c0d0de70b0d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a03b7ca6be2414085e89c22732bffca', 'request_id': 'req-cf118db1-9dda-41c3-9e67-c0d0de70b0d2'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:53.569260 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-cf118db1-9dda-41c3-9e67-c0d0de70b0d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a03b7ca6be2414085e89c22732bffca', 'request_id': 'req-cf118db1-9dda-41c3-9e67-c0d0de70b0d2'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:53.585604 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-cf118db1-9dda-41c3-9e67-c0d0de70b0d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a03b7ca6be2414085e89c22732bffca', 'request_id': 'req-cf118db1-9dda-41c3-9e67-c0d0de70b0d2'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:53.611096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-cf118db1-9dda-41c3-9e67-c0d0de70b0d2 admin admin] The token cache is being invalidate because project 2a03b7ca6be2414085e89c22732bffca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:07:53.611397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-cf118db1-9dda-41c3-9e67-c0d0de70b0d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:53.612237 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-cf118db1-9dda-41c3-9e67-c0d0de70b0d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:53.614251 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1123/2236] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:07:53 2022] DELETE /identity/v3/projects/2a03b7ca6be2414085e89c22732bffca => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:07:53.624050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b118d-99a9-4cd9-80fa-4fda5191b622 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:53.624380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b118d-99a9-4cd9-80fa-4fda5191b622 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:53.624582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b118d-99a9-4cd9-80fa-4fda5191b622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:53.679253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-211b118d-99a9-4cd9-80fa-4fda5191b622 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:53.709790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-211b118d-99a9-4cd9-80fa-4fda5191b622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:53.838906 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1114/2237] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:07:53.848309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc748ad-5e4f-4215-bcc8-afa606a926d6 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:53.848871 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc748ad-5e4f-4215-bcc8-afa606a926d6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:53.848971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc748ad-5e4f-4215-bcc8-afa606a926d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:53.883113 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-bcc748ad-5e4f-4215-bcc8-afa606a926d6 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:53.891451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-bcc748ad-5e4f-4215-bcc8-afa606a926d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:53.902730 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1124/2238] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:53.908088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b118d-99a9-4cd9-80fa-4fda5191b622 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:53.928278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b118d-99a9-4cd9-80fa-4fda5191b622 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:53.934239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec846c5-054d-4cfe-b67e-479f50fae3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:53.935609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec846c5-054d-4cfe-b67e-479f50fae3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:53.936898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec846c5-054d-4cfe-b67e-479f50fae3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:53.937868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec846c5-054d-4cfe-b67e-479f50fae3b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:53.938084 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec846c5-054d-4cfe-b67e-479f50fae3b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:07:53.938985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec846c5-054d-4cfe-b67e-479f50fae3b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:53.941193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec846c5-054d-4cfe-b67e-479f50fae3b0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:53.966310 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1115/2239] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:07:53.971261 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc748ad-5e4f-4215-bcc8-afa606a926d6 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:53.990264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc748ad-5e4f-4215-bcc8-afa606a926d6 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:54.000075 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cbc63-9f5b-426a-a888-df32ec748ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:54.000747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cbc63-9f5b-426a-a888-df32ec748ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:54.001072 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cbc63-9f5b-426a-a888-df32ec748ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:54.001391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cbc63-9f5b-426a-a888-df32ec748ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:54.002093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cbc63-9f5b-426a-a888-df32ec748ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:54.007003 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cbc63-9f5b-426a-a888-df32ec748ea3 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:54.063760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1125/2240] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:07:53 2022] POST /identity/v3/projects => generated 359 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:54.065231 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec846c5-054d-4cfe-b67e-479f50fae3b0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:54.088275 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec846c5-054d-4cfe-b67e-479f50fae3b0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:54.196774 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe15dd-5642-49a4-9a75-0e9e8ee11b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:54.197492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe15dd-5642-49a4-9a75-0e9e8ee11b8a admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:54.197729 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe15dd-5642-49a4-9a75-0e9e8ee11b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:54.198040 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe15dd-5642-49a4-9a75-0e9e8ee11b8a admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:54.199221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe15dd-5642-49a4-9a75-0e9e8ee11b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:54.202050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe15dd-5642-49a4-9a75-0e9e8ee11b8a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:54.234809 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1116/2241] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:07:54 2022] POST /identity/v3/users => generated 280 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:07:54.239570 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cbc63-9f5b-426a-a888-df32ec748ea3 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:54.260076 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cbc63-9f5b-426a-a888-df32ec748ea3 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:54.276196 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19382d12-81d1-427f-987f-6cd3363e8f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:54.277414 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19382d12-81d1-427f-987f-6cd3363e8f7a admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:54.277890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19382d12-81d1-427f-987f-6cd3363e8f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:54.279843 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19382d12-81d1-427f-987f-6cd3363e8f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:54.280765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19382d12-81d1-427f-987f-6cd3363e8f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:54.285217 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19382d12-81d1-427f-987f-6cd3363e8f7a admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:54.319535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1126/2242] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:54.321671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe15dd-5642-49a4-9a75-0e9e8ee11b8a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:54.335372 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe15dd-5642-49a4-9a75-0e9e8ee11b8a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:54.336244 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19382d12-81d1-427f-987f-6cd3363e8f7a admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:54.339475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-19382d12-81d1-427f-987f-6cd3363e8f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:54.342423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132fd34-2621-4261-b3cc-ed1152008413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:54.343120 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132fd34-2621-4261-b3cc-ed1152008413 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:54.343943 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132fd34-2621-4261-b3cc-ed1152008413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:54.343943 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132fd34-2621-4261-b3cc-ed1152008413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:54.344382 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132fd34-2621-4261-b3cc-ed1152008413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:54.346068 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132fd34-2621-4261-b3cc-ed1152008413 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:54.370150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1117/2243] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:07:54.372512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132fd34-2621-4261-b3cc-ed1152008413 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:54.381056 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19382d12-81d1-427f-987f-6cd3363e8f7a admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:54.388630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132fd34-2621-4261-b3cc-ed1152008413 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:54.397243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43599035-97fc-4631-b3d4-6296fa6e1db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:54.398285 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43599035-97fc-4631-b3d4-6296fa6e1db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:54.398710 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43599035-97fc-4631-b3d4-6296fa6e1db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:54.399066 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43599035-97fc-4631-b3d4-6296fa6e1db4 admin admin] PATH_INFO: `/v3/projects/5b866627d38e49fa90f30ea92d60bdb3/users/2f1a4aab1383450095401b0486e18038/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:54.422513 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43599035-97fc-4631-b3d4-6296fa6e1db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b866627d38e49fa90f30ea92d60bdb3, user_id=2f1a4aab1383450095401b0486e18038, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:54.426286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfe390-4525-4af6-9136-7dcb04b31d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:54.426506 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43599035-97fc-4631-b3d4-6296fa6e1db4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:54.431040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfe390-4525-4af6-9136-7dcb04b31d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:54.432092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfe390-4525-4af6-9136-7dcb04b31d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:54.436598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfe390-4525-4af6-9136-7dcb04b31d9b admin admin] PATH_INFO: `/v3/projects/79100dd39d8a46cc922ee53416aa4818` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:54.439474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfe390-4525-4af6-9136-7dcb04b31d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=79100dd39d8a46cc922ee53416aa4818)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:54.448751 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfe390-4525-4af6-9136-7dcb04b31d9b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:54.459300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1118/2244] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:07:54 2022] PUT /identity/v3/projects/5b866627d38e49fa90f30ea92d60bdb3/users/2f1a4aab1383450095401b0486e18038/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:07:54.461207 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7f1a5-5c2b-4a07-ab02-f8fdba8c8eb8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:54.461502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7f1a5-5c2b-4a07-ab02-f8fdba8c8eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:54.461803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7f1a5-5c2b-4a07-ab02-f8fdba8c8eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:54.601606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-16d7f1a5-5c2b-4a07-ab02-f8fdba8c8eb8 None None] MFA Rules not processed for user `2f1a4aab1383450095401b0486e18038`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:54.605323 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-16d7f1a5-5c2b-4a07-ab02-f8fdba8c8eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:54.620186 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43bfe390-4525-4af6-9136-7dcb04b31d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79100dd39d8a46cc922ee53416aa4818', 'request_id': 'req-43bfe390-4525-4af6-9136-7dcb04b31d9b'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:54.622407 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:54.644827 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43bfe390-4525-4af6-9136-7dcb04b31d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79100dd39d8a46cc922ee53416aa4818', 'request_id': 'req-43bfe390-4525-4af6-9136-7dcb04b31d9b'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:54.659930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43bfe390-4525-4af6-9136-7dcb04b31d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79100dd39d8a46cc922ee53416aa4818', 'request_id': 'req-43bfe390-4525-4af6-9136-7dcb04b31d9b'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:54.681618 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43bfe390-4525-4af6-9136-7dcb04b31d9b admin admin] The token cache is being invalidate because project 79100dd39d8a46cc922ee53416aa4818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:07:54.681999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43bfe390-4525-4af6-9136-7dcb04b31d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:54.686099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43bfe390-4525-4af6-9136-7dcb04b31d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:07:54.703944 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1127/2245] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:07:54 2022] DELETE /identity/v3/projects/79100dd39d8a46cc922ee53416aa4818 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:07:54.819948 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1119/2246] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:07:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:07:54.855735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfe390-4525-4af6-9136-7dcb04b31d9b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:54.859034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-43bfe390-4525-4af6-9136-7dcb04b31d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:54.981001 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:55.026802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfe390-4525-4af6-9136-7dcb04b31d9b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:55.042599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6014a67-7165-4f63-a0d9-219a7e859aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:55.043686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6014a67-7165-4f63-a0d9-219a7e859aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:55.045027 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6014a67-7165-4f63-a0d9-219a7e859aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:55.045464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6014a67-7165-4f63-a0d9-219a7e859aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:55.080390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6014a67-7165-4f63-a0d9-219a7e859aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:55.082608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6014a67-7165-4f63-a0d9-219a7e859aa4 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:55.108239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1128/2247] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:57.757826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7f1a5-5c2b-4a07-ab02-f8fdba8c8eb8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:57.759859 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-16d7f1a5-5c2b-4a07-ab02-f8fdba8c8eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:57.866686 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7f1a5-5c2b-4a07-ab02-f8fdba8c8eb8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:57.873253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74558199-2a99-445b-ba9b-3096e00bd4f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:57.874289 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74558199-2a99-445b-ba9b-3096e00bd4f6 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:57.874750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74558199-2a99-445b-ba9b-3096e00bd4f6 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:57.875153 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74558199-2a99-445b-ba9b-3096e00bd4f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:57.877893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-74558199-2a99-445b-ba9b-3096e00bd4f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:57.896319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74558199-2a99-445b-ba9b-3096e00bd4f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:57.898639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74558199-2a99-445b-ba9b-3096e00bd4f6 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:57.946550 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1120/2248] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:05.096889 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=10 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:05.202067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6014a67-7165-4f63-a0d9-219a7e859aa4 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:05.241483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6014a67-7165-4f63-a0d9-219a7e859aa4 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:05.254218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a76d7-1fe5-487b-9f64-96686c443fe2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:05.255108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a76d7-1fe5-487b-9f64-96686c443fe2 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:05.255536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a76d7-1fe5-487b-9f64-96686c443fe2 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:05.255916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a76d7-1fe5-487b-9f64-96686c443fe2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:05.259542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-703a76d7-1fe5-487b-9f64-96686c443fe2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:05.296777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a76d7-1fe5-487b-9f64-96686c443fe2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:05.314103 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a76d7-1fe5-487b-9f64-96686c443fe2 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:05.345633 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1129/2249] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:06.095338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74558199-2a99-445b-ba9b-3096e00bd4f6 service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:06.096964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-74558199-2a99-445b-ba9b-3096e00bd4f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:06.238222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74558199-2a99-445b-ba9b-3096e00bd4f6 service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:06.250824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413bae2-89f4-4e95-a5a4-69db6142cafd tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06bf8acaaacb4ae193e141980353cc8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '684d73dbf6a5482cbb5916c23a1b7171', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:06.251456 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413bae2-89f4-4e95-a5a4-69db6142cafd tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:06.251737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413bae2-89f4-4e95-a5a4-69db6142cafd tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:06.252038 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413bae2-89f4-4e95-a5a4-69db6142cafd tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:06.252698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413bae2-89f4-4e95-a5a4-69db6142cafd tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:08:06.252999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413bae2-89f4-4e95-a5a4-69db6142cafd tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:06.254607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413bae2-89f4-4e95-a5a4-69db6142cafd tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:06.285848 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1121/2250] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:08:06.286669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a76d7-1fe5-487b-9f64-96686c443fe2 service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:06.303477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a76d7-1fe5-487b-9f64-96686c443fe2 service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:06.313194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea209bf-e88e-47d5-9ce9-292efe32c6ff tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06bf8acaaacb4ae193e141980353cc8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '684d73dbf6a5482cbb5916c23a1b7171', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:06.313740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea209bf-e88e-47d5-9ce9-292efe32c6ff tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:06.316220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea209bf-e88e-47d5-9ce9-292efe32c6ff tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:06.316516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea209bf-e88e-47d5-9ce9-292efe32c6ff tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:06.317230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea209bf-e88e-47d5-9ce9-292efe32c6ff tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:06.321415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea209bf-e88e-47d5-9ce9-292efe32c6ff tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:06.398387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413bae2-89f4-4e95-a5a4-69db6142cafd tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:06.405875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1130/2251] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:08:06 2022] POST /identity/v3/projects => generated 347 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:08:06.413003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413bae2-89f4-4e95-a5a4-69db6142cafd tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:06.507457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:06.561551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bbf9f-d367-4dcb-b95d-341f8689b44a tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06bf8acaaacb4ae193e141980353cc8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '684d73dbf6a5482cbb5916c23a1b7171', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:06.562187 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bbf9f-d367-4dcb-b95d-341f8689b44a tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:06.562475 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bbf9f-d367-4dcb-b95d-341f8689b44a tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:06.562752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bbf9f-d367-4dcb-b95d-341f8689b44a tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:06.563473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bbf9f-d367-4dcb-b95d-341f8689b44a tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:08:06.563719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bbf9f-d367-4dcb-b95d-341f8689b44a tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:06.565374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bbf9f-d367-4dcb-b95d-341f8689b44a tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:06.589169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1122/2252] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:08:07.893860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea209bf-e88e-47d5-9ce9-292efe32c6ff tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:07.913386 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea209bf-e88e-47d5-9ce9-292efe32c6ff tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:07.925793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06bf8acaaacb4ae193e141980353cc8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '684d73dbf6a5482cbb5916c23a1b7171', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:07.926388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:07.926663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:07.926944 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] PATH_INFO: `/v3/projects/56e76607aa624657b93f2387c6bd541c` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:07.932756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] RBAC: Authorizing `identity:delete_project(project_id=56e76607aa624657b93f2387c6bd541c)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:07.936289 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:08.046693 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e76607aa624657b93f2387c6bd541c', 'request_id': 'req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:08.056377 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e76607aa624657b93f2387c6bd541c', 'request_id': 'req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:08.071461 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e76607aa624657b93f2387c6bd541c', 'request_id': 'req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:08.101338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] The token cache is being invalidate because project 56e76607aa624657b93f2387c6bd541c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:08:08.101923 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:08.103111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:08.109734 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1131/2253] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:08:07 2022] DELETE /identity/v3/projects/56e76607aa624657b93f2387c6bd541c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:08:08.124346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bbf9f-d367-4dcb-b95d-341f8689b44a tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:08.127890 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-215bbf9f-d367-4dcb-b95d-341f8689b44a tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:08.277777 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bbf9f-d367-4dcb-b95d-341f8689b44a tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:08.420108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e62d38-b92e-46f1-88e7-3f3dc55c5253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:08.423510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e62d38-b92e-46f1-88e7-3f3dc55c5253 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:08.425271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e62d38-b92e-46f1-88e7-3f3dc55c5253 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:08.426234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e62d38-b92e-46f1-88e7-3f3dc55c5253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:08.440238 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-59e62d38-b92e-46f1-88e7-3f3dc55c5253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:08.666504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e62d38-b92e-46f1-88e7-3f3dc55c5253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:08.667531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e62d38-b92e-46f1-88e7-3f3dc55c5253 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:08.694280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1123/2254] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:18.090566 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=42,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:18.692716 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=84 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:25.300837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:25.302653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:25.405102 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8b9fc-cac1-4612-a14c-68bbc4ea0e2e tempest-RoutersIpV6AdminTest-2034401249 tempest-RoutersIpV6AdminTest-2034401249-project-admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:25.415724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1856e87-b187-4c22-86b6-b3503fcceb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:25.415724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1856e87-b187-4c22-86b6-b3503fcceb48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:25.415724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1856e87-b187-4c22-86b6-b3503fcceb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:25.415724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1856e87-b187-4c22-86b6-b3503fcceb48 admin admin] PATH_INFO: `/v3/users/59f8797a423b434fa51568f7075f56e3` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:25.416140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1856e87-b187-4c22-86b6-b3503fcceb48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f8797a423b434fa51568f7075f56e3)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:25.419381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1856e87-b187-4c22-86b6-b3503fcceb48 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:25.490861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a1856e87-b187-4c22-86b6-b3503fcceb48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f8797a423b434fa51568f7075f56e3'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:25.499999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a1856e87-b187-4c22-86b6-b3503fcceb48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f8797a423b434fa51568f7075f56e3'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:25.519371 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a1856e87-b187-4c22-86b6-b3503fcceb48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f8797a423b434fa51568f7075f56e3'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:25.520351 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a1856e87-b187-4c22-86b6-b3503fcceb48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f8797a423b434fa51568f7075f56e3'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:25.521184 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a1856e87-b187-4c22-86b6-b3503fcceb48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f8797a423b434fa51568f7075f56e3'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:25.541249 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1132/2255] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:08:25 2022] DELETE /identity/v3/users/59f8797a423b434fa51568f7075f56e3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:08:25.546189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140b810-56e0-462a-8c22-d1cdd2da4c8f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:25.547168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140b810-56e0-462a-8c22-d1cdd2da4c8f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:25.547879 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140b810-56e0-462a-8c22-d1cdd2da4c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:25.571391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6140b810-56e0-462a-8c22-d1cdd2da4c8f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:25.572734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6140b810-56e0-462a-8c22-d1cdd2da4c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:25.681308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1124/2256] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:08:25.716490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1856e87-b187-4c22-86b6-b3503fcceb48 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:25.718346 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a1856e87-b187-4c22-86b6-b3503fcceb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:25.799799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1856e87-b187-4c22-86b6-b3503fcceb48 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:25.803629 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8f1be-ea92-4300-b61e-1ea62a69209f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:25.804557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8f1be-ea92-4300-b61e-1ea62a69209f service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:25.804928 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8f1be-ea92-4300-b61e-1ea62a69209f service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:25.805292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8f1be-ea92-4300-b61e-1ea62a69209f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:25.811626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140b810-56e0-462a-8c22-d1cdd2da4c8f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:25.813554 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6140b810-56e0-462a-8c22-d1cdd2da4c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:25.821361 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8f1be-ea92-4300-b61e-1ea62a69209f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:25.822826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8f1be-ea92-4300-b61e-1ea62a69209f service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:25.827347 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140b810-56e0-462a-8c22-d1cdd2da4c8f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:25.836442 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb898eb-63f6-4bef-a9d6-33565d5e3d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:25.837163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb898eb-63f6-4bef-a9d6-33565d5e3d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:25.837438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb898eb-63f6-4bef-a9d6-33565d5e3d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:25.839737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb898eb-63f6-4bef-a9d6-33565d5e3d4c admin admin] PATH_INFO: `/v3/users/296c18c9a35941dd9385049dfbaaa198` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:25.841712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1133/2257] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:25.842599 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb898eb-63f6-4bef-a9d6-33565d5e3d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=296c18c9a35941dd9385049dfbaaa198)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:25.847967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb898eb-63f6-4bef-a9d6-33565d5e3d4c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:25.927130 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eb898eb-63f6-4bef-a9d6-33565d5e3d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '296c18c9a35941dd9385049dfbaaa198'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:25.938796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eb898eb-63f6-4bef-a9d6-33565d5e3d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '296c18c9a35941dd9385049dfbaaa198'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:25.960893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eb898eb-63f6-4bef-a9d6-33565d5e3d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '296c18c9a35941dd9385049dfbaaa198'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:25.971056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eb898eb-63f6-4bef-a9d6-33565d5e3d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '296c18c9a35941dd9385049dfbaaa198'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:25.972590 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eb898eb-63f6-4bef-a9d6-33565d5e3d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '296c18c9a35941dd9385049dfbaaa198'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:25.981296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1125/2258] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:08:25 2022] DELETE /identity/v3/users/296c18c9a35941dd9385049dfbaaa198 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:08:25.988942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6b5cd-519d-45f3-8869-e992732b353d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:25.989227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6b5cd-519d-45f3-8869-e992732b353d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:25.989502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6b5cd-519d-45f3-8869-e992732b353d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:26.031698 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-11a6b5cd-519d-45f3-8869-e992732b353d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:26.033377 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-11a6b5cd-519d-45f3-8869-e992732b353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:26.056033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:26.131516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1134/2259] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:26.154058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb898eb-63f6-4bef-a9d6-33565d5e3d4c admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:26.158729 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7eb898eb-63f6-4bef-a9d6-33565d5e3d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:26.260542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb898eb-63f6-4bef-a9d6-33565d5e3d4c admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:26.266981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088286f-ef14-4ef2-ae3f-281b8135452f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:26.268275 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088286f-ef14-4ef2-ae3f-281b8135452f service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:26.268714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088286f-ef14-4ef2-ae3f-281b8135452f service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:26.269720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088286f-ef14-4ef2-ae3f-281b8135452f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:26.290192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088286f-ef14-4ef2-ae3f-281b8135452f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:26.292384 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088286f-ef14-4ef2-ae3f-281b8135452f service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:26.308383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1126/2260] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:26.552920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6b5cd-519d-45f3-8869-e992732b353d None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:26.555325 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-11a6b5cd-519d-45f3-8869-e992732b353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:26.561405 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088286f-ef14-4ef2-ae3f-281b8135452f service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:26.563768 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3088286f-ef14-4ef2-ae3f-281b8135452f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:26.575494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6b5cd-519d-45f3-8869-e992732b353d None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:26.581379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088286f-ef14-4ef2-ae3f-281b8135452f service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:26.583748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dbe0a-0ad6-4f5d-838f-0d05d5b4795b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:26.584520 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dbe0a-0ad6-4f5d-838f-0d05d5b4795b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:26.584897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dbe0a-0ad6-4f5d-838f-0d05d5b4795b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:26.585267 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dbe0a-0ad6-4f5d-838f-0d05d5b4795b admin admin] PATH_INFO: `/v3/users/0f127c9e562b418592d07e238f7ce717` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:26.586656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295dbe0a-0ad6-4f5d-838f-0d05d5b4795b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f127c9e562b418592d07e238f7ce717)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:26.588432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d55f9-348f-4ce2-a763-b71e36b07e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:26.589499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d55f9-348f-4ce2-a763-b71e36b07e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:26.589621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295dbe0a-0ad6-4f5d-838f-0d05d5b4795b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:26.590227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d55f9-348f-4ce2-a763-b71e36b07e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:26.590723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d55f9-348f-4ce2-a763-b71e36b07e08 admin admin] PATH_INFO: `/v3/projects/7a9dde70c53f45bc97d8371e4289050f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:26.592280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d55f9-348f-4ce2-a763-b71e36b07e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9dde70c53f45bc97d8371e4289050f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:26.594796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d55f9-348f-4ce2-a763-b71e36b07e08 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:26.610387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:26.685413 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-295dbe0a-0ad6-4f5d-838f-0d05d5b4795b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f127c9e562b418592d07e238f7ce717'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:26.717536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-295dbe0a-0ad6-4f5d-838f-0d05d5b4795b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f127c9e562b418592d07e238f7ce717'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:26.756712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-295dbe0a-0ad6-4f5d-838f-0d05d5b4795b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f127c9e562b418592d07e238f7ce717'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:26.758682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-295dbe0a-0ad6-4f5d-838f-0d05d5b4795b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f127c9e562b418592d07e238f7ce717'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:26.760277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-295dbe0a-0ad6-4f5d-838f-0d05d5b4795b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f127c9e562b418592d07e238f7ce717'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:26.785750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3c8d55f9-348f-4ce2-a763-b71e36b07e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9dde70c53f45bc97d8371e4289050f', 'request_id': 'req-3c8d55f9-348f-4ce2-a763-b71e36b07e08'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:26.806128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3c8d55f9-348f-4ce2-a763-b71e36b07e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9dde70c53f45bc97d8371e4289050f', 'request_id': 'req-3c8d55f9-348f-4ce2-a763-b71e36b07e08'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:26.821700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3c8d55f9-348f-4ce2-a763-b71e36b07e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9dde70c53f45bc97d8371e4289050f', 'request_id': 'req-3c8d55f9-348f-4ce2-a763-b71e36b07e08'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:26.839682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1135/2261] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:08:26 2022] DELETE /identity/v3/users/0f127c9e562b418592d07e238f7ce717 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:08:26.844939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb3a33-592d-4f7b-ab53-f11053c21cf6 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:26.845287 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb3a33-592d-4f7b-ab53-f11053c21cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:26.845568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb3a33-592d-4f7b-ab53-f11053c21cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:26.856040 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3c8d55f9-348f-4ce2-a763-b71e36b07e08 admin admin] The token cache is being invalidate because project 7a9dde70c53f45bc97d8371e4289050f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:08:26.856673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3c8d55f9-348f-4ce2-a763-b71e36b07e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:26.857847 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-3c8d55f9-348f-4ce2-a763-b71e36b07e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:26.861850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1127/2262] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:08:26 2022] DELETE /identity/v3/projects/7a9dde70c53f45bc97d8371e4289050f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:08:26.944792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e9cb3a33-592d-4f7b-ab53-f11053c21cf6 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:26.950910 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e9cb3a33-592d-4f7b-ab53-f11053c21cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:27.109489 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1136/2263] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:27.139440 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d55f9-348f-4ce2-a763-b71e36b07e08 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:27.141758 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3c8d55f9-348f-4ce2-a763-b71e36b07e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:27.295358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d55f9-348f-4ce2-a763-b71e36b07e08 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:27.369455 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073b257-c270-47de-b0fc-5d4b6b139e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:27.370199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073b257-c270-47de-b0fc-5d4b6b139e48 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:27.370982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073b257-c270-47de-b0fc-5d4b6b139e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:27.371529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073b257-c270-47de-b0fc-5d4b6b139e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:27.387373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073b257-c270-47de-b0fc-5d4b6b139e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:27.390165 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073b257-c270-47de-b0fc-5d4b6b139e48 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:27.408487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1128/2264] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:27.418528 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb3a33-592d-4f7b-ab53-f11053c21cf6 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:27.420020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e9cb3a33-592d-4f7b-ab53-f11053c21cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:27.433727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb3a33-592d-4f7b-ab53-f11053c21cf6 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:27.439007 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca050e-e9d8-4889-90cb-117ffa154c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:27.439885 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca050e-e9d8-4889-90cb-117ffa154c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:27.440035 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca050e-e9d8-4889-90cb-117ffa154c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:27.440279 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca050e-e9d8-4889-90cb-117ffa154c7f admin admin] PATH_INFO: `/v3/projects/92b7b6b00db04a738b24d162252ceed2` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:27.441774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca050e-e9d8-4889-90cb-117ffa154c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b7b6b00db04a738b24d162252ceed2)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:27.444057 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca050e-e9d8-4889-90cb-117ffa154c7f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:27.504409 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:27.525415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-92ca050e-e9d8-4889-90cb-117ffa154c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b7b6b00db04a738b24d162252ceed2', 'request_id': 'req-92ca050e-e9d8-4889-90cb-117ffa154c7f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:27.535495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-92ca050e-e9d8-4889-90cb-117ffa154c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b7b6b00db04a738b24d162252ceed2', 'request_id': 'req-92ca050e-e9d8-4889-90cb-117ffa154c7f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:27.547730 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-92ca050e-e9d8-4889-90cb-117ffa154c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b7b6b00db04a738b24d162252ceed2', 'request_id': 'req-92ca050e-e9d8-4889-90cb-117ffa154c7f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:27.563659 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-92ca050e-e9d8-4889-90cb-117ffa154c7f admin admin] The token cache is being invalidate because project 92b7b6b00db04a738b24d162252ceed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:08:27.564339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-92ca050e-e9d8-4889-90cb-117ffa154c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:27.565013 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-92ca050e-e9d8-4889-90cb-117ffa154c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:27.567499 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1137/2265] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:08:27 2022] DELETE /identity/v3/projects/92b7b6b00db04a738b24d162252ceed2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:08:27.572589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15927e-93b1-4f6d-a0f3-c1352174be5f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:27.572589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15927e-93b1-4f6d-a0f3-c1352174be5f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:27.573231 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15927e-93b1-4f6d-a0f3-c1352174be5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:27.601387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9a15927e-93b1-4f6d-a0f3-c1352174be5f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:27.604219 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9a15927e-93b1-4f6d-a0f3-c1352174be5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:27.685040 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:27.705300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1129/2266] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:27.705789 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77475f0-427f-436d-a157-fb27138b3baa None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:27.706289 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77475f0-427f-436d-a157-fb27138b3baa None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:27.706436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77475f0-427f-436d-a157-fb27138b3baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:27.756871 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c77475f0-427f-436d-a157-fb27138b3baa None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:27.758809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c77475f0-427f-436d-a157-fb27138b3baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:27.770505 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1138/2267] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:27.774830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15927e-93b1-4f6d-a0f3-c1352174be5f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:27.789205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15927e-93b1-4f6d-a0f3-c1352174be5f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:27.795952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c6601-fcf1-4070-9923-e0478806df6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:27.796469 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c6601-fcf1-4070-9923-e0478806df6c admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:27.796765 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c6601-fcf1-4070-9923-e0478806df6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:27.797030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c6601-fcf1-4070-9923-e0478806df6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:27.798640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c6601-fcf1-4070-9923-e0478806df6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:08:27.798640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c6601-fcf1-4070-9923-e0478806df6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:27.800717 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c6601-fcf1-4070-9923-e0478806df6c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:27.825950 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1130/2268] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:08:27.826517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77475f0-427f-436d-a157-fb27138b3baa None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:27.841619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77475f0-427f-436d-a157-fb27138b3baa None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:27.848956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8456fc-75a9-4afd-9cc7-78bf7672fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:27.850352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8456fc-75a9-4afd-9cc7-78bf7672fe60 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:27.851024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8456fc-75a9-4afd-9cc7-78bf7672fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:27.851468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8456fc-75a9-4afd-9cc7-78bf7672fe60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:27.852319 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8456fc-75a9-4afd-9cc7-78bf7672fe60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:27.854579 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8456fc-75a9-4afd-9cc7-78bf7672fe60 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:27.903951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1139/2269] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:08:27 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:08:27.908300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c6601-fcf1-4070-9923-e0478806df6c admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:27.920240 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c6601-fcf1-4070-9923-e0478806df6c admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:28.032795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69f2a4-ed05-4c41-aa97-1f4519a969a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:28.033736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69f2a4-ed05-4c41-aa97-1f4519a969a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:28.034095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69f2a4-ed05-4c41-aa97-1f4519a969a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:28.034563 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69f2a4-ed05-4c41-aa97-1f4519a969a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:28.035284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69f2a4-ed05-4c41-aa97-1f4519a969a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:28.038265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69f2a4-ed05-4c41-aa97-1f4519a969a8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:28.074981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1131/2270] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:08:27 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:08:28.077055 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8456fc-75a9-4afd-9cc7-78bf7672fe60 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:28.104565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8456fc-75a9-4afd-9cc7-78bf7672fe60 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:28.111878 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a9c62-3577-4774-b346-6a70175673c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:28.112792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a9c62-3577-4774-b346-6a70175673c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:28.113173 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a9c62-3577-4774-b346-6a70175673c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:28.113540 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a9c62-3577-4774-b346-6a70175673c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:28.114308 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a9c62-3577-4774-b346-6a70175673c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:28.116422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a9c62-3577-4774-b346-6a70175673c9 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:28.141813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1140/2271] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:08:28.147532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69f2a4-ed05-4c41-aa97-1f4519a969a8 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:28.202560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69f2a4-ed05-4c41-aa97-1f4519a969a8 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:28.235212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bc6fa-5e68-4e10-a691-117ad81554ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:28.241273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bc6fa-5e68-4e10-a691-117ad81554ba admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:28.243944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bc6fa-5e68-4e10-a691-117ad81554ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:28.247169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bc6fa-5e68-4e10-a691-117ad81554ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:28.248667 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bc6fa-5e68-4e10-a691-117ad81554ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:28.257410 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bc6fa-5e68-4e10-a691-117ad81554ba admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:28.287985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1132/2272] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:08:28.294020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a9c62-3577-4774-b346-6a70175673c9 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:28.313504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a9c62-3577-4774-b346-6a70175673c9 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:28.328167 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cef215-d641-4044-b7dd-464f67f646cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:28.328779 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cef215-d641-4044-b7dd-464f67f646cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:28.329065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cef215-d641-4044-b7dd-464f67f646cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:28.329340 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cef215-d641-4044-b7dd-464f67f646cc admin admin] PATH_INFO: `/v3/projects/65ba01331ab741cbbdea5b72339b1aed/users/5e6cc482add745baa9efe08827708845/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:28.365625 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cef215-d641-4044-b7dd-464f67f646cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ba01331ab741cbbdea5b72339b1aed, user_id=5e6cc482add745baa9efe08827708845, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:28.368089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cef215-d641-4044-b7dd-464f67f646cc admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:28.397933 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9e253-a1bd-4823-80f1-2977393cfbe0 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:28.398434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9e253-a1bd-4823-80f1-2977393cfbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:28.398722 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9e253-a1bd-4823-80f1-2977393cfbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:28.402921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1141/2273] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:08:28 2022] PUT /identity/v3/projects/65ba01331ab741cbbdea5b72339b1aed/users/5e6cc482add745baa9efe08827708845/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:08:28.447023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6ed9e253-a1bd-4823-80f1-2977393cfbe0 None None] MFA Rules not processed for user `5e6cc482add745baa9efe08827708845`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:28.448395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6ed9e253-a1bd-4823-80f1-2977393cfbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:28.563639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1133/2274] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:28.588627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cef215-d641-4044-b7dd-464f67f646cc admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:28.593411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-13cef215-d641-4044-b7dd-464f67f646cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:28.807314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cef215-d641-4044-b7dd-464f67f646cc admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:28.817116 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8416e9-b9d7-496a-90d7-7fc1d0738518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:28.818316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8416e9-b9d7-496a-90d7-7fc1d0738518 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:28.819182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8416e9-b9d7-496a-90d7-7fc1d0738518 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:28.819337 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8416e9-b9d7-496a-90d7-7fc1d0738518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:28.844053 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8416e9-b9d7-496a-90d7-7fc1d0738518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:28.846384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8416e9-b9d7-496a-90d7-7fc1d0738518 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:28.862015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1142/2275] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:28.888923 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9e253-a1bd-4823-80f1-2977393cfbe0 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:29.061987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:29.108498 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9e253-a1bd-4823-80f1-2977393cfbe0 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:29.117132 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8814a-bac9-4278-98b1-cdc61b147d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:29.119212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8814a-bac9-4278-98b1-cdc61b147d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:29.120267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8814a-bac9-4278-98b1-cdc61b147d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:29.120542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8814a-bac9-4278-98b1-cdc61b147d39 admin admin] PATH_INFO: `/v3/users/5e6cc482add745baa9efe08827708845` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:29.124803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8814a-bac9-4278-98b1-cdc61b147d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6cc482add745baa9efe08827708845)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:29.129537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8814a-bac9-4278-98b1-cdc61b147d39 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:29.249993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-fde8814a-bac9-4278-98b1-cdc61b147d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6cc482add745baa9efe08827708845'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:29.266445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-fde8814a-bac9-4278-98b1-cdc61b147d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6cc482add745baa9efe08827708845'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:29.291971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-fde8814a-bac9-4278-98b1-cdc61b147d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6cc482add745baa9efe08827708845'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:29.303599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8416e9-b9d7-496a-90d7-7fc1d0738518 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:29.305200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ba8416e9-b9d7-496a-90d7-7fc1d0738518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:29.320502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-fde8814a-bac9-4278-98b1-cdc61b147d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6cc482add745baa9efe08827708845'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:29.321327 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-fde8814a-bac9-4278-98b1-cdc61b147d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6cc482add745baa9efe08827708845'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:29.334946 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8416e9-b9d7-496a-90d7-7fc1d0738518 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:29.337253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1134/2276] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:08:28 2022] DELETE /identity/v3/users/5e6cc482add745baa9efe08827708845 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:08:29.343703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e250ca6-b693-414c-bd0d-06755e346cce None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:29.344024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e250ca6-b693-414c-bd0d-06755e346cce None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:29.344420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e250ca6-b693-414c-bd0d-06755e346cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:29.398522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2e250ca6-b693-414c-bd0d-06755e346cce None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:29.407361 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2e250ca6-b693-414c-bd0d-06755e346cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:29.460613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:29.485234 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d949adc-774a-402d-abdb-9f06a5750c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:29.486102 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d949adc-774a-402d-abdb-9f06a5750c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:29.488502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d949adc-774a-402d-abdb-9f06a5750c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:29.488916 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d949adc-774a-402d-abdb-9f06a5750c1d admin admin] PATH_INFO: `/v3/projects/e065c50d60c9490d80080d19ebd28d4a` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:29.492439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d949adc-774a-402d-abdb-9f06a5750c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e065c50d60c9490d80080d19ebd28d4a)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:29.507436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d949adc-774a-402d-abdb-9f06a5750c1d admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:29.611304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1135/2277] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:29.645740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9d949adc-774a-402d-abdb-9f06a5750c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e065c50d60c9490d80080d19ebd28d4a', 'request_id': 'req-9d949adc-774a-402d-abdb-9f06a5750c1d'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:29.663762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9d949adc-774a-402d-abdb-9f06a5750c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e065c50d60c9490d80080d19ebd28d4a', 'request_id': 'req-9d949adc-774a-402d-abdb-9f06a5750c1d'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:29.679103 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e250ca6-b693-414c-bd0d-06755e346cce None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:29.685211 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2e250ca6-b693-414c-bd0d-06755e346cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:29.716939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9d949adc-774a-402d-abdb-9f06a5750c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e065c50d60c9490d80080d19ebd28d4a', 'request_id': 'req-9d949adc-774a-402d-abdb-9f06a5750c1d'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:29.752766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9d949adc-774a-402d-abdb-9f06a5750c1d admin admin] The token cache is being invalidate because project e065c50d60c9490d80080d19ebd28d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:08:29.753933 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9d949adc-774a-402d-abdb-9f06a5750c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:29.755715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-9d949adc-774a-402d-abdb-9f06a5750c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:29.769070 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1143/2278] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:08:29 2022] DELETE /identity/v3/projects/e065c50d60c9490d80080d19ebd28d4a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:08:29.772671 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13324714-bf46-42b7-ae5f-b6d69a1e1dd8 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:29.773770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13324714-bf46-42b7-ae5f-b6d69a1e1dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:29.774639 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13324714-bf46-42b7-ae5f-b6d69a1e1dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:29.834413 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-13324714-bf46-42b7-ae5f-b6d69a1e1dd8 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:29.837299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-13324714-bf46-42b7-ae5f-b6d69a1e1dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:29.842553 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e250ca6-b693-414c-bd0d-06755e346cce None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:29.887070 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:29.970008 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7d84f-f0cb-4fbc-b861-cc2ee12ec697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:29.970951 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7d84f-f0cb-4fbc-b861-cc2ee12ec697 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:29.971311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7d84f-f0cb-4fbc-b861-cc2ee12ec697 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:29.973166 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7d84f-f0cb-4fbc-b861-cc2ee12ec697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:29.976510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-87e7d84f-f0cb-4fbc-b861-cc2ee12ec697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:30.076011 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7d84f-f0cb-4fbc-b861-cc2ee12ec697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:30.077563 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7d84f-f0cb-4fbc-b861-cc2ee12ec697 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:30.083821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1144/2279] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:30.092331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1136/2280] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:30.103216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49126ef-ab16-4daa-8cd9-d97999b4b35f None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:30.103719 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49126ef-ab16-4daa-8cd9-d97999b4b35f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:30.104249 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49126ef-ab16-4daa-8cd9-d97999b4b35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:30.158638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c49126ef-ab16-4daa-8cd9-d97999b4b35f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:30.169720 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c49126ef-ab16-4daa-8cd9-d97999b4b35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:30.191276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1145/2281] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:30.198622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7d84f-f0cb-4fbc-b861-cc2ee12ec697 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:30.223260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7d84f-f0cb-4fbc-b861-cc2ee12ec697 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:30.240511 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2967a9-7d59-4f3c-9b9f-52f2f5ee3d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:30.241912 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2967a9-7d59-4f3c-9b9f-52f2f5ee3d4e admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:30.242378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2967a9-7d59-4f3c-9b9f-52f2f5ee3d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:30.242837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2967a9-7d59-4f3c-9b9f-52f2f5ee3d4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:30.245057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2967a9-7d59-4f3c-9b9f-52f2f5ee3d4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:08:30.245632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2967a9-7d59-4f3c-9b9f-52f2f5ee3d4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:30.253266 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2967a9-7d59-4f3c-9b9f-52f2f5ee3d4e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:30.300793 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1137/2282] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:08:30.302743 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49126ef-ab16-4daa-8cd9-d97999b4b35f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:30.325458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49126ef-ab16-4daa-8cd9-d97999b4b35f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:30.345611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888ef21-15b5-44b0-ad42-b0fdfef6032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:30.347021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888ef21-15b5-44b0-ad42-b0fdfef6032d admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:30.350382 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888ef21-15b5-44b0-ad42-b0fdfef6032d admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:30.351061 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888ef21-15b5-44b0-ad42-b0fdfef6032d admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:30.354034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888ef21-15b5-44b0-ad42-b0fdfef6032d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:30.365380 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888ef21-15b5-44b0-ad42-b0fdfef6032d admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:30.432010 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1146/2283] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:08:30 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:08:30.434912 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2967a9-7d59-4f3c-9b9f-52f2f5ee3d4e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:30.449760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2967a9-7d59-4f3c-9b9f-52f2f5ee3d4e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:30.645412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918ab75-cee8-4743-a8d4-3195b91a24ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:30.659191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918ab75-cee8-4743-a8d4-3195b91a24ac admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:30.664429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918ab75-cee8-4743-a8d4-3195b91a24ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:30.666379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918ab75-cee8-4743-a8d4-3195b91a24ac admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:30.671167 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918ab75-cee8-4743-a8d4-3195b91a24ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:30.679809 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918ab75-cee8-4743-a8d4-3195b91a24ac admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:30.775520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1138/2284] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:08:30 2022] POST /identity/v3/users => generated 292 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:08:30.780095 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888ef21-15b5-44b0-ad42-b0fdfef6032d admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:30.794148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888ef21-15b5-44b0-ad42-b0fdfef6032d admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:30.803180 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b93b7-953a-467e-9dc0-7b3027f989fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:30.804442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b93b7-953a-467e-9dc0-7b3027f989fa admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:30.805243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b93b7-953a-467e-9dc0-7b3027f989fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:30.806043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b93b7-953a-467e-9dc0-7b3027f989fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:30.807276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b93b7-953a-467e-9dc0-7b3027f989fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:30.811254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b93b7-953a-467e-9dc0-7b3027f989fa admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:30.836553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1147/2285] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:08:30.842780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918ab75-cee8-4743-a8d4-3195b91a24ac admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:30.874617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918ab75-cee8-4743-a8d4-3195b91a24ac admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:30.885644 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4410b0c-b1d5-4f04-a069-fc488ba5a640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:30.887354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4410b0c-b1d5-4f04-a069-fc488ba5a640 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:30.888150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4410b0c-b1d5-4f04-a069-fc488ba5a640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:30.888290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4410b0c-b1d5-4f04-a069-fc488ba5a640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:30.889723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4410b0c-b1d5-4f04-a069-fc488ba5a640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:30.892665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4410b0c-b1d5-4f04-a069-fc488ba5a640 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:30.926273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1139/2286] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:08:30.931961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b93b7-953a-467e-9dc0-7b3027f989fa admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:30.976511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b93b7-953a-467e-9dc0-7b3027f989fa admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:30.983875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bed01-7978-4b06-b75d-f6c14e898abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:30.984907 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bed01-7978-4b06-b75d-f6c14e898abc admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:30.985357 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bed01-7978-4b06-b75d-f6c14e898abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:30.986409 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bed01-7978-4b06-b75d-f6c14e898abc admin admin] PATH_INFO: `/v3/projects/0dd108fcde4b4870bed6278944f6d71b/users/249d069e6c4d4ed4919dc69ad1cf22b3/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:31.043229 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bed01-7978-4b06-b75d-f6c14e898abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd108fcde4b4870bed6278944f6d71b, user_id=249d069e6c4d4ed4919dc69ad1cf22b3, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:31.046365 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bed01-7978-4b06-b75d-f6c14e898abc admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:31.087009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1148/2287] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:08:30 2022] PUT /identity/v3/projects/0dd108fcde4b4870bed6278944f6d71b/users/249d069e6c4d4ed4919dc69ad1cf22b3/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:08:31.104069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b31db7-ce21-4b9a-9556-a3098032edb0 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:31.106338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b31db7-ce21-4b9a-9556-a3098032edb0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:31.106857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b31db7-ce21-4b9a-9556-a3098032edb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:31.212806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-00b31db7-ce21-4b9a-9556-a3098032edb0 None None] MFA Rules not processed for user `249d069e6c4d4ed4919dc69ad1cf22b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:31.220840 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-00b31db7-ce21-4b9a-9556-a3098032edb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:31.311970 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:31.374166 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1140/2288] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:31.399607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bed01-7978-4b06-b75d-f6c14e898abc admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:31.401669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d81bed01-7978-4b06-b75d-f6c14e898abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:31.455302 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:31.516506 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bed01-7978-4b06-b75d-f6c14e898abc admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:31.529165 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8146f9d-a10b-4c25-9e2e-8938b8f67e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:31.529833 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8146f9d-a10b-4c25-9e2e-8938b8f67e16 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:31.530117 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8146f9d-a10b-4c25-9e2e-8938b8f67e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:31.530384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8146f9d-a10b-4c25-9e2e-8938b8f67e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:31.559701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8146f9d-a10b-4c25-9e2e-8938b8f67e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:31.567776 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8146f9d-a10b-4c25-9e2e-8938b8f67e16 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:31.581993 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1149/2289] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:32.508102 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b31db7-ce21-4b9a-9556-a3098032edb0 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:32.509604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-00b31db7-ce21-4b9a-9556-a3098032edb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:32.683728 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8146f9d-a10b-4c25-9e2e-8938b8f67e16 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:32.685523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d8146f9d-a10b-4c25-9e2e-8938b8f67e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:32.709163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8146f9d-a10b-4c25-9e2e-8938b8f67e16 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:32.709608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b31db7-ce21-4b9a-9556-a3098032edb0 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:32.720073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31331e-d105-492d-af35-2b12ba188efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:32.721105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31331e-d105-492d-af35-2b12ba188efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:32.721720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31331e-d105-492d-af35-2b12ba188efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:32.722235 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31331e-d105-492d-af35-2b12ba188efb admin admin] PATH_INFO: `/v3/projects/65ba01331ab741cbbdea5b72339b1aed` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:32.724178 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f73c0-7359-484c-9441-95683f678723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:32.725131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31331e-d105-492d-af35-2b12ba188efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ba01331ab741cbbdea5b72339b1aed)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:32.725316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f73c0-7359-484c-9441-95683f678723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:32.725418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f73c0-7359-484c-9441-95683f678723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:32.725673 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f73c0-7359-484c-9441-95683f678723 admin admin] PATH_INFO: `/v3/users/2f1a4aab1383450095401b0486e18038` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:32.727179 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f73c0-7359-484c-9441-95683f678723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f1a4aab1383450095401b0486e18038)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:32.729204 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31331e-d105-492d-af35-2b12ba188efb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:32.729732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f73c0-7359-484c-9441-95683f678723 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:32.842023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-248f73c0-7359-484c-9441-95683f678723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f1a4aab1383450095401b0486e18038'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:32.852148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-248f73c0-7359-484c-9441-95683f678723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f1a4aab1383450095401b0486e18038'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:32.876818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4c31331e-d105-492d-af35-2b12ba188efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ba01331ab741cbbdea5b72339b1aed', 'request_id': 'req-4c31331e-d105-492d-af35-2b12ba188efb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:32.877646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-248f73c0-7359-484c-9441-95683f678723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f1a4aab1383450095401b0486e18038'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:32.885247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-248f73c0-7359-484c-9441-95683f678723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f1a4aab1383450095401b0486e18038'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:32.886864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-248f73c0-7359-484c-9441-95683f678723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f1a4aab1383450095401b0486e18038'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:32.888093 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4c31331e-d105-492d-af35-2b12ba188efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ba01331ab741cbbdea5b72339b1aed', 'request_id': 'req-4c31331e-d105-492d-af35-2b12ba188efb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:32.905058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4c31331e-d105-492d-af35-2b12ba188efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ba01331ab741cbbdea5b72339b1aed', 'request_id': 'req-4c31331e-d105-492d-af35-2b12ba188efb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:32.924130 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1150/2290] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:08:32 2022] DELETE /identity/v3/users/2f1a4aab1383450095401b0486e18038 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:08:32.925841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dda9e8-91cb-44d3-af2a-a173e767ff35 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:32.926291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dda9e8-91cb-44d3-af2a-a173e767ff35 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:32.926749 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dda9e8-91cb-44d3-af2a-a173e767ff35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:32.929502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4c31331e-d105-492d-af35-2b12ba188efb admin admin] The token cache is being invalidate because project 65ba01331ab741cbbdea5b72339b1aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:08:32.929932 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4c31331e-d105-492d-af35-2b12ba188efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:32.930875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4c31331e-d105-492d-af35-2b12ba188efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:32.938692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1141/2291] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:08:32 2022] DELETE /identity/v3/projects/65ba01331ab741cbbdea5b72339b1aed => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:08:32.953470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eff3dd-a5d0-42ff-9a0c-94a522aac102 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:32.953829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eff3dd-a5d0-42ff-9a0c-94a522aac102 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:32.954209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eff3dd-a5d0-42ff-9a0c-94a522aac102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:32.972771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-40dda9e8-91cb-44d3-af2a-a173e767ff35 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:32.974123 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-40dda9e8-91cb-44d3-af2a-a173e767ff35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:32.996986 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-79eff3dd-a5d0-42ff-9a0c-94a522aac102 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:32.998436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-79eff3dd-a5d0-42ff-9a0c-94a522aac102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:33.113498 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1151/2292] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:33.134611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dda9e8-91cb-44d3-af2a-a173e767ff35 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:33.136859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-40dda9e8-91cb-44d3-af2a-a173e767ff35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:33.178939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1142/2293] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:33.181242 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d325e-34c4-4f61-afa4-23f6f3327098 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:33.181527 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d325e-34c4-4f61-afa4-23f6f3327098 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:33.181810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d325e-34c4-4f61-afa4-23f6f3327098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:33.203959 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:33.227694 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-cc3d325e-34c4-4f61-afa4-23f6f3327098 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:33.229483 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cc3d325e-34c4-4f61-afa4-23f6f3327098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:33.234119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:33.262024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1143/2294] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:08:33.262440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dda9e8-91cb-44d3-af2a-a173e767ff35 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:33.263192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d325e-34c4-4f61-afa4-23f6f3327098 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:33.266706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940778d-2fc4-42a8-b457-d19754f77042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:33.267697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940778d-2fc4-42a8-b457-d19754f77042 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:33.267697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940778d-2fc4-42a8-b457-d19754f77042 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:33.267885 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940778d-2fc4-42a8-b457-d19754f77042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:33.281336 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d325e-34c4-4f61-afa4-23f6f3327098 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:33.289383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de1f25-8bf5-494f-b7c1-599017ac29a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:33.290062 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de1f25-8bf5-494f-b7c1-599017ac29a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:33.290210 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940778d-2fc4-42a8-b457-d19754f77042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:33.290404 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de1f25-8bf5-494f-b7c1-599017ac29a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:33.290603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de1f25-8bf5-494f-b7c1-599017ac29a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:33.291323 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de1f25-8bf5-494f-b7c1-599017ac29a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:08:33.291626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de1f25-8bf5-494f-b7c1-599017ac29a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:33.291756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940778d-2fc4-42a8-b457-d19754f77042 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:33.295688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de1f25-8bf5-494f-b7c1-599017ac29a2 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:33.322608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1144/2295] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:08:33.324326 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de1f25-8bf5-494f-b7c1-599017ac29a2 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:33.325067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1152/2296] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:08:33.339083 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de1f25-8bf5-494f-b7c1-599017ac29a2 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:33.345708 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8e3be-b12f-43cd-b33f-bcdf9a570667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:33.346594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8e3be-b12f-43cd-b33f-bcdf9a570667 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:33.346898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8e3be-b12f-43cd-b33f-bcdf9a570667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:33.347175 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8e3be-b12f-43cd-b33f-bcdf9a570667 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:33.350247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8e3be-b12f-43cd-b33f-bcdf9a570667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:33.351300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8e3be-b12f-43cd-b33f-bcdf9a570667 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:33.405523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1145/2297] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:08:33 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:08:33.410083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940778d-2fc4-42a8-b457-d19754f77042 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:33.421336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940778d-2fc4-42a8-b457-d19754f77042 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:33.539685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaccb2c-ce15-48b3-903b-35cabb660e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:33.540478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaccb2c-ce15-48b3-903b-35cabb660e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:33.542556 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaccb2c-ce15-48b3-903b-35cabb660e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:33.542556 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaccb2c-ce15-48b3-903b-35cabb660e6f admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:33.543296 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaccb2c-ce15-48b3-903b-35cabb660e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:33.545458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaccb2c-ce15-48b3-903b-35cabb660e6f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:33.605752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1153/2298] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:08:33 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:08:33.609184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8e3be-b12f-43cd-b33f-bcdf9a570667 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:33.642728 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8e3be-b12f-43cd-b33f-bcdf9a570667 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:33.651785 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230c6f2-3322-4002-a3f4-2f19cd4e95c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:33.653757 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230c6f2-3322-4002-a3f4-2f19cd4e95c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:33.654445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230c6f2-3322-4002-a3f4-2f19cd4e95c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:33.655008 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230c6f2-3322-4002-a3f4-2f19cd4e95c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:33.656074 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230c6f2-3322-4002-a3f4-2f19cd4e95c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:33.661351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230c6f2-3322-4002-a3f4-2f19cd4e95c5 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:33.678102 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1146/2299] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:08:33.686396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaccb2c-ce15-48b3-903b-35cabb660e6f admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:33.704280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaccb2c-ce15-48b3-903b-35cabb660e6f admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:33.729802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4a01e-dc48-462b-9c2f-dc3615f4ab98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:33.733118 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4a01e-dc48-462b-9c2f-dc3615f4ab98 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:33.733404 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4a01e-dc48-462b-9c2f-dc3615f4ab98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:33.736349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4a01e-dc48-462b-9c2f-dc3615f4ab98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:33.739030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4a01e-dc48-462b-9c2f-dc3615f4ab98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:33.745542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4a01e-dc48-462b-9c2f-dc3615f4ab98 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:33.766630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1154/2300] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:08:33.768754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230c6f2-3322-4002-a3f4-2f19cd4e95c5 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:33.790990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230c6f2-3322-4002-a3f4-2f19cd4e95c5 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:33.798860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26b2d7-60f2-4db0-861c-553749e28c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:33.799561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26b2d7-60f2-4db0-861c-553749e28c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:33.799849 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26b2d7-60f2-4db0-861c-553749e28c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:33.801386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26b2d7-60f2-4db0-861c-553749e28c60 admin admin] PATH_INFO: `/v3/projects/e879c484e95d4f618d2acef92c745f08/users/5ad51a8ce90e4a478c2d54b9974d3d86/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:33.827393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26b2d7-60f2-4db0-861c-553749e28c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e879c484e95d4f618d2acef92c745f08, user_id=5ad51a8ce90e4a478c2d54b9974d3d86, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:33.830606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26b2d7-60f2-4db0-861c-553749e28c60 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:33.856795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1147/2301] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:08:33 2022] PUT /identity/v3/projects/e879c484e95d4f618d2acef92c745f08/users/5ad51a8ce90e4a478c2d54b9974d3d86/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:08:33.868470 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135aca2-fe96-4070-aacc-50c69828a4f6 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:33.868756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135aca2-fe96-4070-aacc-50c69828a4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:33.869228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135aca2-fe96-4070-aacc-50c69828a4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:33.926777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e135aca2-fe96-4070-aacc-50c69828a4f6 None None] MFA Rules not processed for user `5ad51a8ce90e4a478c2d54b9974d3d86`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:33.926777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e135aca2-fe96-4070-aacc-50c69828a4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:34.052589 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1155/2302] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:34.076374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26b2d7-60f2-4db0-861c-553749e28c60 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:34.079150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0b26b2d7-60f2-4db0-861c-553749e28c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:34.220058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26b2d7-60f2-4db0-861c-553749e28c60 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:34.228323 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad34a1a-025a-4274-b937-c785483293ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:34.230646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad34a1a-025a-4274-b937-c785483293ab service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:34.231172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad34a1a-025a-4274-b937-c785483293ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:34.232030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad34a1a-025a-4274-b937-c785483293ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:34.252443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad34a1a-025a-4274-b937-c785483293ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:34.254358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad34a1a-025a-4274-b937-c785483293ab service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:34.267505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1148/2303] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:34.664482 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135aca2-fe96-4070-aacc-50c69828a4f6 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:34.665857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e135aca2-fe96-4070-aacc-50c69828a4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:34.751164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:34.791753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135aca2-fe96-4070-aacc-50c69828a4f6 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:34.810203 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bceda1-470f-4099-9c8c-0868e0c46738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:34.811007 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bceda1-470f-4099-9c8c-0868e0c46738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:34.811211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bceda1-470f-4099-9c8c-0868e0c46738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:34.811491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bceda1-470f-4099-9c8c-0868e0c46738 admin admin] PATH_INFO: `/v3/projects/5b866627d38e49fa90f30ea92d60bdb3` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:34.816190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bceda1-470f-4099-9c8c-0868e0c46738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b866627d38e49fa90f30ea92d60bdb3)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:34.821152 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bceda1-470f-4099-9c8c-0868e0c46738 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:34.906340 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43bceda1-470f-4099-9c8c-0868e0c46738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b866627d38e49fa90f30ea92d60bdb3', 'request_id': 'req-43bceda1-470f-4099-9c8c-0868e0c46738'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:34.922762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43bceda1-470f-4099-9c8c-0868e0c46738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b866627d38e49fa90f30ea92d60bdb3', 'request_id': 'req-43bceda1-470f-4099-9c8c-0868e0c46738'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:34.936965 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43bceda1-470f-4099-9c8c-0868e0c46738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b866627d38e49fa90f30ea92d60bdb3', 'request_id': 'req-43bceda1-470f-4099-9c8c-0868e0c46738'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:34.982761 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43bceda1-470f-4099-9c8c-0868e0c46738 admin admin] The token cache is being invalidate because project 5b866627d38e49fa90f30ea92d60bdb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:08:34.988934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43bceda1-470f-4099-9c8c-0868e0c46738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:34.993653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-43bceda1-470f-4099-9c8c-0868e0c46738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:35.001697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1156/2304] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:08:34 2022] DELETE /identity/v3/projects/5b866627d38e49fa90f30ea92d60bdb3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:08:35.007956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773db39-fc54-4f38-ad0e-e44ec0329f99 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:35.008857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773db39-fc54-4f38-ad0e-e44ec0329f99 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:35.008857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773db39-fc54-4f38-ad0e-e44ec0329f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:35.058361 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6773db39-fc54-4f38-ad0e-e44ec0329f99 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:35.060332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6773db39-fc54-4f38-ad0e-e44ec0329f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:35.192521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1149/2305] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:35.194827 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd546f-e36b-46f2-9108-537a8804434f None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:35.195208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd546f-e36b-46f2-9108-537a8804434f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:35.195486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd546f-e36b-46f2-9108-537a8804434f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:35.241568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-b3dd546f-e36b-46f2-9108-537a8804434f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:35.245925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b3dd546f-e36b-46f2-9108-537a8804434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:35.259935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773db39-fc54-4f38-ad0e-e44ec0329f99 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:35.261348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1157/2306] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:35.271846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773db39-fc54-4f38-ad0e-e44ec0329f99 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:35.280064 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c09d5f-a7c0-47a7-a304-d31e4efebd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:35.281466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c09d5f-a7c0-47a7-a304-d31e4efebd76 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:35.281937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c09d5f-a7c0-47a7-a304-d31e4efebd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:35.282415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c09d5f-a7c0-47a7-a304-d31e4efebd76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:35.283370 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c09d5f-a7c0-47a7-a304-d31e4efebd76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:08:35.286319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c09d5f-a7c0-47a7-a304-d31e4efebd76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:35.294523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c09d5f-a7c0-47a7-a304-d31e4efebd76 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:35.316039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1150/2307] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:08:35.320501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd546f-e36b-46f2-9108-537a8804434f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:35.331133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd546f-e36b-46f2-9108-537a8804434f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:35.335878 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd10ae9-706d-4e84-a400-b2050454bb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:35.336705 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd10ae9-706d-4e84-a400-b2050454bb55 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:35.337085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd10ae9-706d-4e84-a400-b2050454bb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:35.337530 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd10ae9-706d-4e84-a400-b2050454bb55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:35.338606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd10ae9-706d-4e84-a400-b2050454bb55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:35.341612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd10ae9-706d-4e84-a400-b2050454bb55 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:35.388803 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1158/2308] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:08:35 2022] POST /identity/v3/projects => generated 359 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:08:35.390037 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c09d5f-a7c0-47a7-a304-d31e4efebd76 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:35.416105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c09d5f-a7c0-47a7-a304-d31e4efebd76 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:35.483813 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:35.615711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a4d84-47fe-40fb-af12-3c0b3f03279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:35.616193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a4d84-47fe-40fb-af12-3c0b3f03279a admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:35.616456 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a4d84-47fe-40fb-af12-3c0b3f03279a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:35.616923 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a4d84-47fe-40fb-af12-3c0b3f03279a admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:35.617400 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a4d84-47fe-40fb-af12-3c0b3f03279a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:35.619487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a4d84-47fe-40fb-af12-3c0b3f03279a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:35.676896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1151/2309] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:08:35 2022] POST /identity/v3/users => generated 280 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:08:35.681073 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd10ae9-706d-4e84-a400-b2050454bb55 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:35.699969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd10ae9-706d-4e84-a400-b2050454bb55 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:35.708812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55c0df-383d-43ff-87bc-9b1c410a82c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:35.709627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55c0df-383d-43ff-87bc-9b1c410a82c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:35.710015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55c0df-383d-43ff-87bc-9b1c410a82c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:35.711220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55c0df-383d-43ff-87bc-9b1c410a82c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:35.712101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55c0df-383d-43ff-87bc-9b1c410a82c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:35.713882 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55c0df-383d-43ff-87bc-9b1c410a82c4 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:35.733632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1159/2310] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:08:35.738012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a4d84-47fe-40fb-af12-3c0b3f03279a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:35.759202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a4d84-47fe-40fb-af12-3c0b3f03279a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:35.772838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1830a84-23dc-4e1f-a7d9-65ca706c509f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:35.773483 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1830a84-23dc-4e1f-a7d9-65ca706c509f admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:35.773764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1830a84-23dc-4e1f-a7d9-65ca706c509f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:35.774037 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1830a84-23dc-4e1f-a7d9-65ca706c509f admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:35.774703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1830a84-23dc-4e1f-a7d9-65ca706c509f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:35.779138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1830a84-23dc-4e1f-a7d9-65ca706c509f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:35.811168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1152/2311] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:08:35.815977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55c0df-383d-43ff-87bc-9b1c410a82c4 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:35.832395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55c0df-383d-43ff-87bc-9b1c410a82c4 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:35.840728 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897d7d8-f67f-42e3-b971-a3ffbb308c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:35.841580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897d7d8-f67f-42e3-b971-a3ffbb308c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:35.841925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897d7d8-f67f-42e3-b971-a3ffbb308c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:35.842628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897d7d8-f67f-42e3-b971-a3ffbb308c50 admin admin] PATH_INFO: `/v3/projects/3d4dcdad9f83450cac2faafb408ee2ac/users/140ae6175c0e4ba0b706856839d392c2/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:35.863281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897d7d8-f67f-42e3-b971-a3ffbb308c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4dcdad9f83450cac2faafb408ee2ac, user_id=140ae6175c0e4ba0b706856839d392c2, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:35.866188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897d7d8-f67f-42e3-b971-a3ffbb308c50 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:35.883699 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1160/2312] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:08:35 2022] PUT /identity/v3/projects/3d4dcdad9f83450cac2faafb408ee2ac/users/140ae6175c0e4ba0b706856839d392c2/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:08:35.894609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a1cab-7216-401d-a8f6-705f902a073c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:35.894952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a1cab-7216-401d-a8f6-705f902a073c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:35.895170 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a1cab-7216-401d-a8f6-705f902a073c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:35.969841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4f4a1cab-7216-401d-a8f6-705f902a073c None None] MFA Rules not processed for user `140ae6175c0e4ba0b706856839d392c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:35.971350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4f4a1cab-7216-401d-a8f6-705f902a073c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:36.128826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1153/2313] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:36.189982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897d7d8-f67f-42e3-b971-a3ffbb308c50 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:36.192382 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e897d7d8-f67f-42e3-b971-a3ffbb308c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:36.288455 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897d7d8-f67f-42e3-b971-a3ffbb308c50 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:36.294012 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5315777-ba74-40bc-97df-2088fcb9ae5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:36.295233 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5315777-ba74-40bc-97df-2088fcb9ae5a service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:36.295527 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5315777-ba74-40bc-97df-2088fcb9ae5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:36.295788 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5315777-ba74-40bc-97df-2088fcb9ae5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:36.310551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5315777-ba74-40bc-97df-2088fcb9ae5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:36.312225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5315777-ba74-40bc-97df-2088fcb9ae5a service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:36.323777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1161/2314] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:46.117951 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:46.317813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:52.569903 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a1cab-7216-401d-a8f6-705f902a073c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:52.571405 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4f4a1cab-7216-401d-a8f6-705f902a073c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:52.757963 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a1cab-7216-401d-a8f6-705f902a073c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:52.780847 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072c4c-1425-4153-81e4-cb0b13b55d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:52.781939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072c4c-1425-4153-81e4-cb0b13b55d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:52.782497 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072c4c-1425-4153-81e4-cb0b13b55d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:52.782998 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b072c4c-1425-4153-81e4-cb0b13b55d82 admin admin] PATH_INFO: `/v3/users/249d069e6c4d4ed4919dc69ad1cf22b3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:52.789972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072c4c-1425-4153-81e4-cb0b13b55d82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=249d069e6c4d4ed4919dc69ad1cf22b3)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:52.792537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b072c4c-1425-4153-81e4-cb0b13b55d82 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:52.875659 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1b072c4c-1425-4153-81e4-cb0b13b55d82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '249d069e6c4d4ed4919dc69ad1cf22b3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:52.899455 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1b072c4c-1425-4153-81e4-cb0b13b55d82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '249d069e6c4d4ed4919dc69ad1cf22b3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:52.919999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1b072c4c-1425-4153-81e4-cb0b13b55d82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '249d069e6c4d4ed4919dc69ad1cf22b3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:52.932303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1b072c4c-1425-4153-81e4-cb0b13b55d82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '249d069e6c4d4ed4919dc69ad1cf22b3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:52.934439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1b072c4c-1425-4153-81e4-cb0b13b55d82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '249d069e6c4d4ed4919dc69ad1cf22b3'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:52.946599 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1154/2315] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:08:52 2022] DELETE /identity/v3/users/249d069e6c4d4ed4919dc69ad1cf22b3 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:08:52.953624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7920b-f7c7-4d8c-86ec-94b5856dbb23 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:52.954576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7920b-f7c7-4d8c-86ec-94b5856dbb23 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:52.955004 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7920b-f7c7-4d8c-86ec-94b5856dbb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:53.006762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-cbc7920b-f7c7-4d8c-86ec-94b5856dbb23 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:53.009456 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-cbc7920b-f7c7-4d8c-86ec-94b5856dbb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:53.147468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1162/2316] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:53.171747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072c4c-1425-4153-81e4-cb0b13b55d82 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:53.185131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1b072c4c-1425-4153-81e4-cb0b13b55d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:53.359401 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b072c4c-1425-4153-81e4-cb0b13b55d82 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:53.373343 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c1eb1-a797-4f8c-98a3-dc5357739e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:53.376386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c1eb1-a797-4f8c-98a3-dc5357739e85 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:53.378990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c1eb1-a797-4f8c-98a3-dc5357739e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:53.379243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c1eb1-a797-4f8c-98a3-dc5357739e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:53.418696 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c1eb1-a797-4f8c-98a3-dc5357739e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:53.424136 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c1eb1-a797-4f8c-98a3-dc5357739e85 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:53.446870 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1155/2317] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:54.317775 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7920b-f7c7-4d8c-86ec-94b5856dbb23 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:54.321672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-cbc7920b-f7c7-4d8c-86ec-94b5856dbb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:54.340088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7920b-f7c7-4d8c-86ec-94b5856dbb23 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:54.358840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9711f-1138-404f-b8c1-374dd97c73b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:54.359587 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9711f-1138-404f-b8c1-374dd97c73b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:54.359966 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9711f-1138-404f-b8c1-374dd97c73b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:54.360372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9711f-1138-404f-b8c1-374dd97c73b2 admin admin] PATH_INFO: `/v3/projects/0dd108fcde4b4870bed6278944f6d71b` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:54.362736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9711f-1138-404f-b8c1-374dd97c73b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd108fcde4b4870bed6278944f6d71b)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:54.364997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9711f-1138-404f-b8c1-374dd97c73b2 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:54.472455 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-60f9711f-1138-404f-b8c1-374dd97c73b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd108fcde4b4870bed6278944f6d71b', 'request_id': 'req-60f9711f-1138-404f-b8c1-374dd97c73b2'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:54.483407 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-60f9711f-1138-404f-b8c1-374dd97c73b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd108fcde4b4870bed6278944f6d71b', 'request_id': 'req-60f9711f-1138-404f-b8c1-374dd97c73b2'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:54.495397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-60f9711f-1138-404f-b8c1-374dd97c73b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd108fcde4b4870bed6278944f6d71b', 'request_id': 'req-60f9711f-1138-404f-b8c1-374dd97c73b2'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:54.518569 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-60f9711f-1138-404f-b8c1-374dd97c73b2 admin admin] The token cache is being invalidate because project 0dd108fcde4b4870bed6278944f6d71b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:08:54.519255 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-60f9711f-1138-404f-b8c1-374dd97c73b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:54.520042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-60f9711f-1138-404f-b8c1-374dd97c73b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:08:54.522026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1163/2318] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:08:54 2022] DELETE /identity/v3/projects/0dd108fcde4b4870bed6278944f6d71b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:08:54.526810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8cc7c-ecbc-497a-a595-265edce11f2a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:54.528327 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8cc7c-ecbc-497a-a595-265edce11f2a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:54.528829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8cc7c-ecbc-497a-a595-265edce11f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:54.715495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ace8cc7c-ecbc-497a-a595-265edce11f2a None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:54.717706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ace8cc7c-ecbc-497a-a595-265edce11f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:54.738686 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:54.811229 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1156/2319] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:54.820124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760bce1-61e9-47c8-a286-3dcf9e3ec7c0 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:54.820408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760bce1-61e9-47c8-a286-3dcf9e3ec7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:54.820694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760bce1-61e9-47c8-a286-3dcf9e3ec7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:54.859070 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-8760bce1-61e9-47c8-a286-3dcf9e3ec7c0 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:54.861112 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8760bce1-61e9-47c8-a286-3dcf9e3ec7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:54.876199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1164/2320] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:54.880231 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8cc7c-ecbc-497a-a595-265edce11f2a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:54.894931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8cc7c-ecbc-497a-a595-265edce11f2a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:54.904612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e356f9-c807-4bfb-bdac-6c9eca193812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:54.905328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e356f9-c807-4bfb-bdac-6c9eca193812 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:54.905705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e356f9-c807-4bfb-bdac-6c9eca193812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:54.906485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e356f9-c807-4bfb-bdac-6c9eca193812 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:54.907443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e356f9-c807-4bfb-bdac-6c9eca193812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:08:54.908350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e356f9-c807-4bfb-bdac-6c9eca193812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:54.910492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e356f9-c807-4bfb-bdac-6c9eca193812 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:54.934075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1157/2321] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:08:54.938415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760bce1-61e9-47c8-a286-3dcf9e3ec7c0 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:54.949689 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760bce1-61e9-47c8-a286-3dcf9e3ec7c0 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:54.966316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab258e6-d9a9-4898-ab05-2cd5512ad8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:54.966740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab258e6-d9a9-4898-ab05-2cd5512ad8ff admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:54.967120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab258e6-d9a9-4898-ab05-2cd5512ad8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:54.967541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab258e6-d9a9-4898-ab05-2cd5512ad8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:54.968388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab258e6-d9a9-4898-ab05-2cd5512ad8ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:54.970461 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab258e6-d9a9-4898-ab05-2cd5512ad8ff admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:55.034144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1165/2322] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:08:54 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:08:55.038914 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e356f9-c807-4bfb-bdac-6c9eca193812 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:55.059837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e356f9-c807-4bfb-bdac-6c9eca193812 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:55.133882 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f226759-e561-4fea-b3a8-7a7e626062c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:55.134706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f226759-e561-4fea-b3a8-7a7e626062c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:55.135119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f226759-e561-4fea-b3a8-7a7e626062c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:55.135542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f226759-e561-4fea-b3a8-7a7e626062c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:55.137379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f226759-e561-4fea-b3a8-7a7e626062c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:55.139373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f226759-e561-4fea-b3a8-7a7e626062c3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:55.181371 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1158/2323] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:08:55 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:08:55.185969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab258e6-d9a9-4898-ab05-2cd5512ad8ff admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:55.205033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab258e6-d9a9-4898-ab05-2cd5512ad8ff admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:55.221446 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bf573-441f-48a4-bebf-037f019ab4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:55.223397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bf573-441f-48a4-bebf-037f019ab4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:55.225464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bf573-441f-48a4-bebf-037f019ab4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:55.226961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bf573-441f-48a4-bebf-037f019ab4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:55.233187 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bf573-441f-48a4-bebf-037f019ab4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:55.254129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bf573-441f-48a4-bebf-037f019ab4b1 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:55.285561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1166/2324] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:08:55.286717 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f226759-e561-4fea-b3a8-7a7e626062c3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:55.302132 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f226759-e561-4fea-b3a8-7a7e626062c3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:55.310379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8fb3c-0720-40f5-8499-94f8dfb38333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:55.311017 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8fb3c-0720-40f5-8499-94f8dfb38333 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:55.311302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8fb3c-0720-40f5-8499-94f8dfb38333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:55.311637 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8fb3c-0720-40f5-8499-94f8dfb38333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:55.312452 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8fb3c-0720-40f5-8499-94f8dfb38333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:55.314402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8fb3c-0720-40f5-8499-94f8dfb38333 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:55.331959 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1159/2325] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:08:55.341878 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bf573-441f-48a4-bebf-037f019ab4b1 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:55.352842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bf573-441f-48a4-bebf-037f019ab4b1 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:55.358745 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb9aa0-8419-4b32-a63f-ea8bf8ff4148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:55.359744 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb9aa0-8419-4b32-a63f-ea8bf8ff4148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:55.360269 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb9aa0-8419-4b32-a63f-ea8bf8ff4148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:55.360763 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb9aa0-8419-4b32-a63f-ea8bf8ff4148 admin admin] PATH_INFO: `/v3/projects/d04eea9bcf8f4dfd99c9603f17973abe/users/0fe233fed2594af6bb20003b608fd10f/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:55.384900 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb9aa0-8419-4b32-a63f-ea8bf8ff4148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04eea9bcf8f4dfd99c9603f17973abe, user_id=0fe233fed2594af6bb20003b608fd10f, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:55.389170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb9aa0-8419-4b32-a63f-ea8bf8ff4148 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:55.440669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8b214-fadc-4d96-9a44-a9ce0021c4d6 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:55.441031 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8b214-fadc-4d96-9a44-a9ce0021c4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:55.441216 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8b214-fadc-4d96-9a44-a9ce0021c4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:55.441921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1167/2326] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:08:55 2022] PUT /identity/v3/projects/d04eea9bcf8f4dfd99c9603f17973abe/users/0fe233fed2594af6bb20003b608fd10f/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:08:55.491576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-24a8b214-fadc-4d96-9a44-a9ce0021c4d6 None None] MFA Rules not processed for user `0fe233fed2594af6bb20003b608fd10f`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:55.492813 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-24a8b214-fadc-4d96-9a44-a9ce0021c4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:55.594566 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1160/2327] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:08:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:08:55.608088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb9aa0-8419-4b32-a63f-ea8bf8ff4148 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:08:55.609882 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b5cb9aa0-8419-4b32-a63f-ea8bf8ff4148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:55.647523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:55.711036 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb9aa0-8419-4b32-a63f-ea8bf8ff4148 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:08:55.716797 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1bacc-ac05-4dc8-883e-910c27575055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:08:55.717117 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1bacc-ac05-4dc8-883e-910c27575055 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:55.717397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1bacc-ac05-4dc8-883e-910c27575055 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:55.717671 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1bacc-ac05-4dc8-883e-910c27575055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:55.731408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1bacc-ac05-4dc8-883e-910c27575055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:08:55.733529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1bacc-ac05-4dc8-883e-910c27575055 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:08:55.744326 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1168/2328] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:08:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:05.590221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:05.739860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=17 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:07.208786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8b214-fadc-4d96-9a44-a9ce0021c4d6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:07.210342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-24a8b214-fadc-4d96-9a44-a9ce0021c4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:07.335125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8b214-fadc-4d96-9a44-a9ce0021c4d6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:07.341996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf9039-bf6d-4051-80e3-a80d068db85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:07.343243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf9039-bf6d-4051-80e3-a80d068db85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:07.343795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf9039-bf6d-4051-80e3-a80d068db85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:07.344319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf9039-bf6d-4051-80e3-a80d068db85e admin admin] PATH_INFO: `/v3/users/140ae6175c0e4ba0b706856839d392c2` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:07.346796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf9039-bf6d-4051-80e3-a80d068db85e admin admin] RBAC: Authorizing `identity:delete_user(user_id=140ae6175c0e4ba0b706856839d392c2)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:07.349206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf9039-bf6d-4051-80e3-a80d068db85e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:07.467991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bebf9039-bf6d-4051-80e3-a80d068db85e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140ae6175c0e4ba0b706856839d392c2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:07.479875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bebf9039-bf6d-4051-80e3-a80d068db85e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140ae6175c0e4ba0b706856839d392c2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:07.504693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bebf9039-bf6d-4051-80e3-a80d068db85e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140ae6175c0e4ba0b706856839d392c2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:07.530139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bebf9039-bf6d-4051-80e3-a80d068db85e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140ae6175c0e4ba0b706856839d392c2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:07.530998 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bebf9039-bf6d-4051-80e3-a80d068db85e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140ae6175c0e4ba0b706856839d392c2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:07.545706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1161/2329] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:07 2022] DELETE /identity/v3/users/140ae6175c0e4ba0b706856839d392c2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:07.556292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b72a6-8d53-4b5b-a7e9-5b40c868027f None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:07.556908 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b72a6-8d53-4b5b-a7e9-5b40c868027f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:07.556908 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b72a6-8d53-4b5b-a7e9-5b40c868027f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:07.579682 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-d24b72a6-8d53-4b5b-a7e9-5b40c868027f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:07.581148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d24b72a6-8d53-4b5b-a7e9-5b40c868027f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:07.707715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1169/2330] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:07.732603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf9039-bf6d-4051-80e3-a80d068db85e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:07.736123 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bebf9039-bf6d-4051-80e3-a80d068db85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:07.894770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf9039-bf6d-4051-80e3-a80d068db85e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:07.898733 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be9b1b-9b8a-4a04-b1a6-d2670d51c91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:07.899368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be9b1b-9b8a-4a04-b1a6-d2670d51c91e service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:07.899648 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be9b1b-9b8a-4a04-b1a6-d2670d51c91e service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:07.900483 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be9b1b-9b8a-4a04-b1a6-d2670d51c91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:07.916349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be9b1b-9b8a-4a04-b1a6-d2670d51c91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:07.917943 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be9b1b-9b8a-4a04-b1a6-d2670d51c91e service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:07.936520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1162/2331] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:08.824690 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b72a6-8d53-4b5b-a7e9-5b40c868027f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:08.827415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d24b72a6-8d53-4b5b-a7e9-5b40c868027f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:08.865099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b72a6-8d53-4b5b-a7e9-5b40c868027f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:08.877405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e23080-4005-4a87-b21f-8d571f56e395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:08.878617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e23080-4005-4a87-b21f-8d571f56e395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:08.881021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e23080-4005-4a87-b21f-8d571f56e395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:08.882335 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e23080-4005-4a87-b21f-8d571f56e395 admin admin] PATH_INFO: `/v3/projects/3d4dcdad9f83450cac2faafb408ee2ac` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:08.886787 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e23080-4005-4a87-b21f-8d571f56e395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4dcdad9f83450cac2faafb408ee2ac)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:08.895570 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e23080-4005-4a87-b21f-8d571f56e395 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:09.058212 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-70e23080-4005-4a87-b21f-8d571f56e395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4dcdad9f83450cac2faafb408ee2ac', 'request_id': 'req-70e23080-4005-4a87-b21f-8d571f56e395'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:09.092884 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-70e23080-4005-4a87-b21f-8d571f56e395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4dcdad9f83450cac2faafb408ee2ac', 'request_id': 'req-70e23080-4005-4a87-b21f-8d571f56e395'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:09.115758 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-70e23080-4005-4a87-b21f-8d571f56e395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4dcdad9f83450cac2faafb408ee2ac', 'request_id': 'req-70e23080-4005-4a87-b21f-8d571f56e395'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:09.151052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-70e23080-4005-4a87-b21f-8d571f56e395 admin admin] The token cache is being invalidate because project 3d4dcdad9f83450cac2faafb408ee2ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:09.151585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-70e23080-4005-4a87-b21f-8d571f56e395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:09.164636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-70e23080-4005-4a87-b21f-8d571f56e395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:09.167349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1170/2332] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:08 2022] DELETE /identity/v3/projects/3d4dcdad9f83450cac2faafb408ee2ac => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:09.172999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c041eb-0c82-4568-b401-5764bdf73302 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:09.173680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c041eb-0c82-4568-b401-5764bdf73302 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:09.173680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c041eb-0c82-4568-b401-5764bdf73302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:09.201066 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b6c041eb-0c82-4568-b401-5764bdf73302 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:09.204844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b6c041eb-0c82-4568-b401-5764bdf73302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:09.236017 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:09.319546 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1163/2333] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:09.330069 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565f681-a2d6-4017-ac43-57562745bb17 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:09.330566 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565f681-a2d6-4017-ac43-57562745bb17 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:09.331054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565f681-a2d6-4017-ac43-57562745bb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:09.371002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-2565f681-a2d6-4017-ac43-57562745bb17 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:09.374269 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2565f681-a2d6-4017-ac43-57562745bb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:09.384964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1171/2334] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:09.389260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c041eb-0c82-4568-b401-5764bdf73302 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:09.403021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c041eb-0c82-4568-b401-5764bdf73302 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:09.412634 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d515d-6d44-4bfa-bdb7-e63c711fca54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:09.413726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d515d-6d44-4bfa-bdb7-e63c711fca54 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:09.414164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d515d-6d44-4bfa-bdb7-e63c711fca54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:09.424222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d515d-6d44-4bfa-bdb7-e63c711fca54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:09.428523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d515d-6d44-4bfa-bdb7-e63c711fca54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:09.429104 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d515d-6d44-4bfa-bdb7-e63c711fca54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:09.432781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d515d-6d44-4bfa-bdb7-e63c711fca54 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:09.454162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1164/2335] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:09:09.459166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565f681-a2d6-4017-ac43-57562745bb17 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:09.472591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565f681-a2d6-4017-ac43-57562745bb17 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:09.482430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb362a-a33f-499b-9b6d-8bb66d264c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:09.484128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb362a-a33f-499b-9b6d-8bb66d264c45 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:09.485197 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb362a-a33f-499b-9b6d-8bb66d264c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:09.485736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb362a-a33f-499b-9b6d-8bb66d264c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:09.492292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb362a-a33f-499b-9b6d-8bb66d264c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:09.495810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb362a-a33f-499b-9b6d-8bb66d264c45 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:09.570155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1172/2336] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:09 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:09:09.583974 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d515d-6d44-4bfa-bdb7-e63c711fca54 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:09.611408 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d515d-6d44-4bfa-bdb7-e63c711fca54 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:09.755073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ee84f-f5d7-412a-8405-9e46b978ce95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:09.755726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ee84f-f5d7-412a-8405-9e46b978ce95 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:09.756178 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ee84f-f5d7-412a-8405-9e46b978ce95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:09.756447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ee84f-f5d7-412a-8405-9e46b978ce95 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:09.757117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ee84f-f5d7-412a-8405-9e46b978ce95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:09.759401 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ee84f-f5d7-412a-8405-9e46b978ce95 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:09.793826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1165/2337] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:09 2022] POST /identity/v3/users => generated 296 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:09.798618 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb362a-a33f-499b-9b6d-8bb66d264c45 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:09.830845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb362a-a33f-499b-9b6d-8bb66d264c45 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:09.849287 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d38a8-e99c-40ef-a37f-ae7ae5831426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:09.850429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d38a8-e99c-40ef-a37f-ae7ae5831426 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:09.850914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d38a8-e99c-40ef-a37f-ae7ae5831426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:09.851382 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d38a8-e99c-40ef-a37f-ae7ae5831426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:09.852585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d38a8-e99c-40ef-a37f-ae7ae5831426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:09.857802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d38a8-e99c-40ef-a37f-ae7ae5831426 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:09.883827 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1173/2338] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:09:09.885833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ee84f-f5d7-412a-8405-9e46b978ce95 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:09.898294 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ee84f-f5d7-412a-8405-9e46b978ce95 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:09.908822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d7ff9-8b50-4105-b324-8dc31563e68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:09.909449 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d7ff9-8b50-4105-b324-8dc31563e68d admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:09.909799 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d7ff9-8b50-4105-b324-8dc31563e68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:09.910148 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d7ff9-8b50-4105-b324-8dc31563e68d admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:09.911180 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d7ff9-8b50-4105-b324-8dc31563e68d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:09.913229 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d7ff9-8b50-4105-b324-8dc31563e68d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:09.933813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d38a8-e99c-40ef-a37f-ae7ae5831426 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:09.941254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1166/2339] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:09.949401 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d38a8-e99c-40ef-a37f-ae7ae5831426 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:09.955228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc9e6d-dd10-4bbd-8003-e1131c2ed68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:09.956345 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc9e6d-dd10-4bbd-8003-e1131c2ed68b admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:09.956729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc9e6d-dd10-4bbd-8003-e1131c2ed68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:09.957111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc9e6d-dd10-4bbd-8003-e1131c2ed68b admin admin] PATH_INFO: `/v3/projects/bf43cbd4a4284a1bac069b993485dfe7/users/fd66b47f86264f24b68283accebb7bd6/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:09.980592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc9e6d-dd10-4bbd-8003-e1131c2ed68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf43cbd4a4284a1bac069b993485dfe7, user_id=fd66b47f86264f24b68283accebb7bd6, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:09.983531 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc9e6d-dd10-4bbd-8003-e1131c2ed68b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:10.002914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1174/2340] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:09 2022] PUT /identity/v3/projects/bf43cbd4a4284a1bac069b993485dfe7/users/fd66b47f86264f24b68283accebb7bd6/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:09:10.013919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b67cc-541f-4b09-93c0-094f22b39652 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:10.014200 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b67cc-541f-4b09-93c0-094f22b39652 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:10.014465 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b67cc-541f-4b09-93c0-094f22b39652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:10.053187 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c26b67cc-541f-4b09-93c0-094f22b39652 None None] MFA Rules not processed for user `fd66b47f86264f24b68283accebb7bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:10.055647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c26b67cc-541f-4b09-93c0-094f22b39652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:10.153799 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1167/2341] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:10.158700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc9e6d-dd10-4bbd-8003-e1131c2ed68b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:10.188619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:10.257213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc9e6d-dd10-4bbd-8003-e1131c2ed68b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:10.268068 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08780e2f-3df7-43a3-9ba9-1e6d5f04eb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:10.269284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08780e2f-3df7-43a3-9ba9-1e6d5f04eb50 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:10.269800 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08780e2f-3df7-43a3-9ba9-1e6d5f04eb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:10.270319 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08780e2f-3df7-43a3-9ba9-1e6d5f04eb50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:10.271405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08780e2f-3df7-43a3-9ba9-1e6d5f04eb50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:10.276854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08780e2f-3df7-43a3-9ba9-1e6d5f04eb50 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:10.335307 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1175/2342] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:10 2022] POST /identity/v3/projects => generated 393 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:10.341106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b67cc-541f-4b09-93c0-094f22b39652 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:10.357570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b67cc-541f-4b09-93c0-094f22b39652 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:10.382825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:10.476385 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f431a-5fb6-40a8-a6c6-2675036516b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:10.477031 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f431a-5fb6-40a8-a6c6-2675036516b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:10.477306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f431a-5fb6-40a8-a6c6-2675036516b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:10.477574 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f431a-5fb6-40a8-a6c6-2675036516b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:10.478270 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f431a-5fb6-40a8-a6c6-2675036516b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:10.480300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f431a-5fb6-40a8-a6c6-2675036516b1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:10.525726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1168/2343] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:10 2022] POST /identity/v3/users => generated 303 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:10.533005 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08780e2f-3df7-43a3-9ba9-1e6d5f04eb50 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:10.550266 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08780e2f-3df7-43a3-9ba9-1e6d5f04eb50 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:10.562211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8d264-057e-4a7a-b7b2-9af45896196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:10.564546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8d264-057e-4a7a-b7b2-9af45896196f admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:10.565938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8d264-057e-4a7a-b7b2-9af45896196f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:10.566605 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8d264-057e-4a7a-b7b2-9af45896196f admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:10.568849 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8d264-057e-4a7a-b7b2-9af45896196f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:10.575550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8d264-057e-4a7a-b7b2-9af45896196f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:10.609740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1176/2344] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:09:10.611154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f431a-5fb6-40a8-a6c6-2675036516b1 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:10.629520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f431a-5fb6-40a8-a6c6-2675036516b1 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:10.648824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12314e9e-f906-4437-9060-6bbac2cfc20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:10.649536 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12314e9e-f906-4437-9060-6bbac2cfc20b admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:10.650596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12314e9e-f906-4437-9060-6bbac2cfc20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:10.651042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12314e9e-f906-4437-9060-6bbac2cfc20b admin admin] PATH_INFO: `/v3/projects/c875411d73e746a0984e777e2b997e8c/users/0748006f945346a19a7018ea47b7f450/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:10.679581 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12314e9e-f906-4437-9060-6bbac2cfc20b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c875411d73e746a0984e777e2b997e8c, user_id=0748006f945346a19a7018ea47b7f450, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:10.684696 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12314e9e-f906-4437-9060-6bbac2cfc20b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:10.709441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1169/2345] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:10 2022] PUT /identity/v3/projects/c875411d73e746a0984e777e2b997e8c/users/0748006f945346a19a7018ea47b7f450/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:10.710374 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8d264-057e-4a7a-b7b2-9af45896196f admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:10.725928 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8d264-057e-4a7a-b7b2-9af45896196f admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:10.853149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b18920-c009-473c-ab04-1ea8de5cd133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:10.853884 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b18920-c009-473c-ab04-1ea8de5cd133 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:10.854118 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b18920-c009-473c-ab04-1ea8de5cd133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:10.854359 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b18920-c009-473c-ab04-1ea8de5cd133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:10.854936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b18920-c009-473c-ab04-1ea8de5cd133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:10.856796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b18920-c009-473c-ab04-1ea8de5cd133 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:10.894888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1177/2346] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:09:10.903670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12314e9e-f906-4437-9060-6bbac2cfc20b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:10.917607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12314e9e-f906-4437-9060-6bbac2cfc20b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:10.929775 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c3bf8-a885-43ec-8c61-5445ec917982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:10.930467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c3bf8-a885-43ec-8c61-5445ec917982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:10.931319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c3bf8-a885-43ec-8c61-5445ec917982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:10.931319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c3bf8-a885-43ec-8c61-5445ec917982 admin admin] PATH_INFO: `/v3/projects/c875411d73e746a0984e777e2b997e8c/users/0748006f945346a19a7018ea47b7f450/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:10.936891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c3bf8-a885-43ec-8c61-5445ec917982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c875411d73e746a0984e777e2b997e8c, user_id=0748006f945346a19a7018ea47b7f450, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:10.939567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c3bf8-a885-43ec-8c61-5445ec917982 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:10.955945 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1170/2347] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:10 2022] PUT /identity/v3/projects/c875411d73e746a0984e777e2b997e8c/users/0748006f945346a19a7018ea47b7f450/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:10.964349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943458bf-500b-4a5d-b9f2-8a2cf7cdc507 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:10.964534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943458bf-500b-4a5d-b9f2-8a2cf7cdc507 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:10.964813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943458bf-500b-4a5d-b9f2-8a2cf7cdc507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:10.997495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-943458bf-500b-4a5d-b9f2-8a2cf7cdc507 None None] MFA Rules not processed for user `0748006f945346a19a7018ea47b7f450`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:10.998949 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-943458bf-500b-4a5d-b9f2-8a2cf7cdc507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:11.173739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1178/2348] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:11.185290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c3bf8-a885-43ec-8c61-5445ec917982 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:11.189494 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8e2c3bf8-a885-43ec-8c61-5445ec917982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:11.307140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c3bf8-a885-43ec-8c61-5445ec917982 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:11.313378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb5479-70a2-45d5-8664-70ac72ab1da3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:11.314193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb5479-70a2-45d5-8664-70ac72ab1da3 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:11.314473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb5479-70a2-45d5-8664-70ac72ab1da3 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:11.314730 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb5479-70a2-45d5-8664-70ac72ab1da3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:11.401223 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb5479-70a2-45d5-8664-70ac72ab1da3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:11.404313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb5479-70a2-45d5-8664-70ac72ab1da3 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:11.440788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1171/2349] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:09:13.080597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943458bf-500b-4a5d-b9f2-8a2cf7cdc507 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:13.082223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-943458bf-500b-4a5d-b9f2-8a2cf7cdc507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:13.111446 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:13.191410 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943458bf-500b-4a5d-b9f2-8a2cf7cdc507 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:13.197808 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c71fa0-4516-44b3-b210-0ee8eb34af3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:13.198902 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c71fa0-4516-44b3-b210-0ee8eb34af3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:13.199290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c71fa0-4516-44b3-b210-0ee8eb34af3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:13.199667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c71fa0-4516-44b3-b210-0ee8eb34af3b admin admin] PATH_INFO: `/v3/users/0fe233fed2594af6bb20003b608fd10f` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:13.201181 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c71fa0-4516-44b3-b210-0ee8eb34af3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe233fed2594af6bb20003b608fd10f)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:13.203620 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c71fa0-4516-44b3-b210-0ee8eb34af3b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:13.277299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-44c71fa0-4516-44b3-b210-0ee8eb34af3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe233fed2594af6bb20003b608fd10f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:13.291192 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-44c71fa0-4516-44b3-b210-0ee8eb34af3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe233fed2594af6bb20003b608fd10f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:13.315830 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-44c71fa0-4516-44b3-b210-0ee8eb34af3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe233fed2594af6bb20003b608fd10f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:13.317224 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-44c71fa0-4516-44b3-b210-0ee8eb34af3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe233fed2594af6bb20003b608fd10f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:13.318942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-44c71fa0-4516-44b3-b210-0ee8eb34af3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe233fed2594af6bb20003b608fd10f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:13.339764 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1179/2350] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:13 2022] DELETE /identity/v3/users/0fe233fed2594af6bb20003b608fd10f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:13.345607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e74b8-32ac-4704-8cf9-6495dda5abaf None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:13.348100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e74b8-32ac-4704-8cf9-6495dda5abaf None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:13.348726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e74b8-32ac-4704-8cf9-6495dda5abaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:13.380432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:13.396851 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-648e74b8-32ac-4704-8cf9-6495dda5abaf None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:13.400060 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-648e74b8-32ac-4704-8cf9-6495dda5abaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:13.533148 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1172/2351] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:13.590662 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c71fa0-4516-44b3-b210-0ee8eb34af3b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:13.593420 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-44c71fa0-4516-44b3-b210-0ee8eb34af3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:13.680572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c71fa0-4516-44b3-b210-0ee8eb34af3b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:13.685875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b4014-6c0d-400b-ae64-994cb07ed333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:13.687099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4014-6c0d-400b-ae64-994cb07ed333 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:13.687385 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4014-6c0d-400b-ae64-994cb07ed333 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:13.687658 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4014-6c0d-400b-ae64-994cb07ed333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:13.701046 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b4014-6c0d-400b-ae64-994cb07ed333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:13.704367 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b4014-6c0d-400b-ae64-994cb07ed333 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:13.723308 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1180/2352] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:14.984395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e74b8-32ac-4704-8cf9-6495dda5abaf None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:14.986557 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-648e74b8-32ac-4704-8cf9-6495dda5abaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:15.000137 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e74b8-32ac-4704-8cf9-6495dda5abaf None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:15.005701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1693da-b7bc-412c-ae8d-21c59fddde08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:15.006920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1693da-b7bc-412c-ae8d-21c59fddde08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:15.007485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1693da-b7bc-412c-ae8d-21c59fddde08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:15.007990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1693da-b7bc-412c-ae8d-21c59fddde08 admin admin] PATH_INFO: `/v3/projects/d04eea9bcf8f4dfd99c9603f17973abe` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:15.009455 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1693da-b7bc-412c-ae8d-21c59fddde08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04eea9bcf8f4dfd99c9603f17973abe)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:15.011634 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1693da-b7bc-412c-ae8d-21c59fddde08 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:15.109913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1e1693da-b7bc-412c-ae8d-21c59fddde08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04eea9bcf8f4dfd99c9603f17973abe', 'request_id': 'req-1e1693da-b7bc-412c-ae8d-21c59fddde08'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:15.117013 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1e1693da-b7bc-412c-ae8d-21c59fddde08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04eea9bcf8f4dfd99c9603f17973abe', 'request_id': 'req-1e1693da-b7bc-412c-ae8d-21c59fddde08'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:15.155217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1e1693da-b7bc-412c-ae8d-21c59fddde08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04eea9bcf8f4dfd99c9603f17973abe', 'request_id': 'req-1e1693da-b7bc-412c-ae8d-21c59fddde08'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:15.198727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1e1693da-b7bc-412c-ae8d-21c59fddde08 admin admin] The token cache is being invalidate because project d04eea9bcf8f4dfd99c9603f17973abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:15.199025 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1e1693da-b7bc-412c-ae8d-21c59fddde08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:15.199709 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-1e1693da-b7bc-412c-ae8d-21c59fddde08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:15.206837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1173/2353] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:14 2022] DELETE /identity/v3/projects/d04eea9bcf8f4dfd99c9603f17973abe => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:15.207145 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0f82d-025e-4d4f-bb8b-137e9d57f561 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:15.207649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0f82d-025e-4d4f-bb8b-137e9d57f561 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:15.207736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0f82d-025e-4d4f-bb8b-137e9d57f561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:15.237360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5ac0f82d-025e-4d4f-bb8b-137e9d57f561 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:15.238613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5ac0f82d-025e-4d4f-bb8b-137e9d57f561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:15.284820 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:15.328467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1181/2354] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:15.332920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb581a-8400-49f7-be08-cc30470e6d65 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:15.334372 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb581a-8400-49f7-be08-cc30470e6d65 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:15.335409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb581a-8400-49f7-be08-cc30470e6d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:15.367002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3beb581a-8400-49f7-be08-cc30470e6d65 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:15.369328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3beb581a-8400-49f7-be08-cc30470e6d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:15.386009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0f82d-025e-4d4f-bb8b-137e9d57f561 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:15.386967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1174/2355] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:15.397094 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0f82d-025e-4d4f-bb8b-137e9d57f561 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:15.402567 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221f5bc-3f9c-4536-949d-677a1d4ffba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:15.403193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221f5bc-3f9c-4536-949d-677a1d4ffba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:15.403471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221f5bc-3f9c-4536-949d-677a1d4ffba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:15.403744 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221f5bc-3f9c-4536-949d-677a1d4ffba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:15.404460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221f5bc-3f9c-4536-949d-677a1d4ffba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:15.404764 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221f5bc-3f9c-4536-949d-677a1d4ffba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:15.407088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221f5bc-3f9c-4536-949d-677a1d4ffba8 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:15.423626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1182/2356] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:15.424760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb581a-8400-49f7-be08-cc30470e6d65 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:15.436979 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb581a-8400-49f7-be08-cc30470e6d65 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:15.442590 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb979ee0-ba98-4ad7-a16a-df518fd0ac50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:15.443224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb979ee0-ba98-4ad7-a16a-df518fd0ac50 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:15.443520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb979ee0-ba98-4ad7-a16a-df518fd0ac50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:15.444871 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb979ee0-ba98-4ad7-a16a-df518fd0ac50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:15.444871 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb979ee0-ba98-4ad7-a16a-df518fd0ac50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:15.449035 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb979ee0-ba98-4ad7-a16a-df518fd0ac50 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:15.505611 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1175/2357] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:15 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:09:15.505821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221f5bc-3f9c-4536-949d-677a1d4ffba8 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:15.517999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221f5bc-3f9c-4536-949d-677a1d4ffba8 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:15.620318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b3fdc-ed35-4623-b300-2560b0f184ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:15.620953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3fdc-ed35-4623-b300-2560b0f184ed admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:15.621297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3fdc-ed35-4623-b300-2560b0f184ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:15.622082 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b3fdc-ed35-4623-b300-2560b0f184ed admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:15.622757 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b3fdc-ed35-4623-b300-2560b0f184ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:15.625024 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b3fdc-ed35-4623-b300-2560b0f184ed admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:15.665120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1183/2358] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:15 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:09:15.668987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb979ee0-ba98-4ad7-a16a-df518fd0ac50 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:15.683849 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb979ee0-ba98-4ad7-a16a-df518fd0ac50 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:15.691186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebfc2f-7e00-475b-b132-c5f94544e52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:15.692288 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebfc2f-7e00-475b-b132-c5f94544e52b admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:15.692783 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebfc2f-7e00-475b-b132-c5f94544e52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:15.693909 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebfc2f-7e00-475b-b132-c5f94544e52b admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:15.694883 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebfc2f-7e00-475b-b132-c5f94544e52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:15.696841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebfc2f-7e00-475b-b132-c5f94544e52b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:15.715129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1176/2359] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:15.715663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b3fdc-ed35-4623-b300-2560b0f184ed admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:15.726838 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b3fdc-ed35-4623-b300-2560b0f184ed admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:15.744730 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c1a99-afa2-4379-b8cf-ca697424bbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:15.745367 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c1a99-afa2-4379-b8cf-ca697424bbbc admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:15.745658 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c1a99-afa2-4379-b8cf-ca697424bbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:15.745926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c1a99-afa2-4379-b8cf-ca697424bbbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:15.746599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c1a99-afa2-4379-b8cf-ca697424bbbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:15.748295 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c1a99-afa2-4379-b8cf-ca697424bbbc admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:15.783288 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1184/2360] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:09:15.784504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebfc2f-7e00-475b-b132-c5f94544e52b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:15.808301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebfc2f-7e00-475b-b132-c5f94544e52b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:15.820670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16136b68-bc7a-45ed-bd46-52da10dd12ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:15.821366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16136b68-bc7a-45ed-bd46-52da10dd12ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:15.822164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16136b68-bc7a-45ed-bd46-52da10dd12ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:15.822917 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16136b68-bc7a-45ed-bd46-52da10dd12ef admin admin] PATH_INFO: `/v3/projects/2aa3830a62fb4d02a0d9113c6e86eb88/users/27d26b8100a94631bd73e77c55765764/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:15.848848 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16136b68-bc7a-45ed-bd46-52da10dd12ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa3830a62fb4d02a0d9113c6e86eb88, user_id=27d26b8100a94631bd73e77c55765764, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:15.852561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16136b68-bc7a-45ed-bd46-52da10dd12ef admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:15.873795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1177/2361] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:15 2022] PUT /identity/v3/projects/2aa3830a62fb4d02a0d9113c6e86eb88/users/27d26b8100a94631bd73e77c55765764/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:15.887782 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835e7b1-0f62-404b-b8de-b238585ffa0e None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:15.888140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835e7b1-0f62-404b-b8de-b238585ffa0e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:15.888381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835e7b1-0f62-404b-b8de-b238585ffa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:15.938868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-0835e7b1-0f62-404b-b8de-b238585ffa0e None None] MFA Rules not processed for user `27d26b8100a94631bd73e77c55765764`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:15.940674 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-0835e7b1-0f62-404b-b8de-b238585ffa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:16.136459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1185/2362] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:16.184542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16136b68-bc7a-45ed-bd46-52da10dd12ef admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:16.186297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-16136b68-bc7a-45ed-bd46-52da10dd12ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:16.266708 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:16.330426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16136b68-bc7a-45ed-bd46-52da10dd12ef admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:16.338491 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93372d-de47-466b-85d2-376a43f76c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:16.339132 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93372d-de47-466b-85d2-376a43f76c07 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:16.339413 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93372d-de47-466b-85d2-376a43f76c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:16.339681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93372d-de47-466b-85d2-376a43f76c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:16.366214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93372d-de47-466b-85d2-376a43f76c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:16.367938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93372d-de47-466b-85d2-376a43f76c07 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:16.385613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1178/2363] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:16.419212 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835e7b1-0f62-404b-b8de-b238585ffa0e None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:16.506642 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:16.565925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835e7b1-0f62-404b-b8de-b238585ffa0e None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:16.575205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e1d63-078c-4db9-851a-5d781d509956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:16.577582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e1d63-078c-4db9-851a-5d781d509956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:16.577864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e1d63-078c-4db9-851a-5d781d509956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:16.578960 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e1d63-078c-4db9-851a-5d781d509956 admin admin] PATH_INFO: `/v3/users/27d26b8100a94631bd73e77c55765764` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:16.583739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e1d63-078c-4db9-851a-5d781d509956 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d26b8100a94631bd73e77c55765764)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:16.590264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e1d63-078c-4db9-851a-5d781d509956 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:16.702685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6a5e1d63-078c-4db9-851a-5d781d509956 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d26b8100a94631bd73e77c55765764'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:16.715105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6a5e1d63-078c-4db9-851a-5d781d509956 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d26b8100a94631bd73e77c55765764'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:16.746581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6a5e1d63-078c-4db9-851a-5d781d509956 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d26b8100a94631bd73e77c55765764'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:16.747647 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6a5e1d63-078c-4db9-851a-5d781d509956 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d26b8100a94631bd73e77c55765764'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:16.748302 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6a5e1d63-078c-4db9-851a-5d781d509956 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d26b8100a94631bd73e77c55765764'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:16.784650 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1186/2364] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:16 2022] DELETE /identity/v3/users/27d26b8100a94631bd73e77c55765764 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:16.786111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664191f-1f34-4d16-94d7-1033d09333d5 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:16.786739 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664191f-1f34-4d16-94d7-1033d09333d5 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:16.786927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664191f-1f34-4d16-94d7-1033d09333d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:16.828315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9664191f-1f34-4d16-94d7-1033d09333d5 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:16.835020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9664191f-1f34-4d16-94d7-1033d09333d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:16.979556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1179/2365] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:17.011125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e1d63-078c-4db9-851a-5d781d509956 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:17.012711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-6a5e1d63-078c-4db9-851a-5d781d509956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:17.128033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e1d63-078c-4db9-851a-5d781d509956 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:17.138960 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ec445-20da-476f-93b8-2d3ba25d1bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:17.140261 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ec445-20da-476f-93b8-2d3ba25d1bfa service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:17.140695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ec445-20da-476f-93b8-2d3ba25d1bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:17.141119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ec445-20da-476f-93b8-2d3ba25d1bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:17.183797 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ec445-20da-476f-93b8-2d3ba25d1bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:17.185589 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ec445-20da-476f-93b8-2d3ba25d1bfa service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:17.205309 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1187/2366] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:18.733062 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664191f-1f34-4d16-94d7-1033d09333d5 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:18.734661 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9664191f-1f34-4d16-94d7-1033d09333d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:18.747936 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664191f-1f34-4d16-94d7-1033d09333d5 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:18.767395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9516483-f3ad-4ca4-ab87-7c5560d45e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:18.769189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9516483-f3ad-4ca4-ab87-7c5560d45e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:18.769682 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9516483-f3ad-4ca4-ab87-7c5560d45e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:18.770387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9516483-f3ad-4ca4-ab87-7c5560d45e94 admin admin] PATH_INFO: `/v3/projects/2aa3830a62fb4d02a0d9113c6e86eb88` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:18.771997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9516483-f3ad-4ca4-ab87-7c5560d45e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa3830a62fb4d02a0d9113c6e86eb88)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:18.788119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9516483-f3ad-4ca4-ab87-7c5560d45e94 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:18.893609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9516483-f3ad-4ca4-ab87-7c5560d45e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa3830a62fb4d02a0d9113c6e86eb88', 'request_id': 'req-c9516483-f3ad-4ca4-ab87-7c5560d45e94'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:18.905075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9516483-f3ad-4ca4-ab87-7c5560d45e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa3830a62fb4d02a0d9113c6e86eb88', 'request_id': 'req-c9516483-f3ad-4ca4-ab87-7c5560d45e94'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:18.918244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9516483-f3ad-4ca4-ab87-7c5560d45e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa3830a62fb4d02a0d9113c6e86eb88', 'request_id': 'req-c9516483-f3ad-4ca4-ab87-7c5560d45e94'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:18.943592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9516483-f3ad-4ca4-ab87-7c5560d45e94 admin admin] The token cache is being invalidate because project 2aa3830a62fb4d02a0d9113c6e86eb88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:18.943592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9516483-f3ad-4ca4-ab87-7c5560d45e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:18.944194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9516483-f3ad-4ca4-ab87-7c5560d45e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:18.947254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1180/2367] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:18 2022] DELETE /identity/v3/projects/2aa3830a62fb4d02a0d9113c6e86eb88 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:18.952757 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ef7c-cefc-41ed-a0c6-3bdc76efde99 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:18.953315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ef7c-cefc-41ed-a0c6-3bdc76efde99 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:18.954545 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ef7c-cefc-41ed-a0c6-3bdc76efde99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:18.982811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-a951ef7c-cefc-41ed-a0c6-3bdc76efde99 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:18.985336 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a951ef7c-cefc-41ed-a0c6-3bdc76efde99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:19.068895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:19.086267 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1188/2368] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:19.094242 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3e49-ac2c-427f-bfeb-8ffb159b4f94 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:19.094537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3e49-ac2c-427f-bfeb-8ffb159b4f94 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:19.094862 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a3e49-ac2c-427f-bfeb-8ffb159b4f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:19.129763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-fa0a3e49-ac2c-427f-bfeb-8ffb159b4f94 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:19.130944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-fa0a3e49-ac2c-427f-bfeb-8ffb159b4f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:19.150153 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1181/2369] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:19.151517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ef7c-cefc-41ed-a0c6-3bdc76efde99 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:19.161778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ef7c-cefc-41ed-a0c6-3bdc76efde99 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:19.167896 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d24fc-60d2-4db2-900b-da6cf4f3be50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:19.168737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d24fc-60d2-4db2-900b-da6cf4f3be50 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:19.169021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d24fc-60d2-4db2-900b-da6cf4f3be50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:19.169295 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d24fc-60d2-4db2-900b-da6cf4f3be50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:19.169969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d24fc-60d2-4db2-900b-da6cf4f3be50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:19.170274 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d24fc-60d2-4db2-900b-da6cf4f3be50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:19.172110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d24fc-60d2-4db2-900b-da6cf4f3be50 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:19.197515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1189/2370] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:19.201843 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3e49-ac2c-427f-bfeb-8ffb159b4f94 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:19.213135 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a3e49-ac2c-427f-bfeb-8ffb159b4f94 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:19.218483 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbac1c9-bb98-476d-82a2-111d8e219b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:19.219460 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbac1c9-bb98-476d-82a2-111d8e219b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:19.220051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbac1c9-bb98-476d-82a2-111d8e219b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:19.220580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbac1c9-bb98-476d-82a2-111d8e219b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:19.221709 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbac1c9-bb98-476d-82a2-111d8e219b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:19.223884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbac1c9-bb98-476d-82a2-111d8e219b07 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:19.283695 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1182/2371] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:19 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:19.288235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d24fc-60d2-4db2-900b-da6cf4f3be50 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:19.301788 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d24fc-60d2-4db2-900b-da6cf4f3be50 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:19.446474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa7fdb-8811-46ab-9ea4-c8260ca85e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:19.448635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa7fdb-8811-46ab-9ea4-c8260ca85e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:19.456105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa7fdb-8811-46ab-9ea4-c8260ca85e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:19.456513 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa7fdb-8811-46ab-9ea4-c8260ca85e7b admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:19.457360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa7fdb-8811-46ab-9ea4-c8260ca85e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:19.459679 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa7fdb-8811-46ab-9ea4-c8260ca85e7b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:19.508450 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1190/2372] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:19 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:19.517076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbac1c9-bb98-476d-82a2-111d8e219b07 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:19.533230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbac1c9-bb98-476d-82a2-111d8e219b07 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:19.539004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b68c47-7603-459e-becc-3b11499dba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:19.539617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b68c47-7603-459e-becc-3b11499dba92 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:19.540429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b68c47-7603-459e-becc-3b11499dba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:19.540870 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b68c47-7603-459e-becc-3b11499dba92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:19.541565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b68c47-7603-459e-becc-3b11499dba92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:19.543779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b68c47-7603-459e-becc-3b11499dba92 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:19.556372 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1183/2373] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:19.560376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa7fdb-8811-46ab-9ea4-c8260ca85e7b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:19.577405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa7fdb-8811-46ab-9ea4-c8260ca85e7b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:19.589895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771a0a3-b8eb-433e-81d5-e647ae7b2635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:19.590535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771a0a3-b8eb-433e-81d5-e647ae7b2635 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:19.590820 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771a0a3-b8eb-433e-81d5-e647ae7b2635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:19.591141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771a0a3-b8eb-433e-81d5-e647ae7b2635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:19.592114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771a0a3-b8eb-433e-81d5-e647ae7b2635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:19.593712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771a0a3-b8eb-433e-81d5-e647ae7b2635 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:19.621913 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1191/2374] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:19.627089 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b68c47-7603-459e-becc-3b11499dba92 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:19.652236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b68c47-7603-459e-becc-3b11499dba92 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:19.661643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3c64c-7ca4-4fce-a8b7-795b802fd7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:19.664397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3c64c-7ca4-4fce-a8b7-795b802fd7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:19.665243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3c64c-7ca4-4fce-a8b7-795b802fd7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:19.665991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3c64c-7ca4-4fce-a8b7-795b802fd7a1 admin admin] PATH_INFO: `/v3/projects/56c054ea85384ababbd7a271cba9b87c/users/c30148c955ca4b79864da62e70820af0/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:19.701257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:19.714033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3c64c-7ca4-4fce-a8b7-795b802fd7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c054ea85384ababbd7a271cba9b87c, user_id=c30148c955ca4b79864da62e70820af0, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:19.717294 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3c64c-7ca4-4fce-a8b7-795b802fd7a1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:19.743251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1184/2375] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:19 2022] PUT /identity/v3/projects/56c054ea85384ababbd7a271cba9b87c/users/c30148c955ca4b79864da62e70820af0/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:19.748815 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6553f2-ad46-4a38-8427-091de4f6adb4 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:19.749300 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6553f2-ad46-4a38-8427-091de4f6adb4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:19.749633 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6553f2-ad46-4a38-8427-091de4f6adb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:19.782876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-1c6553f2-ad46-4a38-8427-091de4f6adb4 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:19.784605 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1c6553f2-ad46-4a38-8427-091de4f6adb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:19.922277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1192/2376] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:19.984693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3c64c-7ca4-4fce-a8b7-795b802fd7a1 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:19.986611 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d7b3c64c-7ca4-4fce-a8b7-795b802fd7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.105552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3c64c-7ca4-4fce-a8b7-795b802fd7a1 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:20.114009 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ff0da-46d7-4aab-8c46-f520d10dc7de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:20.115018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ff0da-46d7-4aab-8c46-f520d10dc7de service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.115689 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ff0da-46d7-4aab-8c46-f520d10dc7de service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.116572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ff0da-46d7-4aab-8c46-f520d10dc7de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.133913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ff0da-46d7-4aab-8c46-f520d10dc7de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:20.135938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ff0da-46d7-4aab-8c46-f520d10dc7de service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:20.148741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1185/2377] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:21.054174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6553f2-ad46-4a38-8427-091de4f6adb4 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.056836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1c6553f2-ad46-4a38-8427-091de4f6adb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:21.089451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6553f2-ad46-4a38-8427-091de4f6adb4 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.142805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e3294-7491-4696-baef-9b909997ee8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.147117 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e3294-7491-4696-baef-9b909997ee8f service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.151484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e3294-7491-4696-baef-9b909997ee8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.152301 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e3294-7491-4696-baef-9b909997ee8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.188995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c07e3294-7491-4696-baef-9b909997ee8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:21.452841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:21.456520 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e3294-7491-4696-baef-9b909997ee8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.461791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e3294-7491-4696-baef-9b909997ee8f service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.480476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1193/2378] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:26.889333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ff0da-46d7-4aab-8c46-f520d10dc7de service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:26.891562 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-018ff0da-46d7-4aab-8c46-f520d10dc7de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:26.919038 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ff0da-46d7-4aab-8c46-f520d10dc7de service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:26.932602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cf319-6d29-4cd6-a774-06f8ed36083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:26.933262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cf319-6d29-4cd6-a774-06f8ed36083f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:26.933543 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cf319-6d29-4cd6-a774-06f8ed36083f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:26.933818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cf319-6d29-4cd6-a774-06f8ed36083f admin admin] PATH_INFO: `/v3/users/5ad51a8ce90e4a478c2d54b9974d3d86` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:26.936322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cf319-6d29-4cd6-a774-06f8ed36083f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ad51a8ce90e4a478c2d54b9974d3d86)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:26.938252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cf319-6d29-4cd6-a774-06f8ed36083f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:27.080530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4a2cf319-6d29-4cd6-a774-06f8ed36083f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ad51a8ce90e4a478c2d54b9974d3d86'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:27.106306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4a2cf319-6d29-4cd6-a774-06f8ed36083f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ad51a8ce90e4a478c2d54b9974d3d86'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:27.142105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4a2cf319-6d29-4cd6-a774-06f8ed36083f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ad51a8ce90e4a478c2d54b9974d3d86'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:27.154044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4a2cf319-6d29-4cd6-a774-06f8ed36083f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ad51a8ce90e4a478c2d54b9974d3d86'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:27.154809 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-4a2cf319-6d29-4cd6-a774-06f8ed36083f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ad51a8ce90e4a478c2d54b9974d3d86'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:27.168081 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1186/2379] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:26 2022] DELETE /identity/v3/users/5ad51a8ce90e4a478c2d54b9974d3d86 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:27.172899 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540c8d8-366d-4867-b61e-1c8fd30c10fb None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:27.173507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540c8d8-366d-4867-b61e-1c8fd30c10fb None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:27.173507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540c8d8-366d-4867-b61e-1c8fd30c10fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:27.222611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5540c8d8-366d-4867-b61e-1c8fd30c10fb None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:27.225867 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5540c8d8-366d-4867-b61e-1c8fd30c10fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:27.378138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1194/2380] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:27.398728 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cf319-6d29-4cd6-a774-06f8ed36083f admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:27.400340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4a2cf319-6d29-4cd6-a774-06f8ed36083f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:27.514929 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cf319-6d29-4cd6-a774-06f8ed36083f admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:27.520580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874c41b-7167-4746-aebb-f8830af0254e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:27.521507 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874c41b-7167-4746-aebb-f8830af0254e service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:27.522775 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874c41b-7167-4746-aebb-f8830af0254e service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:27.523298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874c41b-7167-4746-aebb-f8830af0254e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:27.556631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874c41b-7167-4746-aebb-f8830af0254e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:27.559189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874c41b-7167-4746-aebb-f8830af0254e service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:27.580700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1187/2381] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:28.313172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540c8d8-366d-4867-b61e-1c8fd30c10fb None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:28.314649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5540c8d8-366d-4867-b61e-1c8fd30c10fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:28.342412 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540c8d8-366d-4867-b61e-1c8fd30c10fb None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:28.362951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbc8a8-ed76-4ecb-be95-10661352c162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:28.363614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbc8a8-ed76-4ecb-be95-10661352c162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:28.363894 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbc8a8-ed76-4ecb-be95-10661352c162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:28.364192 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbc8a8-ed76-4ecb-be95-10661352c162 admin admin] PATH_INFO: `/v3/projects/e879c484e95d4f618d2acef92c745f08` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:28.370099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbc8a8-ed76-4ecb-be95-10661352c162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e879c484e95d4f618d2acef92c745f08)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:28.372132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbc8a8-ed76-4ecb-be95-10661352c162 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:28.523846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-74bbc8a8-ed76-4ecb-be95-10661352c162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e879c484e95d4f618d2acef92c745f08', 'request_id': 'req-74bbc8a8-ed76-4ecb-be95-10661352c162'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:28.538020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-74bbc8a8-ed76-4ecb-be95-10661352c162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e879c484e95d4f618d2acef92c745f08', 'request_id': 'req-74bbc8a8-ed76-4ecb-be95-10661352c162'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:28.556936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-74bbc8a8-ed76-4ecb-be95-10661352c162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e879c484e95d4f618d2acef92c745f08', 'request_id': 'req-74bbc8a8-ed76-4ecb-be95-10661352c162'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:28.606705 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-74bbc8a8-ed76-4ecb-be95-10661352c162 admin admin] The token cache is being invalidate because project e879c484e95d4f618d2acef92c745f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:28.607006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-74bbc8a8-ed76-4ecb-be95-10661352c162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:28.607867 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-74bbc8a8-ed76-4ecb-be95-10661352c162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:28.612828 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1195/2382] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:28 2022] DELETE /identity/v3/projects/e879c484e95d4f618d2acef92c745f08 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:28.618492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bd1e5-85cc-44c9-a847-90810091f182 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:28.619079 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bd1e5-85cc-44c9-a847-90810091f182 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:28.619079 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bd1e5-85cc-44c9-a847-90810091f182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:28.640509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:28.657723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-023bd1e5-85cc-44c9-a847-90810091f182 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:28.658955 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-023bd1e5-85cc-44c9-a847-90810091f182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:28.823793 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1188/2383] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:28.833987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062362-11f4-45d9-91c1-e18a0b2e8a02 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:28.834277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062362-11f4-45d9-91c1-e18a0b2e8a02 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:28.834556 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062362-11f4-45d9-91c1-e18a0b2e8a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:28.873180 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-de062362-11f4-45d9-91c1-e18a0b2e8a02 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:28.876509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-de062362-11f4-45d9-91c1-e18a0b2e8a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:28.889141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1196/2384] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:28.893215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bd1e5-85cc-44c9-a847-90810091f182 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:28.903710 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bd1e5-85cc-44c9-a847-90810091f182 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:28.919462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b33e6-5c0f-4025-a500-6d34a6aa96e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:28.922616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b33e6-5c0f-4025-a500-6d34a6aa96e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:28.923038 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b33e6-5c0f-4025-a500-6d34a6aa96e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:28.923385 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b33e6-5c0f-4025-a500-6d34a6aa96e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:28.925212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b33e6-5c0f-4025-a500-6d34a6aa96e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:28.925212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b33e6-5c0f-4025-a500-6d34a6aa96e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:28.927517 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b33e6-5c0f-4025-a500-6d34a6aa96e1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:28.962170 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1189/2385] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:28.966271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062362-11f4-45d9-91c1-e18a0b2e8a02 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:28.983842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062362-11f4-45d9-91c1-e18a0b2e8a02 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:28.989839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707372e-d523-444a-9105-2da6cc2c873a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:28.990673 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707372e-d523-444a-9105-2da6cc2c873a admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:28.991450 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707372e-d523-444a-9105-2da6cc2c873a admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:28.991958 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707372e-d523-444a-9105-2da6cc2c873a admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:28.992905 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707372e-d523-444a-9105-2da6cc2c873a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:28.995830 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707372e-d523-444a-9105-2da6cc2c873a admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:29.053352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1197/2386] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:28 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:29.054637 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b33e6-5c0f-4025-a500-6d34a6aa96e1 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:29.078972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b33e6-5c0f-4025-a500-6d34a6aa96e1 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:29.234074 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8e228-7f69-4820-ba85-b0f285acae54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:29.234934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8e228-7f69-4820-ba85-b0f285acae54 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.235227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8e228-7f69-4820-ba85-b0f285acae54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.235504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8e228-7f69-4820-ba85-b0f285acae54 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.238678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8e228-7f69-4820-ba85-b0f285acae54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:29.241949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8e228-7f69-4820-ba85-b0f285acae54 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:29.310293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1190/2387] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:29 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:29.312314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707372e-d523-444a-9105-2da6cc2c873a admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:29.331637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707372e-d523-444a-9105-2da6cc2c873a admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:29.344841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ccc98-2124-484a-b970-c2b686798718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:29.348690 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ccc98-2124-484a-b970-c2b686798718 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.350131 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ccc98-2124-484a-b970-c2b686798718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.357243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ccc98-2124-484a-b970-c2b686798718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.359608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ccc98-2124-484a-b970-c2b686798718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:29.371814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ccc98-2124-484a-b970-c2b686798718 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:29.408440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1198/2388] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:29.412957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8e228-7f69-4820-ba85-b0f285acae54 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:29.428029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8e228-7f69-4820-ba85-b0f285acae54 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:29.450518 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aaca1b-c948-4cc7-a120-0e3f9855eba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:29.451149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aaca1b-c948-4cc7-a120-0e3f9855eba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.451430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aaca1b-c948-4cc7-a120-0e3f9855eba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.451701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aaca1b-c948-4cc7-a120-0e3f9855eba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.452385 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aaca1b-c948-4cc7-a120-0e3f9855eba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:29.454008 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aaca1b-c948-4cc7-a120-0e3f9855eba9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:29.481880 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1191/2389] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:09:29.486925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ccc98-2124-484a-b970-c2b686798718 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:29.503759 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ccc98-2124-484a-b970-c2b686798718 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:29.523480 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f6223-aba4-4a43-b928-84854838342b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:29.524245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f6223-aba4-4a43-b928-84854838342b admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.524531 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f6223-aba4-4a43-b928-84854838342b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.524799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f6223-aba4-4a43-b928-84854838342b admin admin] PATH_INFO: `/v3/projects/4079bbc02c5e4f258818846a7684367a/users/50b146584e5644d69c001fcb3cd06ca9/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.557684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f6223-aba4-4a43-b928-84854838342b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4079bbc02c5e4f258818846a7684367a, user_id=50b146584e5644d69c001fcb3cd06ca9, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:29.561334 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f6223-aba4-4a43-b928-84854838342b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:29.584276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1199/2390] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:29 2022] PUT /identity/v3/projects/4079bbc02c5e4f258818846a7684367a/users/50b146584e5644d69c001fcb3cd06ca9/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:29.595655 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742d8c5-6748-4720-9e93-e11fd3094df2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.596301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742d8c5-6748-4720-9e93-e11fd3094df2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.596714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742d8c5-6748-4720-9e93-e11fd3094df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.657206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1742d8c5-6748-4720-9e93-e11fd3094df2 None None] MFA Rules not processed for user `50b146584e5644d69c001fcb3cd06ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:29.658623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1742d8c5-6748-4720-9e93-e11fd3094df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:29.840403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1192/2391] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:29.985465 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f6223-aba4-4a43-b928-84854838342b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:29.987866 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-df7f6223-aba4-4a43-b928-84854838342b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:30.035471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:30.138828 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f6223-aba4-4a43-b928-84854838342b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:30.143190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297eba69-a7bf-4b39-8bc7-d103492ec306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:30.143847 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eba69-a7bf-4b39-8bc7-d103492ec306 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:30.144294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eba69-a7bf-4b39-8bc7-d103492ec306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:30.144663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eba69-a7bf-4b39-8bc7-d103492ec306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:30.160557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297eba69-a7bf-4b39-8bc7-d103492ec306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:30.162572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297eba69-a7bf-4b39-8bc7-d103492ec306 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:30.175611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1200/2392] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:31.273314 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742d8c5-6748-4720-9e93-e11fd3094df2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:31.275314 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1742d8c5-6748-4720-9e93-e11fd3094df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.281746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:31.413863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742d8c5-6748-4720-9e93-e11fd3094df2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:31.430020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf5ac4-8731-4e84-a3ae-c426652ef9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:31.431237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf5ac4-8731-4e84-a3ae-c426652ef9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:31.431522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf5ac4-8731-4e84-a3ae-c426652ef9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:31.431795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf5ac4-8731-4e84-a3ae-c426652ef9fe admin admin] PATH_INFO: `/v3/users/dc8c1cf1e1e241bd9d9505ce3fde7211` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:31.434406 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf5ac4-8731-4e84-a3ae-c426652ef9fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8c1cf1e1e241bd9d9505ce3fde7211)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:31.437296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf5ac4-8731-4e84-a3ae-c426652ef9fe admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:31.542258 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-decf5ac4-8731-4e84-a3ae-c426652ef9fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8c1cf1e1e241bd9d9505ce3fde7211'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.552579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-decf5ac4-8731-4e84-a3ae-c426652ef9fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8c1cf1e1e241bd9d9505ce3fde7211'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.577082 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-decf5ac4-8731-4e84-a3ae-c426652ef9fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8c1cf1e1e241bd9d9505ce3fde7211'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.605653 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-decf5ac4-8731-4e84-a3ae-c426652ef9fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8c1cf1e1e241bd9d9505ce3fde7211'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.606550 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-decf5ac4-8731-4e84-a3ae-c426652ef9fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8c1cf1e1e241bd9d9505ce3fde7211'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.620814 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1193/2393] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:31 2022] DELETE /identity/v3/users/dc8c1cf1e1e241bd9d9505ce3fde7211 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:31.623138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e22ce3-3c63-471a-952b-d96584e91123 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:31.623630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e22ce3-3c63-471a-952b-d96584e91123 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:31.623729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e22ce3-3c63-471a-952b-d96584e91123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:31.669351 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c4e22ce3-3c63-471a-952b-d96584e91123 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:31.670620 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c4e22ce3-3c63-471a-952b-d96584e91123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.818942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1201/2394] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:31.842035 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf5ac4-8731-4e84-a3ae-c426652ef9fe admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:31.844066 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-decf5ac4-8731-4e84-a3ae-c426652ef9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.995261 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf5ac4-8731-4e84-a3ae-c426652ef9fe admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:31.999406 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d49630-2e4b-48dd-8ad2-0b7d7486afbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:32.000399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d49630-2e4b-48dd-8ad2-0b7d7486afbe service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.002652 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d49630-2e4b-48dd-8ad2-0b7d7486afbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.003190 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d49630-2e4b-48dd-8ad2-0b7d7486afbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.027219 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d49630-2e4b-48dd-8ad2-0b7d7486afbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:32.029133 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d49630-2e4b-48dd-8ad2-0b7d7486afbe service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:32.056862 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1194/2395] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:32.340470 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fa37-2f15-4a30-8cee-0944b9bbd31f None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.341077 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fa37-2f15-4a30-8cee-0944b9bbd31f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.341532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fa37-2f15-4a30-8cee-0944b9bbd31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.385266 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-f1d5fa37-2f15-4a30-8cee-0944b9bbd31f None None] MFA Rules not processed for user `fd66b47f86264f24b68283accebb7bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:32.388510 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f1d5fa37-2f15-4a30-8cee-0944b9bbd31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.522255 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1202/2396] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:32.608473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d49630-2e4b-48dd-8ad2-0b7d7486afbe service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:32.611062 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-40d49630-2e4b-48dd-8ad2-0b7d7486afbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.678411 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:32.742524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d49630-2e4b-48dd-8ad2-0b7d7486afbe service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:32.750701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad7a3c-1124-4a10-a461-0efaec80a561 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345c25e7dd2341bcb4c53d0a5aa36b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:32.751338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad7a3c-1124-4a10-a461-0efaec80a561 service glance] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.751616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad7a3c-1124-4a10-a461-0efaec80a561 service glance] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.751884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad7a3c-1124-4a10-a461-0efaec80a561 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.759623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-61ad7a3c-1124-4a10-a461-0efaec80a561 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.984123 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad7a3c-1124-4a10-a461-0efaec80a561 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:32.985606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad7a3c-1124-4a10-a461-0efaec80a561 service glance] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:33.000807 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1195/2397] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:33.610297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5fa37-2f15-4a30-8cee-0944b9bbd31f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:33.612161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f1d5fa37-2f15-4a30-8cee-0944b9bbd31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:33.634714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5fa37-2f15-4a30-8cee-0944b9bbd31f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:33.651598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccb939-1e60-4962-b948-c833a30aac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:33.652472 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccb939-1e60-4962-b948-c833a30aac85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.652737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccb939-1e60-4962-b948-c833a30aac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.654108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccb939-1e60-4962-b948-c833a30aac85 admin admin] PATH_INFO: `/v3/projects/ac19f63a387c48c890842d83234e274e` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.655582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccb939-1e60-4962-b948-c833a30aac85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac19f63a387c48c890842d83234e274e)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:33.659126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccb939-1e60-4962-b948-c833a30aac85 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:33.765805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b0ccb939-1e60-4962-b948-c833a30aac85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac19f63a387c48c890842d83234e274e', 'request_id': 'req-b0ccb939-1e60-4962-b948-c833a30aac85'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:33.779237 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b0ccb939-1e60-4962-b948-c833a30aac85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac19f63a387c48c890842d83234e274e', 'request_id': 'req-b0ccb939-1e60-4962-b948-c833a30aac85'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:33.786778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:33.797448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b0ccb939-1e60-4962-b948-c833a30aac85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac19f63a387c48c890842d83234e274e', 'request_id': 'req-b0ccb939-1e60-4962-b948-c833a30aac85'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:33.843836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b0ccb939-1e60-4962-b948-c833a30aac85 admin admin] The token cache is being invalidate because project ac19f63a387c48c890842d83234e274e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:33.846821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b0ccb939-1e60-4962-b948-c833a30aac85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:33.849164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b0ccb939-1e60-4962-b948-c833a30aac85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:33.859448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1203/2398] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:33 2022] DELETE /identity/v3/projects/ac19f63a387c48c890842d83234e274e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:33.861724 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad7a3c-1124-4a10-a461-0efaec80a561 service glance] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:33.882909 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad7a3c-1124-4a10-a461-0efaec80a561 service glance] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.032231 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e63836-d86e-46dd-a0cd-43f01846b82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.033261 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63836-d86e-46dd-a0cd-43f01846b82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.033735 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63836-d86e-46dd-a0cd-43f01846b82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.034066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c278117-0129-41c9-a729-da861ead3b15 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.034404 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63836-d86e-46dd-a0cd-43f01846b82b admin admin] PATH_INFO: `/v3/users/06bf8acaaacb4ae193e141980353cc8e` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.034534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c278117-0129-41c9-a729-da861ead3b15 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.034756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c278117-0129-41c9-a729-da861ead3b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.041629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e63836-d86e-46dd-a0cd-43f01846b82b admin admin] RBAC: Authorizing `identity:delete_user(user_id=06bf8acaaacb4ae193e141980353cc8e)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.043970 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e63836-d86e-46dd-a0cd-43f01846b82b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.075984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-7c278117-0129-41c9-a729-da861ead3b15 None None] MFA Rules not processed for user `e393d9c50bbb4f69a48ae635d13b1197`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:34.081453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7c278117-0129-41c9-a729-da861ead3b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:34.142931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a1e63836-d86e-46dd-a0cd-43f01846b82b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06bf8acaaacb4ae193e141980353cc8e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:34.159713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a1e63836-d86e-46dd-a0cd-43f01846b82b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06bf8acaaacb4ae193e141980353cc8e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:34.182598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:34.186977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a1e63836-d86e-46dd-a0cd-43f01846b82b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06bf8acaaacb4ae193e141980353cc8e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:34.218506 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a1e63836-d86e-46dd-a0cd-43f01846b82b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06bf8acaaacb4ae193e141980353cc8e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:34.219430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a1e63836-d86e-46dd-a0cd-43f01846b82b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06bf8acaaacb4ae193e141980353cc8e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:34.230191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1196/2399] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:33 2022] DELETE /identity/v3/users/06bf8acaaacb4ae193e141980353cc8e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:34.273351 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1204/2400] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 01:09:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:34.301714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e63836-d86e-46dd-a0cd-43f01846b82b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.303436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a1e63836-d86e-46dd-a0cd-43f01846b82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:34.378703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e63836-d86e-46dd-a0cd-43f01846b82b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.386816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264928b5-237b-4e3b-8aeb-31d98731c582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.387453 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264928b5-237b-4e3b-8aeb-31d98731c582 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.387731 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264928b5-237b-4e3b-8aeb-31d98731c582 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.388037 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264928b5-237b-4e3b-8aeb-31d98731c582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.396794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264928b5-237b-4e3b-8aeb-31d98731c582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.398258 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264928b5-237b-4e3b-8aeb-31d98731c582 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.408703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1197/2401] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:34.862705 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c935203-b5f6-4734-a502-7a7e8f4d65f9 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.863316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c935203-b5f6-4734-a502-7a7e8f4d65f9 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.863316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c935203-b5f6-4734-a502-7a7e8f4d65f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.918344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5c935203-b5f6-4734-a502-7a7e8f4d65f9 None None] MFA Rules not processed for user `c30148c955ca4b79864da62e70820af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:34.920367 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5c935203-b5f6-4734-a502-7a7e8f4d65f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:35.044663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1205/2402] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:35.052303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264928b5-237b-4e3b-8aeb-31d98731c582 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:35.056300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-264928b5-237b-4e3b-8aeb-31d98731c582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:35.181189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264928b5-237b-4e3b-8aeb-31d98731c582 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:35.188305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a65c30-fe40-4292-9977-ea8d48488907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.189030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a65c30-fe40-4292-9977-ea8d48488907 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.189319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a65c30-fe40-4292-9977-ea8d48488907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.189698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a65c30-fe40-4292-9977-ea8d48488907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.190549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a65c30-fe40-4292-9977-ea8d48488907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:35.193562 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a65c30-fe40-4292-9977-ea8d48488907 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:35.269124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c935203-b5f6-4734-a502-7a7e8f4d65f9 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:35.270311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1198/2403] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:35 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:35.289091 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c935203-b5f6-4734-a502-7a7e8f4d65f9 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:35.398349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57c5f6-d5a0-4551-b1a6-c6fe2d255455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.399891 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57c5f6-d5a0-4551-b1a6-c6fe2d255455 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.400727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57c5f6-d5a0-4551-b1a6-c6fe2d255455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.402675 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57c5f6-d5a0-4551-b1a6-c6fe2d255455 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.403870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57c5f6-d5a0-4551-b1a6-c6fe2d255455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:35.409431 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57c5f6-d5a0-4551-b1a6-c6fe2d255455 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:35.452992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1206/2404] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:35 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:35.456935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a65c30-fe40-4292-9977-ea8d48488907 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:35.472907 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a65c30-fe40-4292-9977-ea8d48488907 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:35.480971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c07a3f-dede-4212-b294-e6215e6852d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.482173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c07a3f-dede-4212-b294-e6215e6852d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.483016 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c07a3f-dede-4212-b294-e6215e6852d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.483560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c07a3f-dede-4212-b294-e6215e6852d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.485869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c07a3f-dede-4212-b294-e6215e6852d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:35.488530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c07a3f-dede-4212-b294-e6215e6852d5 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:35.510850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1199/2405] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:35.514626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57c5f6-d5a0-4551-b1a6-c6fe2d255455 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:35.534606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57c5f6-d5a0-4551-b1a6-c6fe2d255455 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:35.550476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76294a-3aa5-4a7e-90a7-85433054d24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.550741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76294a-3aa5-4a7e-90a7-85433054d24a admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.550980 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76294a-3aa5-4a7e-90a7-85433054d24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.551610 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76294a-3aa5-4a7e-90a7-85433054d24a admin admin] PATH_INFO: `/v3/projects/9784350979e848e2874c8ba459cecd05/users/e5a63398ba0749d58fb6b8426f775bda/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.579477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:35.583326 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76294a-3aa5-4a7e-90a7-85433054d24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9784350979e848e2874c8ba459cecd05, user_id=e5a63398ba0749d58fb6b8426f775bda, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:35.586083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76294a-3aa5-4a7e-90a7-85433054d24a admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:35.604756 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1207/2406] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:35 2022] PUT /identity/v3/projects/9784350979e848e2874c8ba459cecd05/users/e5a63398ba0749d58fb6b8426f775bda/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:09:35.608634 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c07a3f-dede-4212-b294-e6215e6852d5 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:35.661821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c07a3f-dede-4212-b294-e6215e6852d5 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:35.794891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12754953-230a-427f-bc19-5cc0d15b8065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.809924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12754953-230a-427f-bc19-5cc0d15b8065 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.812815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12754953-230a-427f-bc19-5cc0d15b8065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.812815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12754953-230a-427f-bc19-5cc0d15b8065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.822713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12754953-230a-427f-bc19-5cc0d15b8065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:35.829301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12754953-230a-427f-bc19-5cc0d15b8065 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:35.834497 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:35.865199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1200/2407] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:35.865389 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76294a-3aa5-4a7e-90a7-85433054d24a admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:35.887063 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76294a-3aa5-4a7e-90a7-85433054d24a admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:35.910665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d258a31-b9b0-4e6f-90b3-0e3725db8c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.911415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d258a31-b9b0-4e6f-90b3-0e3725db8c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.916635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d258a31-b9b0-4e6f-90b3-0e3725db8c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.916949 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d258a31-b9b0-4e6f-90b3-0e3725db8c9e admin admin] PATH_INFO: `/v3/projects/9784350979e848e2874c8ba459cecd05/users/e5a63398ba0749d58fb6b8426f775bda/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.921576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d258a31-b9b0-4e6f-90b3-0e3725db8c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9784350979e848e2874c8ba459cecd05, user_id=e5a63398ba0749d58fb6b8426f775bda, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:35.924718 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d258a31-b9b0-4e6f-90b3-0e3725db8c9e admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:35.985122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1208/2408] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:35 2022] PUT /identity/v3/projects/9784350979e848e2874c8ba459cecd05/users/e5a63398ba0749d58fb6b8426f775bda/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:36.052516 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12754953-230a-427f-bc19-5cc0d15b8065 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:36.056721 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-12754953-230a-427f-bc19-5cc0d15b8065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:36.083497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d258a31-b9b0-4e6f-90b3-0e3725db8c9e admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:36.085605 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3d258a31-b9b0-4e6f-90b3-0e3725db8c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:36.217490 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12754953-230a-427f-bc19-5cc0d15b8065 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:36.253390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d258a31-b9b0-4e6f-90b3-0e3725db8c9e admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:36.260591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31be53f-2b35-4a6b-82b0-d5a072f06d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:36.261453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31be53f-2b35-4a6b-82b0-d5a072f06d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.262226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31be53f-2b35-4a6b-82b0-d5a072f06d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.262582 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31be53f-2b35-4a6b-82b0-d5a072f06d61 admin admin] PATH_INFO: `/v3/projects/684d73dbf6a5482cbb5916c23a1b7171` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.264504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31be53f-2b35-4a6b-82b0-d5a072f06d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=684d73dbf6a5482cbb5916c23a1b7171)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:36.267749 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31be53f-2b35-4a6b-82b0-d5a072f06d61 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:36.323068 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc85d7a-8afe-4c76-9014-2580115f434c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:36.323998 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85d7a-8afe-4c76-9014-2580115f434c service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.324425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85d7a-8afe-4c76-9014-2580115f434c service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.324827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85d7a-8afe-4c76-9014-2580115f434c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.326904 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5fc85d7a-8afe-4c76-9014-2580115f434c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:36.351007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc85d7a-8afe-4c76-9014-2580115f434c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:36.357490 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc85d7a-8afe-4c76-9014-2580115f434c service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:36.370479 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c31be53f-2b35-4a6b-82b0-d5a072f06d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '684d73dbf6a5482cbb5916c23a1b7171', 'request_id': 'req-c31be53f-2b35-4a6b-82b0-d5a072f06d61'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:36.395352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1201/2409] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:36.396939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c31be53f-2b35-4a6b-82b0-d5a072f06d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '684d73dbf6a5482cbb5916c23a1b7171', 'request_id': 'req-c31be53f-2b35-4a6b-82b0-d5a072f06d61'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:36.397093 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc85d7a-8afe-4c76-9014-2580115f434c service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:36.408342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c31be53f-2b35-4a6b-82b0-d5a072f06d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '684d73dbf6a5482cbb5916c23a1b7171', 'request_id': 'req-c31be53f-2b35-4a6b-82b0-d5a072f06d61'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:36.430542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c31be53f-2b35-4a6b-82b0-d5a072f06d61 admin admin] The token cache is being invalidate because project 684d73dbf6a5482cbb5916c23a1b7171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:36.430981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c31be53f-2b35-4a6b-82b0-d5a072f06d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:36.438478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-c31be53f-2b35-4a6b-82b0-d5a072f06d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:36.440221 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1209/2410] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:36 2022] DELETE /identity/v3/projects/684d73dbf6a5482cbb5916c23a1b7171 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:36.445050 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad2502-633f-4a3c-bd32-fc130cb54910 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.445337 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad2502-633f-4a3c-bd32-fc130cb54910 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.446193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad2502-633f-4a3c-bd32-fc130cb54910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.487606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-55ad2502-633f-4a3c-bd32-fc130cb54910 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:36.489014 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-55ad2502-633f-4a3c-bd32-fc130cb54910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:36.521647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc85d7a-8afe-4c76-9014-2580115f434c service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:36.633620 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1210/2411] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:36.635042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9aae4-3764-4e95-98c5-3f680f0f3dea None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.635341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9aae4-3764-4e95-98c5-3f680f0f3dea None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.635605 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9aae4-3764-4e95-98c5-3f680f0f3dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.660902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:36.674330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2869915-0e83-4a3b-8525-c3463ebd5dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:36.677463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2869915-0e83-4a3b-8525-c3463ebd5dbf service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.677901 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2869915-0e83-4a3b-8525-c3463ebd5dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.678865 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2869915-0e83-4a3b-8525-c3463ebd5dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.682422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-dbb9aae4-3764-4e95-98c5-3f680f0f3dea None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:36.683795 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-dbb9aae4-3764-4e95-98c5-3f680f0f3dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:36.696347 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f2869915-0e83-4a3b-8525-c3463ebd5dbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:36.709563 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1211/2412] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:36.710481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9aae4-3764-4e95-98c5-3f680f0f3dea None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:36.715847 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:36.734119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9aae4-3764-4e95-98c5-3f680f0f3dea None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:36.750081 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472f0c5-37b5-4dc5-8155-1f01a8579bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:36.750722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472f0c5-37b5-4dc5-8155-1f01a8579bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.751004 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472f0c5-37b5-4dc5-8155-1f01a8579bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.751533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472f0c5-37b5-4dc5-8155-1f01a8579bfc admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.752617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472f0c5-37b5-4dc5-8155-1f01a8579bfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:36.752967 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472f0c5-37b5-4dc5-8155-1f01a8579bfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:36.754702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472f0c5-37b5-4dc5-8155-1f01a8579bfc admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:36.786467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1212/2413] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:36.791533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472f0c5-37b5-4dc5-8155-1f01a8579bfc admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:36.814510 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472f0c5-37b5-4dc5-8155-1f01a8579bfc admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:36.831705 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a28fc-f0a1-4d98-8d63-7b93213d7e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:36.832385 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a28fc-f0a1-4d98-8d63-7b93213d7e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.832706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a28fc-f0a1-4d98-8d63-7b93213d7e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.832983 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a28fc-f0a1-4d98-8d63-7b93213d7e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.833744 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a28fc-f0a1-4d98-8d63-7b93213d7e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:36.835964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a28fc-f0a1-4d98-8d63-7b93213d7e5e admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:36.879149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2869915-0e83-4a3b-8525-c3463ebd5dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:36.880867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2869915-0e83-4a3b-8525-c3463ebd5dbf service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:36.908315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1213/2414] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:36 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:36.909818 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a28fc-f0a1-4d98-8d63-7b93213d7e5e admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:36.910349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1202/2415] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:37.045928 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a28fc-f0a1-4d98-8d63-7b93213d7e5e admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:37.066929 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552d61d-94f5-4e07-b12d-6ed61508faa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:37.068450 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d61d-94f5-4e07-b12d-6ed61508faa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:37.069000 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d61d-94f5-4e07-b12d-6ed61508faa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:37.069625 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d61d-94f5-4e07-b12d-6ed61508faa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:37.070421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552d61d-94f5-4e07-b12d-6ed61508faa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:37.075814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552d61d-94f5-4e07-b12d-6ed61508faa5 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:37.133637 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1214/2416] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:36 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:37.138351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2869915-0e83-4a3b-8525-c3463ebd5dbf service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:37.156086 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2869915-0e83-4a3b-8525-c3463ebd5dbf service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:37.165047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74a6b0-3e39-4816-b3e8-2612abd39c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:37.166286 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74a6b0-3e39-4816-b3e8-2612abd39c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:37.166721 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74a6b0-3e39-4816-b3e8-2612abd39c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:37.167338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74a6b0-3e39-4816-b3e8-2612abd39c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:37.168343 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74a6b0-3e39-4816-b3e8-2612abd39c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:37.171408 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74a6b0-3e39-4816-b3e8-2612abd39c13 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:37.192941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1203/2417] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:37.195482 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552d61d-94f5-4e07-b12d-6ed61508faa5 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:37.216564 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552d61d-94f5-4e07-b12d-6ed61508faa5 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:37.225899 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604212d5-13fa-42a3-b4c5-0515398e7c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:37.229696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604212d5-13fa-42a3-b4c5-0515398e7c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:37.230279 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604212d5-13fa-42a3-b4c5-0515398e7c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:37.230709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604212d5-13fa-42a3-b4c5-0515398e7c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:37.232106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604212d5-13fa-42a3-b4c5-0515398e7c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:37.238750 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604212d5-13fa-42a3-b4c5-0515398e7c27 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:37.253522 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1215/2418] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:37.258778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74a6b0-3e39-4816-b3e8-2612abd39c13 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:37.273114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74a6b0-3e39-4816-b3e8-2612abd39c13 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:37.281252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff294e-e0f4-4dfe-96c3-f7de37ca9c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:37.282228 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff294e-e0f4-4dfe-96c3-f7de37ca9c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:37.282868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff294e-e0f4-4dfe-96c3-f7de37ca9c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:37.283413 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff294e-e0f4-4dfe-96c3-f7de37ca9c32 admin admin] PATH_INFO: `/v3/projects/caf5924cf20c4d8eb540d4fd1b9e2390/users/97b31a636ac54a2dbc06ec4600a67281/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:37.312358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff294e-e0f4-4dfe-96c3-f7de37ca9c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf5924cf20c4d8eb540d4fd1b9e2390, user_id=97b31a636ac54a2dbc06ec4600a67281, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:37.315938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff294e-e0f4-4dfe-96c3-f7de37ca9c32 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:37.346798 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1204/2419] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:37 2022] PUT /identity/v3/projects/caf5924cf20c4d8eb540d4fd1b9e2390/users/97b31a636ac54a2dbc06ec4600a67281/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:37.359099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc9045-e51c-47c8-b23d-bf219004c8cd None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:37.359389 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc9045-e51c-47c8-b23d-bf219004c8cd None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:37.359666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc9045-e51c-47c8-b23d-bf219004c8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:37.417508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-33bc9045-e51c-47c8-b23d-bf219004c8cd None None] MFA Rules not processed for user `97b31a636ac54a2dbc06ec4600a67281`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:37.419022 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-33bc9045-e51c-47c8-b23d-bf219004c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:37.593246 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1216/2420] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:37.623255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff294e-e0f4-4dfe-96c3-f7de37ca9c32 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:37.626984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a3ff294e-e0f4-4dfe-96c3-f7de37ca9c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:37.786991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff294e-e0f4-4dfe-96c3-f7de37ca9c32 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:37.800639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d68363-9d1f-4521-87e2-38dfb4dbf750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:37.801714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d68363-9d1f-4521-87e2-38dfb4dbf750 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:37.802004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d68363-9d1f-4521-87e2-38dfb4dbf750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:37.802348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d68363-9d1f-4521-87e2-38dfb4dbf750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:37.827419 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d68363-9d1f-4521-87e2-38dfb4dbf750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:37.828905 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d68363-9d1f-4521-87e2-38dfb4dbf750 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:37.852831 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1205/2421] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:41.789921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc9045-e51c-47c8-b23d-bf219004c8cd None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:41.797199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-33bc9045-e51c-47c8-b23d-bf219004c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:41.829229 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc9045-e51c-47c8-b23d-bf219004c8cd None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:41.846278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748918e0-6772-49e1-90b1-1b2fac6f4d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:41.850559 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748918e0-6772-49e1-90b1-1b2fac6f4d02 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:41.851033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748918e0-6772-49e1-90b1-1b2fac6f4d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:41.851518 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748918e0-6772-49e1-90b1-1b2fac6f4d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:41.857900 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-748918e0-6772-49e1-90b1-1b2fac6f4d02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:41.891360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748918e0-6772-49e1-90b1-1b2fac6f4d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:41.893084 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748918e0-6772-49e1-90b1-1b2fac6f4d02 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:41.904808 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1217/2422] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:45.150588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d68363-9d1f-4521-87e2-38dfb4dbf750 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:45.158018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-85d68363-9d1f-4521-87e2-38dfb4dbf750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:45.336920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:45.380816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d68363-9d1f-4521-87e2-38dfb4dbf750 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:45.395332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c48793-b663-4b5b-949f-bf127a7b06ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:45.396000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c48793-b663-4b5b-949f-bf127a7b06ab service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:45.396290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c48793-b663-4b5b-949f-bf127a7b06ab service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:45.396562 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c48793-b663-4b5b-949f-bf127a7b06ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:45.400788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-86c48793-b663-4b5b-949f-bf127a7b06ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:45.432082 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c48793-b663-4b5b-949f-bf127a7b06ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:45.433391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c48793-b663-4b5b-949f-bf127a7b06ab service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:45.461012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1206/2423] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:50.531297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e206227-c493-43d2-a88d-bc16556ba52c None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:50.532269 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e206227-c493-43d2-a88d-bc16556ba52c None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:50.532621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e206227-c493-43d2-a88d-bc16556ba52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:50.601021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-2e206227-c493-43d2-a88d-bc16556ba52c None None] MFA Rules not processed for user `e5a63398ba0749d58fb6b8426f775bda`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:50.602779 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2e206227-c493-43d2-a88d-bc16556ba52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:50.626600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:50.772717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1218/2424] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:50.780043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c48793-b663-4b5b-949f-bf127a7b06ab service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:50.799189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c48793-b663-4b5b-949f-bf127a7b06ab service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:50.812662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0999ff9-ea74-4e42-97eb-7d02b58c6792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:50.813269 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0999ff9-ea74-4e42-97eb-7d02b58c6792 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:50.813555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0999ff9-ea74-4e42-97eb-7d02b58c6792 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:50.813843 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0999ff9-ea74-4e42-97eb-7d02b58c6792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:50.819512 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b0999ff9-ea74-4e42-97eb-7d02b58c6792 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:51.020995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0999ff9-ea74-4e42-97eb-7d02b58c6792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:51.026146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0999ff9-ea74-4e42-97eb-7d02b58c6792 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:51.040545 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1207/2425] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:51.727299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e206227-c493-43d2-a88d-bc16556ba52c None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:51.745855 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2e206227-c493-43d2-a88d-bc16556ba52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:51.764805 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0999ff9-ea74-4e42-97eb-7d02b58c6792 service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:51.765598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b0999ff9-ea74-4e42-97eb-7d02b58c6792 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:51.931160 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0999ff9-ea74-4e42-97eb-7d02b58c6792 service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:51.942684 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48650f6c-a8fe-43f5-ad14-b9112d200654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:51.944047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48650f6c-a8fe-43f5-ad14-b9112d200654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:51.945573 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48650f6c-a8fe-43f5-ad14-b9112d200654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:51.948007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48650f6c-a8fe-43f5-ad14-b9112d200654 admin admin] PATH_INFO: `/v3/users/50b146584e5644d69c001fcb3cd06ca9` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:51.951605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48650f6c-a8fe-43f5-ad14-b9112d200654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50b146584e5644d69c001fcb3cd06ca9)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:51.958041 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48650f6c-a8fe-43f5-ad14-b9112d200654 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:52.064806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e206227-c493-43d2-a88d-bc16556ba52c None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:52.069013 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-48650f6c-a8fe-43f5-ad14-b9112d200654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50b146584e5644d69c001fcb3cd06ca9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:52.086111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f69ee-1ae7-4b23-bbfe-d1216f91cf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:52.086885 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f69ee-1ae7-4b23-bbfe-d1216f91cf46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:52.088317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f69ee-1ae7-4b23-bbfe-d1216f91cf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:52.088643 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f69ee-1ae7-4b23-bbfe-d1216f91cf46 admin admin] PATH_INFO: `/v3/users/d88d3916d21c42f4a82317b320002d18` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:52.089643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-48650f6c-a8fe-43f5-ad14-b9112d200654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50b146584e5644d69c001fcb3cd06ca9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:52.095565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f69ee-1ae7-4b23-bbfe-d1216f91cf46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d88d3916d21c42f4a82317b320002d18)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:52.097837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f69ee-1ae7-4b23-bbfe-d1216f91cf46 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:52.125250 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-48650f6c-a8fe-43f5-ad14-b9112d200654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50b146584e5644d69c001fcb3cd06ca9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:52.144313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-48650f6c-a8fe-43f5-ad14-b9112d200654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50b146584e5644d69c001fcb3cd06ca9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:52.148102 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-48650f6c-a8fe-43f5-ad14-b9112d200654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50b146584e5644d69c001fcb3cd06ca9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:52.153549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:52.161869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1208/2426] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:51 2022] DELETE /identity/v3/users/50b146584e5644d69c001fcb3cd06ca9 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:52.169942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3cd53-611e-477e-9cf6-222ec024a36c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:52.170586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3cd53-611e-477e-9cf6-222ec024a36c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:52.171097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3cd53-611e-477e-9cf6-222ec024a36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:52.205155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-080f69ee-1ae7-4b23-bbfe-d1216f91cf46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd88d3916d21c42f4a82317b320002d18'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:52.221250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-080f69ee-1ae7-4b23-bbfe-d1216f91cf46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd88d3916d21c42f4a82317b320002d18'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:52.228465 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d7c3cd53-611e-477e-9cf6-222ec024a36c None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:52.230274 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d7c3cd53-611e-477e-9cf6-222ec024a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:52.249747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-080f69ee-1ae7-4b23-bbfe-d1216f91cf46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd88d3916d21c42f4a82317b320002d18'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:52.264646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-080f69ee-1ae7-4b23-bbfe-d1216f91cf46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd88d3916d21c42f4a82317b320002d18'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:52.269503 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-080f69ee-1ae7-4b23-bbfe-d1216f91cf46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd88d3916d21c42f4a82317b320002d18'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:52.309924 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1219/2427] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:51 2022] DELETE /identity/v3/users/d88d3916d21c42f4a82317b320002d18 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:52.315041 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7797e-6840-44ae-a268-ab64f1651dd7 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:52.315504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7797e-6840-44ae-a268-ab64f1651dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:52.316876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7797e-6840-44ae-a268-ab64f1651dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:52.389394 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-1fd7797e-6840-44ae-a268-ab64f1651dd7 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:52.397302 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1fd7797e-6840-44ae-a268-ab64f1651dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:52.440992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1209/2428] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:52.440992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3cd53-611e-477e-9cf6-222ec024a36c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:52.443892 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d7c3cd53-611e-477e-9cf6-222ec024a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:52.474370 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:52.598037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1220/2429] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:52.600541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7797e-6840-44ae-a268-ab64f1651dd7 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:52.604242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1fd7797e-6840-44ae-a268-ab64f1651dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:52.645041 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3cd53-611e-477e-9cf6-222ec024a36c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:52.757310 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7797e-6840-44ae-a268-ab64f1651dd7 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:52.767256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edc23f-ce4f-4006-a3f4-9bfdb33b2d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:52.767949 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edc23f-ce4f-4006-a3f4-9bfdb33b2d0d service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:52.768307 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edc23f-ce4f-4006-a3f4-9bfdb33b2d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:52.768471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edc23f-ce4f-4006-a3f4-9bfdb33b2d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:52.789324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edc23f-ce4f-4006-a3f4-9bfdb33b2d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:52.790760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edc23f-ce4f-4006-a3f4-9bfdb33b2d0d service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:52.816882 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1221/2430] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:52.817768 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edc23f-ce4f-4006-a3f4-9bfdb33b2d0d service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:52.829861 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990d38c-aa10-48df-a73f-560c31e244d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:52.830803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d38c-aa10-48df-a73f-560c31e244d0 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:52.831248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d38c-aa10-48df-a73f-560c31e244d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:52.831691 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d38c-aa10-48df-a73f-560c31e244d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:52.837569 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edc23f-ce4f-4006-a3f4-9bfdb33b2d0d service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:52.839953 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4990d38c-aa10-48df-a73f-560c31e244d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:52.847567 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018d244-1462-403b-b5e8-007587a18be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:52.849226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d244-1462-403b-b5e8-007587a18be9 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:52.849935 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d244-1462-403b-b5e8-007587a18be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:52.850437 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d244-1462-403b-b5e8-007587a18be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:52.864724 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990d38c-aa10-48df-a73f-560c31e244d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:52.866375 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990d38c-aa10-48df-a73f-560c31e244d0 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:52.873437 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018d244-1462-403b-b5e8-007587a18be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:52.875785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018d244-1462-403b-b5e8-007587a18be9 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:52.895333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1210/2431] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:52.934042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1222/2432] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:53.868172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990d38c-aa10-48df-a73f-560c31e244d0 service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:53.869222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4990d38c-aa10-48df-a73f-560c31e244d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:53.887286 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990d38c-aa10-48df-a73f-560c31e244d0 service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:53.894774 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0ecb3-2540-4ec6-aa2f-189564cc2564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:53.896633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0ecb3-2540-4ec6-aa2f-189564cc2564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:53.897112 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0ecb3-2540-4ec6-aa2f-189564cc2564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:53.897673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0ecb3-2540-4ec6-aa2f-189564cc2564 admin admin] PATH_INFO: `/v3/projects/4079bbc02c5e4f258818846a7684367a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:53.900899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0ecb3-2540-4ec6-aa2f-189564cc2564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4079bbc02c5e4f258818846a7684367a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:53.904619 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0ecb3-2540-4ec6-aa2f-189564cc2564 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:53.926277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:53.937893 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018d244-1462-403b-b5e8-007587a18be9 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:53.941400 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e018d244-1462-403b-b5e8-007587a18be9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:53.977853 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7dd0ecb3-2540-4ec6-aa2f-189564cc2564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4079bbc02c5e4f258818846a7684367a', 'request_id': 'req-7dd0ecb3-2540-4ec6-aa2f-189564cc2564'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:53.983376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7dd0ecb3-2540-4ec6-aa2f-189564cc2564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4079bbc02c5e4f258818846a7684367a', 'request_id': 'req-7dd0ecb3-2540-4ec6-aa2f-189564cc2564'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:53.993846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018d244-1462-403b-b5e8-007587a18be9 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:54.003889 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7dd0ecb3-2540-4ec6-aa2f-189564cc2564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4079bbc02c5e4f258818846a7684367a', 'request_id': 'req-7dd0ecb3-2540-4ec6-aa2f-189564cc2564'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:54.029329 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7dd0ecb3-2540-4ec6-aa2f-189564cc2564 admin admin] The token cache is being invalidate because project 4079bbc02c5e4f258818846a7684367a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:54.031158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7dd0ecb3-2540-4ec6-aa2f-189564cc2564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:54.032914 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7dd0ecb3-2540-4ec6-aa2f-189564cc2564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:54.038162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1211/2433] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:53 2022] DELETE /identity/v3/projects/4079bbc02c5e4f258818846a7684367a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:54.043468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e165ea1-5be1-4191-a2f4-afde3e7534a1 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.043756 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e165ea1-5be1-4191-a2f4-afde3e7534a1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.044266 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e165ea1-5be1-4191-a2f4-afde3e7534a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.077207 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2e165ea1-5be1-4191-a2f4-afde3e7534a1 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:54.080107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2e165ea1-5be1-4191-a2f4-afde3e7534a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:54.145259 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e4866-b54f-4f09-ba87-8f932a7bf9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:54.146065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e4866-b54f-4f09-ba87-8f932a7bf9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.146620 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e4866-b54f-4f09-ba87-8f932a7bf9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.147089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e4866-b54f-4f09-ba87-8f932a7bf9ca admin admin] PATH_INFO: `/v3/projects/9bc836ba456543d1988272be0047b297` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.149490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e4866-b54f-4f09-ba87-8f932a7bf9ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc836ba456543d1988272be0047b297)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:54.151809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e4866-b54f-4f09-ba87-8f932a7bf9ca admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:54.179221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1212/2434] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:54.187225 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09edff1-3e1c-4db0-9c3c-e770215e9924 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.187702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09edff1-3e1c-4db0-9c3c-e770215e9924 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.188472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09edff1-3e1c-4db0-9c3c-e770215e9924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.230793 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f09edff1-3e1c-4db0-9c3c-e770215e9924 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:54.232937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f09edff1-3e1c-4db0-9c3c-e770215e9924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:54.271401 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7f6e4866-b54f-4f09-ba87-8f932a7bf9ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc836ba456543d1988272be0047b297', 'request_id': 'req-7f6e4866-b54f-4f09-ba87-8f932a7bf9ca'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:54.311993 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7f6e4866-b54f-4f09-ba87-8f932a7bf9ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc836ba456543d1988272be0047b297', 'request_id': 'req-7f6e4866-b54f-4f09-ba87-8f932a7bf9ca'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:54.329800 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:54.341644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7f6e4866-b54f-4f09-ba87-8f932a7bf9ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc836ba456543d1988272be0047b297', 'request_id': 'req-7f6e4866-b54f-4f09-ba87-8f932a7bf9ca'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:54.343289 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1213/2435] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:54.348395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09edff1-3e1c-4db0-9c3c-e770215e9924 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:54.364608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7f6e4866-b54f-4f09-ba87-8f932a7bf9ca admin admin] The token cache is being invalidate because project 9bc836ba456543d1988272be0047b297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:54.364932 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7f6e4866-b54f-4f09-ba87-8f932a7bf9ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:54.369479 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7f6e4866-b54f-4f09-ba87-8f932a7bf9ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:54.371188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09edff1-3e1c-4db0-9c3c-e770215e9924 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:54.374288 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1223/2436] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:53 2022] DELETE /identity/v3/projects/9bc836ba456543d1988272be0047b297 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:54.385646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a572770-1246-4de3-9138-0dadfd169229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:54.386604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a572770-1246-4de3-9138-0dadfd169229 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.387074 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a572770-1246-4de3-9138-0dadfd169229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.387556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a572770-1246-4de3-9138-0dadfd169229 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.388565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a572770-1246-4de3-9138-0dadfd169229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:54.390062 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f104b25-c193-4ff8-bd5b-069a9aa097ac None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.392391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f104b25-c193-4ff8-bd5b-069a9aa097ac None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.392819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f104b25-c193-4ff8-bd5b-069a9aa097ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.404374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a572770-1246-4de3-9138-0dadfd169229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:54.407655 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a572770-1246-4de3-9138-0dadfd169229 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:54.459479 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1214/2437] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:54.464438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a572770-1246-4de3-9138-0dadfd169229 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:54.466573 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4a572770-1246-4de3-9138-0dadfd169229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:54.472850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-6f104b25-c193-4ff8-bd5b-069a9aa097ac None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:54.484964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-6f104b25-c193-4ff8-bd5b-069a9aa097ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:54.511256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1224/2438] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:54.512757 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a572770-1246-4de3-9138-0dadfd169229 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:54.518985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81000d-1344-471b-9a55-cc86627a24c5 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.519271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81000d-1344-471b-9a55-cc86627a24c5 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.519534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81000d-1344-471b-9a55-cc86627a24c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.524639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca8e51-ba75-44a8-929b-7b509e42d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:54.526091 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca8e51-ba75-44a8-929b-7b509e42d8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.526606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca8e51-ba75-44a8-929b-7b509e42d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.527086 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca8e51-ba75-44a8-929b-7b509e42d8c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.528821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca8e51-ba75-44a8-929b-7b509e42d8c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:54.533087 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca8e51-ba75-44a8-929b-7b509e42d8c4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:54.607087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-9a81000d-1344-471b-9a55-cc86627a24c5 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:54.608780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9a81000d-1344-471b-9a55-cc86627a24c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:54.623834 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1225/2439] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:54.627627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81000d-1344-471b-9a55-cc86627a24c5 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:54.633252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1215/2440] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:54 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:54.646671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca8e51-ba75-44a8-929b-7b509e42d8c4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:54.646915 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81000d-1344-471b-9a55-cc86627a24c5 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:54.667119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:54.777235 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca8e51-ba75-44a8-929b-7b509e42d8c4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:54.785049 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175625a-edfd-44e0-939f-0008fcb0174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:54.785972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175625a-edfd-44e0-939f-0008fcb0174d admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.786706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175625a-edfd-44e0-939f-0008fcb0174d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.786706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175625a-edfd-44e0-939f-0008fcb0174d admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.787556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175625a-edfd-44e0-939f-0008fcb0174d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:54.791111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175625a-edfd-44e0-939f-0008fcb0174d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:54.823946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1216/2441] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:54 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:09:54.828812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175625a-edfd-44e0-939f-0008fcb0174d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:54.858700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaa6f4-814e-4a32-a7c3-4077c9544631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:54.859934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaa6f4-814e-4a32-a7c3-4077c9544631 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.860460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaa6f4-814e-4a32-a7c3-4077c9544631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.861092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaa6f4-814e-4a32-a7c3-4077c9544631 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.863225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbaa6f4-814e-4a32-a7c3-4077c9544631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:54.863806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbaa6f4-814e-4a32-a7c3-4077c9544631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:54.864218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175625a-edfd-44e0-939f-0008fcb0174d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:54.866019 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbaa6f4-814e-4a32-a7c3-4077c9544631 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:54.878227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f58b7-452d-441a-8bb6-0f54d872fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:54.879439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f58b7-452d-441a-8bb6-0f54d872fc26 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.880528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f58b7-452d-441a-8bb6-0f54d872fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.880923 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f58b7-452d-441a-8bb6-0f54d872fc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.884818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f58b7-452d-441a-8bb6-0f54d872fc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:54.887121 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f58b7-452d-441a-8bb6-0f54d872fc26 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:54.918107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1226/2442] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:54.921297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaa6f4-814e-4a32-a7c3-4077c9544631 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:54.921472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1217/2443] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:54.922004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f58b7-452d-441a-8bb6-0f54d872fc26 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:54.947698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f58b7-452d-441a-8bb6-0f54d872fc26 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:54.951795 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaa6f4-814e-4a32-a7c3-4077c9544631 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:54.968278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe2026-4eed-4dbb-9996-900f724ecbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:54.968489 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d46e58-1f5a-4552-a41b-d7a425db2df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:54.969071 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d46e58-1f5a-4552-a41b-d7a425db2df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.969359 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d46e58-1f5a-4552-a41b-d7a425db2df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.969789 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d46e58-1f5a-4552-a41b-d7a425db2df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.970021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe2026-4eed-4dbb-9996-900f724ecbe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.970452 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d46e58-1f5a-4552-a41b-d7a425db2df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:54.970790 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe2026-4eed-4dbb-9996-900f724ecbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.971216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe2026-4eed-4dbb-9996-900f724ecbe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.972047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe2026-4eed-4dbb-9996-900f724ecbe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:54.972187 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d46e58-1f5a-4552-a41b-d7a425db2df6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:54.974276 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe2026-4eed-4dbb-9996-900f724ecbe5 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.003681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1218/2444] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:55.014819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d46e58-1f5a-4552-a41b-d7a425db2df6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.033156 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d46e58-1f5a-4552-a41b-d7a425db2df6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:55.057671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc8338-9af4-4eff-9327-24053dfab004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:55.058842 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc8338-9af4-4eff-9327-24053dfab004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.059073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc8338-9af4-4eff-9327-24053dfab004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.059415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc8338-9af4-4eff-9327-24053dfab004 admin admin] PATH_INFO: `/v3/projects/902cfe4a1a854c3aad6e64cc9fb4549f/users/53afc903595c4a07a4003f72228a8291/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.070779 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1227/2445] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:54 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:55.074893 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe2026-4eed-4dbb-9996-900f724ecbe5 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.081789 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc8338-9af4-4eff-9327-24053dfab004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=902cfe4a1a854c3aad6e64cc9fb4549f, user_id=53afc903595c4a07a4003f72228a8291, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:55.084877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc8338-9af4-4eff-9327-24053dfab004 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.128561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1219/2446] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:55 2022] PUT /identity/v3/projects/902cfe4a1a854c3aad6e64cc9fb4549f/users/53afc903595c4a07a4003f72228a8291/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:55.130549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357a1ed-e919-4243-beb3-cae3789e9958 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.130884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357a1ed-e919-4243-beb3-cae3789e9958 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.131161 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357a1ed-e919-4243-beb3-cae3789e9958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.192333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6357a1ed-e919-4243-beb3-cae3789e9958 None None] MFA Rules not processed for user `53afc903595c4a07a4003f72228a8291`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:55.193909 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6357a1ed-e919-4243-beb3-cae3789e9958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:55.329704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe2026-4eed-4dbb-9996-900f724ecbe5 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:55.412586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1220/2447] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:55.419382 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357a1ed-e919-4243-beb3-cae3789e9958 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.495872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:55.518348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaa2e6-ccc1-45a6-b9b6-88d7de768161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:55.519166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa2e6-ccc1-45a6-b9b6-88d7de768161 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.519711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa2e6-ccc1-45a6-b9b6-88d7de768161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.520264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa2e6-ccc1-45a6-b9b6-88d7de768161 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.520945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaa2e6-ccc1-45a6-b9b6-88d7de768161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:55.524137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaa2e6-ccc1-45a6-b9b6-88d7de768161 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.542179 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:55.590459 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357a1ed-e919-4243-beb3-cae3789e9958 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:55.601750 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1228/2448] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:55 2022] POST /identity/v3/users => generated 288 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:55.605954 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18025573-5ade-4363-9ace-16424d0626a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:55.606195 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaa2e6-ccc1-45a6-b9b6-88d7de768161 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.606911 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18025573-5ade-4363-9ace-16424d0626a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.606911 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18025573-5ade-4363-9ace-16424d0626a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.607250 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18025573-5ade-4363-9ace-16424d0626a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.608225 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18025573-5ade-4363-9ace-16424d0626a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:55.610603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18025573-5ade-4363-9ace-16424d0626a2 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.661952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1221/2449] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:55 2022] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:55.666282 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18025573-5ade-4363-9ace-16424d0626a2 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.666490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaa2e6-ccc1-45a6-b9b6-88d7de768161 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:55.761342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18025573-5ade-4363-9ace-16424d0626a2 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:55.767544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90bbaa-40a4-4138-ad1b-d9789b71c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:55.769331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90bbaa-40a4-4138-ad1b-d9789b71c49d admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.771559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90bbaa-40a4-4138-ad1b-d9789b71c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.772195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90bbaa-40a4-4138-ad1b-d9789b71c49d admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.773688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90bbaa-40a4-4138-ad1b-d9789b71c49d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:55.776484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90bbaa-40a4-4138-ad1b-d9789b71c49d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.786544 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3397f-be96-4275-b627-b6523c120390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:55.790963 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3397f-be96-4275-b627-b6523c120390 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.792365 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3397f-be96-4275-b627-b6523c120390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.796252 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3397f-be96-4275-b627-b6523c120390 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.797836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3397f-be96-4275-b627-b6523c120390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:55.799654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3397f-be96-4275-b627-b6523c120390 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.816411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1229/2450] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:55.816556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1222/2451] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:55 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:55.817770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3397f-be96-4275-b627-b6523c120390 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.817963 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90bbaa-40a4-4138-ad1b-d9789b71c49d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.833328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90bbaa-40a4-4138-ad1b-d9789b71c49d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:55.834114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3397f-be96-4275-b627-b6523c120390 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:55.841865 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fa587-90d4-4c75-bf32-95d4981db27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:55.842985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fa587-90d4-4c75-bf32-95d4981db27c admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.843538 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fa587-90d4-4c75-bf32-95d4981db27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.844017 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fa587-90d4-4c75-bf32-95d4981db27c admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.844774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc011c-d62c-4a0c-9328-52a31265009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:55.845167 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fa587-90d4-4c75-bf32-95d4981db27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:55.845793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc011c-d62c-4a0c-9328-52a31265009a admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.846214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc011c-d62c-4a0c-9328-52a31265009a admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.846895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc011c-d62c-4a0c-9328-52a31265009a admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.847618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fa587-90d4-4c75-bf32-95d4981db27c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.847743 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc011c-d62c-4a0c-9328-52a31265009a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:55.849799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc011c-d62c-4a0c-9328-52a31265009a admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.883483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1230/2452] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:55.883725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1223/2453] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:55.884227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc011c-d62c-4a0c-9328-52a31265009a admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.884982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fa587-90d4-4c75-bf32-95d4981db27c admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.899691 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc011c-d62c-4a0c-9328-52a31265009a admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:55.900329 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fa587-90d4-4c75-bf32-95d4981db27c admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:55.905339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9a1d-bcef-4268-a926-8b275d20b50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:55.906348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9a1d-bcef-4268-a926-8b275d20b50c admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.906708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9a1d-bcef-4268-a926-8b275d20b50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.907655 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b0aee-5962-4950-9485-70cfc0c31cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:55.907802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9a1d-bcef-4268-a926-8b275d20b50c admin admin] PATH_INFO: `/v3/projects/7652bf25dfb744898b491b8feb984d45/users/ee474d3c46a542319ed22abb25d7ecfe/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.908656 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b0aee-5962-4950-9485-70cfc0c31cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.910330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b0aee-5962-4950-9485-70cfc0c31cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.910621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b0aee-5962-4950-9485-70cfc0c31cfc admin admin] PATH_INFO: `/v3/projects/8557a42428c441308684b8f788785873/users/13dede9452a24f22b9e996f7ba4f9dc0/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.934951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9a1d-bcef-4268-a926-8b275d20b50c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7652bf25dfb744898b491b8feb984d45, user_id=ee474d3c46a542319ed22abb25d7ecfe, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:55.938858 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9a1d-bcef-4268-a926-8b275d20b50c admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.969510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b0aee-5962-4950-9485-70cfc0c31cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8557a42428c441308684b8f788785873, user_id=13dede9452a24f22b9e996f7ba4f9dc0, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:55.973638 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b0aee-5962-4950-9485-70cfc0c31cfc admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.989519 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1231/2454] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:55 2022] PUT /identity/v3/projects/7652bf25dfb744898b491b8feb984d45/users/ee474d3c46a542319ed22abb25d7ecfe/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:55.997667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9a1d-bcef-4268-a926-8b275d20b50c admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:56.017331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1224/2455] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:55 2022] PUT /identity/v3/projects/8557a42428c441308684b8f788785873/users/13dede9452a24f22b9e996f7ba4f9dc0/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:09:56.033886 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952e43a-d12d-4d2c-aa25-5a119c21cca8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:56.044327 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952e43a-d12d-4d2c-aa25-5a119c21cca8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:56.045230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952e43a-d12d-4d2c-aa25-5a119c21cca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:56.099175 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f952e43a-d12d-4d2c-aa25-5a119c21cca8 None None] MFA Rules not processed for user `13dede9452a24f22b9e996f7ba4f9dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:56.101120 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f952e43a-d12d-4d2c-aa25-5a119c21cca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:56.207260 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9a1d-bcef-4268-a926-8b275d20b50c admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:56.317133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:56.343487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d033e1-cd80-42fa-8a25-53230dc269be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:56.344579 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d033e1-cd80-42fa-8a25-53230dc269be admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:56.345069 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d033e1-cd80-42fa-8a25-53230dc269be admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:56.345631 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d033e1-cd80-42fa-8a25-53230dc269be admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:56.346680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d033e1-cd80-42fa-8a25-53230dc269be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:56.349709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d033e1-cd80-42fa-8a25-53230dc269be admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:56.374868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1225/2456] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:56.381539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1232/2457] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:56.382123 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952e43a-d12d-4d2c-aa25-5a119c21cca8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:56.399561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952e43a-d12d-4d2c-aa25-5a119c21cca8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:56.412953 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb5dff-0241-47bf-b297-1c8436ef1fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:56.413983 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb5dff-0241-47bf-b297-1c8436ef1fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:56.414930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb5dff-0241-47bf-b297-1c8436ef1fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:56.415389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb5dff-0241-47bf-b297-1c8436ef1fad admin admin] PATH_INFO: `/v3/projects/7652bf25dfb744898b491b8feb984d45/users/ee474d3c46a542319ed22abb25d7ecfe/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:56.417658 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb5dff-0241-47bf-b297-1c8436ef1fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7652bf25dfb744898b491b8feb984d45, user_id=ee474d3c46a542319ed22abb25d7ecfe, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:56.420725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb5dff-0241-47bf-b297-1c8436ef1fad admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:56.429830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:56.439957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1226/2458] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:56 2022] PUT /identity/v3/projects/7652bf25dfb744898b491b8feb984d45/users/ee474d3c46a542319ed22abb25d7ecfe/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:56.451193 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5619274-53c5-4f97-8c5a-ff064aba9237 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:56.452045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5619274-53c5-4f97-8c5a-ff064aba9237 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:56.452178 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d033e1-cd80-42fa-8a25-53230dc269be admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:56.452710 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5619274-53c5-4f97-8c5a-ff064aba9237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:56.454725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-80d033e1-cd80-42fa-8a25-53230dc269be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:56.504459 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f5619274-53c5-4f97-8c5a-ff064aba9237 None None] MFA Rules not processed for user `ee474d3c46a542319ed22abb25d7ecfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:56.506791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f5619274-53c5-4f97-8c5a-ff064aba9237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:56.612935 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d033e1-cd80-42fa-8a25-53230dc269be admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:56.703764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1227/2459] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:56.716613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5619274-53c5-4f97-8c5a-ff064aba9237 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:56.718400 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f5619274-53c5-4f97-8c5a-ff064aba9237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:56.733584 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223fdac-b26f-49af-a6b5-2124b5a54543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:56.734192 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223fdac-b26f-49af-a6b5-2124b5a54543 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:56.734469 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223fdac-b26f-49af-a6b5-2124b5a54543 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:56.734777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223fdac-b26f-49af-a6b5-2124b5a54543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:56.862066 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5619274-53c5-4f97-8c5a-ff064aba9237 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:56.871972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e560f7c-b151-4fcb-8411-6c80b7765c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:56.874073 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e560f7c-b151-4fcb-8411-6c80b7765c98 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:56.874243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e560f7c-b151-4fcb-8411-6c80b7765c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:56.874495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e560f7c-b151-4fcb-8411-6c80b7765c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:56.879725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223fdac-b26f-49af-a6b5-2124b5a54543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:56.882282 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223fdac-b26f-49af-a6b5-2124b5a54543 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:56.896047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1233/2460] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:56.933611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223fdac-b26f-49af-a6b5-2124b5a54543 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:57.013397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e560f7c-b151-4fcb-8411-6c80b7765c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:57.015028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e560f7c-b151-4fcb-8411-6c80b7765c98 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:57.029124 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1228/2461] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:57.098397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:57.110696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223fdac-b26f-49af-a6b5-2124b5a54543 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:57.116202 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928906b-f313-4a8d-9da0-3ee93a5bfb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:57.117166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928906b-f313-4a8d-9da0-3ee93a5bfb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:57.117502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928906b-f313-4a8d-9da0-3ee93a5bfb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:57.117771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928906b-f313-4a8d-9da0-3ee93a5bfb30 admin admin] PATH_INFO: `/v3/users/13dede9452a24f22b9e996f7ba4f9dc0` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:57.119136 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928906b-f313-4a8d-9da0-3ee93a5bfb30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13dede9452a24f22b9e996f7ba4f9dc0)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:57.122023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928906b-f313-4a8d-9da0-3ee93a5bfb30 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:57.218497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7928906b-f313-4a8d-9da0-3ee93a5bfb30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13dede9452a24f22b9e996f7ba4f9dc0'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:57.247953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7928906b-f313-4a8d-9da0-3ee93a5bfb30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13dede9452a24f22b9e996f7ba4f9dc0'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:57.269908 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7928906b-f313-4a8d-9da0-3ee93a5bfb30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13dede9452a24f22b9e996f7ba4f9dc0'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:57.270995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7928906b-f313-4a8d-9da0-3ee93a5bfb30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13dede9452a24f22b9e996f7ba4f9dc0'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:57.271938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7928906b-f313-4a8d-9da0-3ee93a5bfb30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13dede9452a24f22b9e996f7ba4f9dc0'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:57.293606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1234/2462] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:56 2022] DELETE /identity/v3/users/13dede9452a24f22b9e996f7ba4f9dc0 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:57.298183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ea625-16f4-4edc-bb9c-a63ec9331ae8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:57.298484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ea625-16f4-4edc-bb9c-a63ec9331ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:57.298768 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ea625-16f4-4edc-bb9c-a63ec9331ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:57.350559 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-111ea625-16f4-4edc-bb9c-a63ec9331ae8 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:57.356078 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-111ea625-16f4-4edc-bb9c-a63ec9331ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:57.561899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:57.672605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1229/2463] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:57.707319 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928906b-f313-4a8d-9da0-3ee93a5bfb30 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:57.709393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7928906b-f313-4a8d-9da0-3ee93a5bfb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:57.893770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928906b-f313-4a8d-9da0-3ee93a5bfb30 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:57.899871 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d909e5-658c-412a-a724-2c3ddb2eb708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:57.900932 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d909e5-658c-412a-a724-2c3ddb2eb708 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:57.902517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d909e5-658c-412a-a724-2c3ddb2eb708 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:57.902883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d909e5-658c-412a-a724-2c3ddb2eb708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:57.916897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d909e5-658c-412a-a724-2c3ddb2eb708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:57.918777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d909e5-658c-412a-a724-2c3ddb2eb708 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:57.936494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1235/2464] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:59.860663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ea625-16f4-4edc-bb9c-a63ec9331ae8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:59.865122 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-111ea625-16f4-4edc-bb9c-a63ec9331ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:59.886610 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ea625-16f4-4edc-bb9c-a63ec9331ae8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:59.907551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869c9c-fa5c-4103-bc95-642a92fd5f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:59.909549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869c9c-fa5c-4103-bc95-642a92fd5f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:59.910305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869c9c-fa5c-4103-bc95-642a92fd5f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:59.910898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869c9c-fa5c-4103-bc95-642a92fd5f75 admin admin] PATH_INFO: `/v3/projects/8557a42428c441308684b8f788785873` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:59.918051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf869c9c-fa5c-4103-bc95-642a92fd5f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8557a42428c441308684b8f788785873)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:59.921264 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf869c9c-fa5c-4103-bc95-642a92fd5f75 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:00.020819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cf869c9c-fa5c-4103-bc95-642a92fd5f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8557a42428c441308684b8f788785873', 'request_id': 'req-cf869c9c-fa5c-4103-bc95-642a92fd5f75'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:00.039284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cf869c9c-fa5c-4103-bc95-642a92fd5f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8557a42428c441308684b8f788785873', 'request_id': 'req-cf869c9c-fa5c-4103-bc95-642a92fd5f75'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:00.052830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cf869c9c-fa5c-4103-bc95-642a92fd5f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8557a42428c441308684b8f788785873', 'request_id': 'req-cf869c9c-fa5c-4103-bc95-642a92fd5f75'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:00.075383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cf869c9c-fa5c-4103-bc95-642a92fd5f75 admin admin] The token cache is being invalidate because project 8557a42428c441308684b8f788785873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:00.075667 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cf869c9c-fa5c-4103-bc95-642a92fd5f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:00.076960 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cf869c9c-fa5c-4103-bc95-642a92fd5f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:00.080095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1230/2465] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:59 2022] DELETE /identity/v3/projects/8557a42428c441308684b8f788785873 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:01.808272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d909e5-658c-412a-a724-2c3ddb2eb708 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:01.810534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e8d909e5-658c-412a-a724-2c3ddb2eb708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:02.011347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d909e5-658c-412a-a724-2c3ddb2eb708 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:02.030967 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:02.167883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010dbd0-a439-4e1e-8f71-08929db00044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:02.170173 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010dbd0-a439-4e1e-8f71-08929db00044 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:02.170454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010dbd0-a439-4e1e-8f71-08929db00044 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:02.170729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010dbd0-a439-4e1e-8f71-08929db00044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:02.185933 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c010dbd0-a439-4e1e-8f71-08929db00044 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:02.219687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010dbd0-a439-4e1e-8f71-08929db00044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:02.239037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010dbd0-a439-4e1e-8f71-08929db00044 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:02.255062 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1236/2466] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:02.474496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869c9c-fa5c-4103-bc95-642a92fd5f75 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:02.478086 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cf869c9c-fa5c-4103-bc95-642a92fd5f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:02.607574 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869c9c-fa5c-4103-bc95-642a92fd5f75 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:02.621094 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dc698-79ee-4fa4-b963-5407c816b7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:02.622053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dc698-79ee-4fa4-b963-5407c816b7ab service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:02.622499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dc698-79ee-4fa4-b963-5407c816b7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:02.622952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dc698-79ee-4fa4-b963-5407c816b7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:02.627364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9a5dc698-79ee-4fa4-b963-5407c816b7ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:02.780351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dc698-79ee-4fa4-b963-5407c816b7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:02.782016 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dc698-79ee-4fa4-b963-5407c816b7ab service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:02.809403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1231/2467] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:03.023433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010dbd0-a439-4e1e-8f71-08929db00044 service nova] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:03.025176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c010dbd0-a439-4e1e-8f71-08929db00044 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:03.181498 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010dbd0-a439-4e1e-8f71-08929db00044 service nova] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:03.190358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7f827-f924-4f4d-932c-993fa65f1939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:03.191497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7f827-f924-4f4d-932c-993fa65f1939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:03.191850 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7f827-f924-4f4d-932c-993fa65f1939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:03.192245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7f827-f924-4f4d-932c-993fa65f1939 admin admin] PATH_INFO: `/v3/users/97b31a636ac54a2dbc06ec4600a67281` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:03.200483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7f827-f924-4f4d-932c-993fa65f1939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b31a636ac54a2dbc06ec4600a67281)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:03.203707 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7f827-f924-4f4d-932c-993fa65f1939 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:03.294628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-30d7f827-f924-4f4d-932c-993fa65f1939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b31a636ac54a2dbc06ec4600a67281'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:03.310343 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-30d7f827-f924-4f4d-932c-993fa65f1939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b31a636ac54a2dbc06ec4600a67281'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:03.360369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-30d7f827-f924-4f4d-932c-993fa65f1939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b31a636ac54a2dbc06ec4600a67281'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:03.361237 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-30d7f827-f924-4f4d-932c-993fa65f1939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b31a636ac54a2dbc06ec4600a67281'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:03.361885 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-30d7f827-f924-4f4d-932c-993fa65f1939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b31a636ac54a2dbc06ec4600a67281'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:03.416395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1237/2468] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:03 2022] DELETE /identity/v3/users/97b31a636ac54a2dbc06ec4600a67281 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:03.422171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb11ab6-4bfe-43ea-b89d-d81e495b59f8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:03.422171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb11ab6-4bfe-43ea-b89d-d81e495b59f8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:03.422620 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb11ab6-4bfe-43ea-b89d-d81e495b59f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:03.461551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2eb11ab6-4bfe-43ea-b89d-d81e495b59f8 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:03.465950 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2eb11ab6-4bfe-43ea-b89d-d81e495b59f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:03.499570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:03.636654 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1232/2469] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:03.646317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7f827-f924-4f4d-932c-993fa65f1939 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:03.648460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-30d7f827-f924-4f4d-932c-993fa65f1939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:03.702120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:03.747719 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7f827-f924-4f4d-932c-993fa65f1939 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:03.751817 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f633c6-b78a-4e5b-8224-0c4d0bc8dcb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:03.752488 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f633c6-b78a-4e5b-8224-0c4d0bc8dcb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:03.753130 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f633c6-b78a-4e5b-8224-0c4d0bc8dcb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:03.753890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f633c6-b78a-4e5b-8224-0c4d0bc8dcb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:03.769337 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f633c6-b78a-4e5b-8224-0c4d0bc8dcb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:03.771247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f633c6-b78a-4e5b-8224-0c4d0bc8dcb3 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:03.788316 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1238/2470] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:05.502397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb11ab6-4bfe-43ea-b89d-d81e495b59f8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:05.503945 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2eb11ab6-4bfe-43ea-b89d-d81e495b59f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:05.528414 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb11ab6-4bfe-43ea-b89d-d81e495b59f8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:05.550431 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a64630-b6ea-405b-b083-1c5b0d9ca794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:05.553594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a64630-b6ea-405b-b083-1c5b0d9ca794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.556289 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a64630-b6ea-405b-b083-1c5b0d9ca794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.556830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a64630-b6ea-405b-b083-1c5b0d9ca794 admin admin] PATH_INFO: `/v3/projects/caf5924cf20c4d8eb540d4fd1b9e2390` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.562317 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a64630-b6ea-405b-b083-1c5b0d9ca794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf5924cf20c4d8eb540d4fd1b9e2390)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:05.575210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a64630-b6ea-405b-b083-1c5b0d9ca794 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:05.732018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-32a64630-b6ea-405b-b083-1c5b0d9ca794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf5924cf20c4d8eb540d4fd1b9e2390', 'request_id': 'req-32a64630-b6ea-405b-b083-1c5b0d9ca794'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:05.747000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-32a64630-b6ea-405b-b083-1c5b0d9ca794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf5924cf20c4d8eb540d4fd1b9e2390', 'request_id': 'req-32a64630-b6ea-405b-b083-1c5b0d9ca794'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:05.769055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-32a64630-b6ea-405b-b083-1c5b0d9ca794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf5924cf20c4d8eb540d4fd1b9e2390', 'request_id': 'req-32a64630-b6ea-405b-b083-1c5b0d9ca794'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:05.804365 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-32a64630-b6ea-405b-b083-1c5b0d9ca794 admin admin] The token cache is being invalidate because project caf5924cf20c4d8eb540d4fd1b9e2390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:05.806865 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-32a64630-b6ea-405b-b083-1c5b0d9ca794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:05.808618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-32a64630-b6ea-405b-b083-1c5b0d9ca794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:05.811669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1233/2471] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:05 2022] DELETE /identity/v3/projects/caf5924cf20c4d8eb540d4fd1b9e2390 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:05.816957 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c42b9-4da6-4b02-8887-6462721c837e None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.818047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c42b9-4da6-4b02-8887-6462721c837e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.818483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c42b9-4da6-4b02-8887-6462721c837e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.860342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-0a6c42b9-4da6-4b02-8887-6462721c837e None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:05.865839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-0a6c42b9-4da6-4b02-8887-6462721c837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:06.063519 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1239/2472] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:06.072912 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14fbd8-85c7-43e5-81ee-a9e0a05b87d0 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.073239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14fbd8-85c7-43e5-81ee-a9e0a05b87d0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.073603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14fbd8-85c7-43e5-81ee-a9e0a05b87d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.119044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5e14fbd8-85c7-43e5-81ee-a9e0a05b87d0 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:06.120847 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5e14fbd8-85c7-43e5-81ee-a9e0a05b87d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:06.140307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1234/2473] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:06.144563 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c42b9-4da6-4b02-8887-6462721c837e None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:06.158360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c42b9-4da6-4b02-8887-6462721c837e None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:06.173088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7f9ac-3fed-47d2-b490-22e8705522d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:06.173713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7f9ac-3fed-47d2-b490-22e8705522d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.173995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7f9ac-3fed-47d2-b490-22e8705522d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.174271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7f9ac-3fed-47d2-b490-22e8705522d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.183960 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7f9ac-3fed-47d2-b490-22e8705522d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:06.184294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7f9ac-3fed-47d2-b490-22e8705522d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:06.185982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7f9ac-3fed-47d2-b490-22e8705522d4 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:06.222982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1240/2474] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:06.224209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14fbd8-85c7-43e5-81ee-a9e0a05b87d0 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:06.241149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14fbd8-85c7-43e5-81ee-a9e0a05b87d0 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:06.250457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85c2ef-0725-4d6a-82ae-3bad867e15d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:06.252061 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85c2ef-0725-4d6a-82ae-3bad867e15d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.252392 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85c2ef-0725-4d6a-82ae-3bad867e15d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.252608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85c2ef-0725-4d6a-82ae-3bad867e15d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.253300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85c2ef-0725-4d6a-82ae-3bad867e15d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:06.255239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85c2ef-0725-4d6a-82ae-3bad867e15d4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:06.346874 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1235/2475] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:06 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:06.348049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7f9ac-3fed-47d2-b490-22e8705522d4 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:06.367659 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7f9ac-3fed-47d2-b490-22e8705522d4 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:06.480421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2bf1d-f3a3-44bd-83d9-5e9ef80c7220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:06.481121 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2bf1d-f3a3-44bd-83d9-5e9ef80c7220 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.481463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2bf1d-f3a3-44bd-83d9-5e9ef80c7220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.481804 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2bf1d-f3a3-44bd-83d9-5e9ef80c7220 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.482898 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2bf1d-f3a3-44bd-83d9-5e9ef80c7220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:06.485548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2bf1d-f3a3-44bd-83d9-5e9ef80c7220 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:06.527573 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1241/2476] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:06 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:06.531505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85c2ef-0725-4d6a-82ae-3bad867e15d4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:06.556443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85c2ef-0725-4d6a-82ae-3bad867e15d4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:06.562962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db6ed0-550b-4125-9b3b-78e9881bf947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:06.564040 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db6ed0-550b-4125-9b3b-78e9881bf947 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.564717 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db6ed0-550b-4125-9b3b-78e9881bf947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.565179 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db6ed0-550b-4125-9b3b-78e9881bf947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.566323 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db6ed0-550b-4125-9b3b-78e9881bf947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:06.568458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db6ed0-550b-4125-9b3b-78e9881bf947 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:06.583760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1236/2477] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:06.587394 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2bf1d-f3a3-44bd-83d9-5e9ef80c7220 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:06.601579 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2bf1d-f3a3-44bd-83d9-5e9ef80c7220 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:06.608663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd2a9b-a0e0-4cc5-956d-8ac259feee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:06.609313 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd2a9b-a0e0-4cc5-956d-8ac259feee83 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.609581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd2a9b-a0e0-4cc5-956d-8ac259feee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.609861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd2a9b-a0e0-4cc5-956d-8ac259feee83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.610808 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd2a9b-a0e0-4cc5-956d-8ac259feee83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:06.613062 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd2a9b-a0e0-4cc5-956d-8ac259feee83 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:06.630535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1242/2478] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:06.632057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db6ed0-550b-4125-9b3b-78e9881bf947 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:06.644049 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db6ed0-550b-4125-9b3b-78e9881bf947 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:06.650434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0952a87-7f91-4f9c-b125-c1a93a0b2a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:06.654812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0952a87-7f91-4f9c-b125-c1a93a0b2a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.655247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0952a87-7f91-4f9c-b125-c1a93a0b2a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.655657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0952a87-7f91-4f9c-b125-c1a93a0b2a06 admin admin] PATH_INFO: `/v3/projects/4d73b33599314f1f8961db945ca6dc0e/users/cca950d62aea4efb83793bfec6fda2b7/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.697189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0952a87-7f91-4f9c-b125-c1a93a0b2a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d73b33599314f1f8961db945ca6dc0e, user_id=cca950d62aea4efb83793bfec6fda2b7, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:06.700024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0952a87-7f91-4f9c-b125-c1a93a0b2a06 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:06.727300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1237/2479] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:06 2022] PUT /identity/v3/projects/4d73b33599314f1f8961db945ca6dc0e/users/cca950d62aea4efb83793bfec6fda2b7/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:06.737154 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a468d-5494-4e5b-8cb5-b0dfedfc088b None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.737377 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a468d-5494-4e5b-8cb5-b0dfedfc088b None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.737482 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a468d-5494-4e5b-8cb5-b0dfedfc088b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.790462 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e45a468d-5494-4e5b-8cb5-b0dfedfc088b None None] MFA Rules not processed for user `cca950d62aea4efb83793bfec6fda2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:06.792046 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e45a468d-5494-4e5b-8cb5-b0dfedfc088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:06.825915 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:06.956000 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1243/2480] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:06.988450 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0952a87-7f91-4f9c-b125-c1a93a0b2a06 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:06.990275 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b0952a87-7f91-4f9c-b125-c1a93a0b2a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:07.076671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:07.160908 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0952a87-7f91-4f9c-b125-c1a93a0b2a06 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:07.181955 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a01ef3-6862-4ab5-a4c2-8e45cd6cc932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:07.182446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a01ef3-6862-4ab5-a4c2-8e45cd6cc932 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:07.182794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a01ef3-6862-4ab5-a4c2-8e45cd6cc932 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:07.183158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a01ef3-6862-4ab5-a4c2-8e45cd6cc932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:07.197613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a01ef3-6862-4ab5-a4c2-8e45cd6cc932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:07.199203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a01ef3-6862-4ab5-a4c2-8e45cd6cc932 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:07.216744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1238/2481] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:07.765402 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a468d-5494-4e5b-8cb5-b0dfedfc088b None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:07.863134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a468d-5494-4e5b-8cb5-b0dfedfc088b None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:07.869413 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d29b9-04b8-4227-8d35-e09ad67d37c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:07.870294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d29b9-04b8-4227-8d35-e09ad67d37c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:07.870735 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d29b9-04b8-4227-8d35-e09ad67d37c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:07.871171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d29b9-04b8-4227-8d35-e09ad67d37c9 admin admin] PATH_INFO: `/v3/users/cca950d62aea4efb83793bfec6fda2b7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:07.872562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d29b9-04b8-4227-8d35-e09ad67d37c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca950d62aea4efb83793bfec6fda2b7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:07.874683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d29b9-04b8-4227-8d35-e09ad67d37c9 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:07.985955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6e3d29b9-04b8-4227-8d35-e09ad67d37c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca950d62aea4efb83793bfec6fda2b7'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:08.000123 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6e3d29b9-04b8-4227-8d35-e09ad67d37c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca950d62aea4efb83793bfec6fda2b7'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:08.018717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6e3d29b9-04b8-4227-8d35-e09ad67d37c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca950d62aea4efb83793bfec6fda2b7'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:08.019593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6e3d29b9-04b8-4227-8d35-e09ad67d37c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca950d62aea4efb83793bfec6fda2b7'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:08.021488 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6e3d29b9-04b8-4227-8d35-e09ad67d37c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca950d62aea4efb83793bfec6fda2b7'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:08.037370 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1244/2482] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:07 2022] DELETE /identity/v3/users/cca950d62aea4efb83793bfec6fda2b7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:08.042770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e560c7-906b-4ba6-bf3d-b002ccca81b4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:08.043626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e560c7-906b-4ba6-bf3d-b002ccca81b4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:08.044362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e560c7-906b-4ba6-bf3d-b002ccca81b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:08.073024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-30e560c7-906b-4ba6-bf3d-b002ccca81b4 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:08.074602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-30e560c7-906b-4ba6-bf3d-b002ccca81b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:08.156504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1239/2483] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:08.166493 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d29b9-04b8-4227-8d35-e09ad67d37c9 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:08.168284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-6e3d29b9-04b8-4227-8d35-e09ad67d37c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:08.237592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:08.267597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d29b9-04b8-4227-8d35-e09ad67d37c9 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:08.272140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951f666-8e96-4a94-a906-8bdd57caa4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:08.274192 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951f666-8e96-4a94-a906-8bdd57caa4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:08.274602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951f666-8e96-4a94-a906-8bdd57caa4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:08.274971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951f666-8e96-4a94-a906-8bdd57caa4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:08.301248 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951f666-8e96-4a94-a906-8bdd57caa4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:08.303216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951f666-8e96-4a94-a906-8bdd57caa4a7 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:08.338476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1245/2484] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:08.880305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e560c7-906b-4ba6-bf3d-b002ccca81b4 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:08.885585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-30e560c7-906b-4ba6-bf3d-b002ccca81b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:08.914931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e560c7-906b-4ba6-bf3d-b002ccca81b4 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:08.920160 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1faa34-7216-41c8-b8c4-d4100e96ed73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:08.920819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1faa34-7216-41c8-b8c4-d4100e96ed73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:08.921103 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1faa34-7216-41c8-b8c4-d4100e96ed73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:08.921381 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1faa34-7216-41c8-b8c4-d4100e96ed73 admin admin] PATH_INFO: `/v3/projects/4d73b33599314f1f8961db945ca6dc0e` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:08.925008 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1faa34-7216-41c8-b8c4-d4100e96ed73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d73b33599314f1f8961db945ca6dc0e)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:08.926963 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1faa34-7216-41c8-b8c4-d4100e96ed73 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:09.037806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ab1faa34-7216-41c8-b8c4-d4100e96ed73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d73b33599314f1f8961db945ca6dc0e', 'request_id': 'req-ab1faa34-7216-41c8-b8c4-d4100e96ed73'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:09.052781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ab1faa34-7216-41c8-b8c4-d4100e96ed73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d73b33599314f1f8961db945ca6dc0e', 'request_id': 'req-ab1faa34-7216-41c8-b8c4-d4100e96ed73'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:09.072916 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ab1faa34-7216-41c8-b8c4-d4100e96ed73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d73b33599314f1f8961db945ca6dc0e', 'request_id': 'req-ab1faa34-7216-41c8-b8c4-d4100e96ed73'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:09.093635 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ab1faa34-7216-41c8-b8c4-d4100e96ed73 admin admin] The token cache is being invalidate because project 4d73b33599314f1f8961db945ca6dc0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:09.094091 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ab1faa34-7216-41c8-b8c4-d4100e96ed73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:09.094775 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ab1faa34-7216-41c8-b8c4-d4100e96ed73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:09.112001 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1240/2485] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:08 2022] DELETE /identity/v3/projects/4d73b33599314f1f8961db945ca6dc0e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:11.853956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951f666-8e96-4a94-a906-8bdd57caa4a7 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:11.855380 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a951f666-8e96-4a94-a906-8bdd57caa4a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:11.881003 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951f666-8e96-4a94-a906-8bdd57caa4a7 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:11.966985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa2af5-ecb7-4142-9d6b-9b17435471b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:11.970948 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa2af5-ecb7-4142-9d6b-9b17435471b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:11.971297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa2af5-ecb7-4142-9d6b-9b17435471b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:11.972348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa2af5-ecb7-4142-9d6b-9b17435471b3 admin admin] PATH_INFO: `/v3/users/b9cb22635f4a48048cd0d4c51355134e` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:11.981552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa2af5-ecb7-4142-9d6b-9b17435471b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9cb22635f4a48048cd0d4c51355134e)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:11.983864 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa2af5-ecb7-4142-9d6b-9b17435471b3 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:12.051761 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-01fa2af5-ecb7-4142-9d6b-9b17435471b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9cb22635f4a48048cd0d4c51355134e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:12.064382 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-01fa2af5-ecb7-4142-9d6b-9b17435471b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9cb22635f4a48048cd0d4c51355134e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:12.090396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-01fa2af5-ecb7-4142-9d6b-9b17435471b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9cb22635f4a48048cd0d4c51355134e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:12.092595 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-01fa2af5-ecb7-4142-9d6b-9b17435471b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9cb22635f4a48048cd0d4c51355134e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:12.093623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-01fa2af5-ecb7-4142-9d6b-9b17435471b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9cb22635f4a48048cd0d4c51355134e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:12.129348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1246/2486] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:11 2022] DELETE /identity/v3/users/b9cb22635f4a48048cd0d4c51355134e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:12.133688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2a7e6-c2c1-4786-847e-d2e3308d6397 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:12.134230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2a7e6-c2c1-4786-847e-d2e3308d6397 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:12.134230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2a7e6-c2c1-4786-847e-d2e3308d6397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:12.163480 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d3b2a7e6-c2c1-4786-847e-d2e3308d6397 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:12.165003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d3b2a7e6-c2c1-4786-847e-d2e3308d6397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:12.271327 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:12.290351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1241/2487] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:12.299706 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa2af5-ecb7-4142-9d6b-9b17435471b3 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:12.301404 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-01fa2af5-ecb7-4142-9d6b-9b17435471b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:12.429035 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa2af5-ecb7-4142-9d6b-9b17435471b3 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:12.436322 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b914ab4-6f8b-4eda-a375-170e96779e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:12.437358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b914ab4-6f8b-4eda-a375-170e96779e03 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:12.437843 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b914ab4-6f8b-4eda-a375-170e96779e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:12.438115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b914ab4-6f8b-4eda-a375-170e96779e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:12.450290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b914ab4-6f8b-4eda-a375-170e96779e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:12.452938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b914ab4-6f8b-4eda-a375-170e96779e03 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:12.474256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1247/2488] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:12.824044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2a7e6-c2c1-4786-847e-d2e3308d6397 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:12.825546 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d3b2a7e6-c2c1-4786-847e-d2e3308d6397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:12.845651 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2a7e6-c2c1-4786-847e-d2e3308d6397 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:12.851520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1883d-eb39-40af-a2df-f725f96eca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:12.852867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1883d-eb39-40af-a2df-f725f96eca35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:12.853312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1883d-eb39-40af-a2df-f725f96eca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:12.853757 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1883d-eb39-40af-a2df-f725f96eca35 admin admin] PATH_INFO: `/v3/projects/3ec30b8e9d4a47179f1493d592b5f5e2` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:12.855341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1883d-eb39-40af-a2df-f725f96eca35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec30b8e9d4a47179f1493d592b5f5e2)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:12.857677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1883d-eb39-40af-a2df-f725f96eca35 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:12.891535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28527487-3392-4b3a-9c09-a3743d6f0be6 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:12.892128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28527487-3392-4b3a-9c09-a3743d6f0be6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:12.898969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28527487-3392-4b3a-9c09-a3743d6f0be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:12.914119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:12.937539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-28527487-3392-4b3a-9c09-a3743d6f0be6 None None] MFA Rules not processed for user `53afc903595c4a07a4003f72228a8291`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:12.940363 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-28527487-3392-4b3a-9c09-a3743d6f0be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:12.945793 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bef1883d-eb39-40af-a2df-f725f96eca35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec30b8e9d4a47179f1493d592b5f5e2', 'request_id': 'req-bef1883d-eb39-40af-a2df-f725f96eca35'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:12.956781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bef1883d-eb39-40af-a2df-f725f96eca35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec30b8e9d4a47179f1493d592b5f5e2', 'request_id': 'req-bef1883d-eb39-40af-a2df-f725f96eca35'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:12.967199 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bef1883d-eb39-40af-a2df-f725f96eca35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec30b8e9d4a47179f1493d592b5f5e2', 'request_id': 'req-bef1883d-eb39-40af-a2df-f725f96eca35'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:12.982857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bef1883d-eb39-40af-a2df-f725f96eca35 admin admin] The token cache is being invalidate because project 3ec30b8e9d4a47179f1493d592b5f5e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:12.983518 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bef1883d-eb39-40af-a2df-f725f96eca35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:12.984675 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bef1883d-eb39-40af-a2df-f725f96eca35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:12.987820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1242/2489] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:12 2022] DELETE /identity/v3/projects/3ec30b8e9d4a47179f1493d592b5f5e2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:12.993544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081d82a-1ee0-4936-b186-f9d40fddc95c None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:12.994263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081d82a-1ee0-4936-b186-f9d40fddc95c None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:12.997647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081d82a-1ee0-4936-b186-f9d40fddc95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:13.039949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6081d82a-1ee0-4936-b186-f9d40fddc95c None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:13.040182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1248/2490] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:13.040305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6081d82a-1ee0-4936-b186-f9d40fddc95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:13.127953 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1243/2491] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:10:13.131818 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832f7af-3e75-4b30-811d-a4f578a8128e None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:13.132412 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832f7af-3e75-4b30-811d-a4f578a8128e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:13.132901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832f7af-3e75-4b30-811d-a4f578a8128e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:13.157408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5832f7af-3e75-4b30-811d-a4f578a8128e None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:13.158807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5832f7af-3e75-4b30-811d-a4f578a8128e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:13.171776 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1249/2492] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:13.176255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081d82a-1ee0-4936-b186-f9d40fddc95c None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:13.190488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081d82a-1ee0-4936-b186-f9d40fddc95c None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:13.197369 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010d280-23cf-47b4-9af5-2442261e83ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:13.198460 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010d280-23cf-47b4-9af5-2442261e83ef admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:13.198749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010d280-23cf-47b4-9af5-2442261e83ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:13.199028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010d280-23cf-47b4-9af5-2442261e83ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:13.199698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010d280-23cf-47b4-9af5-2442261e83ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:13.200039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010d280-23cf-47b4-9af5-2442261e83ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:13.201666 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010d280-23cf-47b4-9af5-2442261e83ef admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:13.216461 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1244/2493] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:13.220844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832f7af-3e75-4b30-811d-a4f578a8128e None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:13.233697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832f7af-3e75-4b30-811d-a4f578a8128e None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:13.239580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738329a2-c870-4db5-8c84-c3f245067c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:13.240262 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738329a2-c870-4db5-8c84-c3f245067c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:13.240541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738329a2-c870-4db5-8c84-c3f245067c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:13.241400 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738329a2-c870-4db5-8c84-c3f245067c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:13.241618 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738329a2-c870-4db5-8c84-c3f245067c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:13.243458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738329a2-c870-4db5-8c84-c3f245067c88 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:13.282812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1250/2494] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:13 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:13.286762 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010d280-23cf-47b4-9af5-2442261e83ef admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:13.301093 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010d280-23cf-47b4-9af5-2442261e83ef admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:13.382317 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd203cb0-d667-4092-9ceb-390a5fc9dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:13.383439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd203cb0-d667-4092-9ceb-390a5fc9dd24 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:13.384022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd203cb0-d667-4092-9ceb-390a5fc9dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:13.384521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd203cb0-d667-4092-9ceb-390a5fc9dd24 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:13.385174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd203cb0-d667-4092-9ceb-390a5fc9dd24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:13.387135 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd203cb0-d667-4092-9ceb-390a5fc9dd24 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:13.416632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:13.421554 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1245/2495] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:13 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:13.425694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738329a2-c870-4db5-8c84-c3f245067c88 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:13.440383 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738329a2-c870-4db5-8c84-c3f245067c88 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:13.448533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ff860-c632-43ba-bc45-b4f0f4130b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:13.449245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd203cb0-d667-4092-9ceb-390a5fc9dd24 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:13.450332 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ff860-c632-43ba-bc45-b4f0f4130b34 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:13.450619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ff860-c632-43ba-bc45-b4f0f4130b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:13.450890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ff860-c632-43ba-bc45-b4f0f4130b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:13.451009 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-dd203cb0-d667-4092-9ceb-390a5fc9dd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:13.452285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ff860-c632-43ba-bc45-b4f0f4130b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:13.453906 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ff860-c632-43ba-bc45-b4f0f4130b34 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:13.465578 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1251/2496] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:13.470008 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ff860-c632-43ba-bc45-b4f0f4130b34 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:13.488149 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ff860-c632-43ba-bc45-b4f0f4130b34 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:13.494759 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1e3b4-ba11-4fd1-ba89-aa8193daae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:13.495382 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1e3b4-ba11-4fd1-ba89-aa8193daae87 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:13.495656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1e3b4-ba11-4fd1-ba89-aa8193daae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:13.495945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1e3b4-ba11-4fd1-ba89-aa8193daae87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:13.496937 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1e3b4-ba11-4fd1-ba89-aa8193daae87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:13.499199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1e3b4-ba11-4fd1-ba89-aa8193daae87 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:13.515375 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1252/2497] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:13.516311 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1e3b4-ba11-4fd1-ba89-aa8193daae87 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:13.528708 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1e3b4-ba11-4fd1-ba89-aa8193daae87 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:13.533843 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720a43c-e366-410b-a2ec-5f3241c70ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:13.534643 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720a43c-e366-410b-a2ec-5f3241c70ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:13.534917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720a43c-e366-410b-a2ec-5f3241c70ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:13.535195 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720a43c-e366-410b-a2ec-5f3241c70ae4 admin admin] PATH_INFO: `/v3/projects/c610d11bf00846b1a3df00c0037bf3ce/users/0157fdf0e9b24c88b9eb7d6066bdd458/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:13.553987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd203cb0-d667-4092-9ceb-390a5fc9dd24 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:13.555192 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720a43c-e366-410b-a2ec-5f3241c70ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c610d11bf00846b1a3df00c0037bf3ce, user_id=0157fdf0e9b24c88b9eb7d6066bdd458, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:13.558264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720a43c-e366-410b-a2ec-5f3241c70ae4 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:13.558463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fadd03-7889-4900-97a2-3ff7896f0910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:13.559087 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fadd03-7889-4900-97a2-3ff7896f0910 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:13.559366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fadd03-7889-4900-97a2-3ff7896f0910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:13.559636 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fadd03-7889-4900-97a2-3ff7896f0910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:13.561496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-76fadd03-7889-4900-97a2-3ff7896f0910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:13.576033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1253/2498] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:13 2022] PUT /identity/v3/projects/c610d11bf00846b1a3df00c0037bf3ce/users/0157fdf0e9b24c88b9eb7d6066bdd458/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:13.586057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fadd03-7889-4900-97a2-3ff7896f0910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:13.587119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12569eb2-5a34-4c5a-8add-8270b80bb5ee None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:13.587405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12569eb2-5a34-4c5a-8add-8270b80bb5ee None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:13.587539 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fadd03-7889-4900-97a2-3ff7896f0910 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:13.587674 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12569eb2-5a34-4c5a-8add-8270b80bb5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:13.598226 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1246/2499] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:13.621985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-12569eb2-5a34-4c5a-8add-8270b80bb5ee None None] MFA Rules not processed for user `0157fdf0e9b24c88b9eb7d6066bdd458`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:13.623288 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-12569eb2-5a34-4c5a-8add-8270b80bb5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:13.719421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1254/2500] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:13.733364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fadd03-7889-4900-97a2-3ff7896f0910 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:13.735412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-76fadd03-7889-4900-97a2-3ff7896f0910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:13.749867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fadd03-7889-4900-97a2-3ff7896f0910 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:13.815248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc95561-d8f7-49a9-b805-9cdb3e306cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:13.815828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc95561-d8f7-49a9-b805-9cdb3e306cea service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:13.816139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc95561-d8f7-49a9-b805-9cdb3e306cea service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:13.816414 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc95561-d8f7-49a9-b805-9cdb3e306cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:13.831086 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc95561-d8f7-49a9-b805-9cdb3e306cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:13.833334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc95561-d8f7-49a9-b805-9cdb3e306cea service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:13.850072 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1247/2501] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:23.715697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=87,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:23.842977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=52 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:24.995374 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99c68-6036-42d6-9933-a947dbc1eccd None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:24.995940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99c68-6036-42d6-9933-a947dbc1eccd None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:24.996060 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b99c68-6036-42d6-9933-a947dbc1eccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:25.016134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-16b99c68-6036-42d6-9933-a947dbc1eccd None None] MFA Rules not processed for user `c30148c955ca4b79864da62e70820af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:25.017387 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-16b99c68-6036-42d6-9933-a947dbc1eccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:25.094493 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1255/2502] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:31.033272 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc95561-d8f7-49a9-b805-9cdb3e306cea service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:31.123838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc95561-d8f7-49a9-b805-9cdb3e306cea service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:31.128946 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac8be2-5392-484b-aff6-a30f3512b7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:31.129611 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8be2-5392-484b-aff6-a30f3512b7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:31.129895 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8be2-5392-484b-aff6-a30f3512b7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:31.130174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8be2-5392-484b-aff6-a30f3512b7f9 admin admin] PATH_INFO: `/v3/users/0157fdf0e9b24c88b9eb7d6066bdd458` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:31.131968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac8be2-5392-484b-aff6-a30f3512b7f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0157fdf0e9b24c88b9eb7d6066bdd458)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:31.134173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac8be2-5392-484b-aff6-a30f3512b7f9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:31.227659 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-40ac8be2-5392-484b-aff6-a30f3512b7f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0157fdf0e9b24c88b9eb7d6066bdd458'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.237949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-40ac8be2-5392-484b-aff6-a30f3512b7f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0157fdf0e9b24c88b9eb7d6066bdd458'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.269153 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-40ac8be2-5392-484b-aff6-a30f3512b7f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0157fdf0e9b24c88b9eb7d6066bdd458'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.280326 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-40ac8be2-5392-484b-aff6-a30f3512b7f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0157fdf0e9b24c88b9eb7d6066bdd458'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.281095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-40ac8be2-5392-484b-aff6-a30f3512b7f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0157fdf0e9b24c88b9eb7d6066bdd458'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.293661 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1248/2503] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:31 2022] DELETE /identity/v3/users/0157fdf0e9b24c88b9eb7d6066bdd458 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:31.296549 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d11449-fcf4-4db9-8e31-392a76482156 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:31.297419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d11449-fcf4-4db9-8e31-392a76482156 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:31.297853 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d11449-fcf4-4db9-8e31-392a76482156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:31.338543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-06d11449-fcf4-4db9-8e31-392a76482156 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:31.340490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-06d11449-fcf4-4db9-8e31-392a76482156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:31.437968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1256/2504] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:31.447020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac8be2-5392-484b-aff6-a30f3512b7f9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:31.448698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-40ac8be2-5392-484b-aff6-a30f3512b7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:31.525603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac8be2-5392-484b-aff6-a30f3512b7f9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:31.529442 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdeca0-592f-4b6d-a542-b4e52e2ec917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:31.530062 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdeca0-592f-4b6d-a542-b4e52e2ec917 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:31.530346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdeca0-592f-4b6d-a542-b4e52e2ec917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:31.530620 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdeca0-592f-4b6d-a542-b4e52e2ec917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:31.541691 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffdeca0-592f-4b6d-a542-b4e52e2ec917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:31.543136 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffdeca0-592f-4b6d-a542-b4e52e2ec917 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:31.562591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1249/2505] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:31.825041 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d11449-fcf4-4db9-8e31-392a76482156 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:31.826591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-06d11449-fcf4-4db9-8e31-392a76482156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:31.848666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d11449-fcf4-4db9-8e31-392a76482156 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:31.854138 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7e071-d0bc-4524-995f-0e75a2ce3d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:31.855020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7e071-d0bc-4524-995f-0e75a2ce3d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:31.855477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7e071-d0bc-4524-995f-0e75a2ce3d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:31.856216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7e071-d0bc-4524-995f-0e75a2ce3d5e admin admin] PATH_INFO: `/v3/projects/c610d11bf00846b1a3df00c0037bf3ce` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:31.858148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7e071-d0bc-4524-995f-0e75a2ce3d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c610d11bf00846b1a3df00c0037bf3ce)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:31.861342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7e071-d0bc-4524-995f-0e75a2ce3d5e admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:31.947335 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fbb7e071-d0bc-4524-995f-0e75a2ce3d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c610d11bf00846b1a3df00c0037bf3ce', 'request_id': 'req-fbb7e071-d0bc-4524-995f-0e75a2ce3d5e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.970150 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fbb7e071-d0bc-4524-995f-0e75a2ce3d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c610d11bf00846b1a3df00c0037bf3ce', 'request_id': 'req-fbb7e071-d0bc-4524-995f-0e75a2ce3d5e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.982152 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fbb7e071-d0bc-4524-995f-0e75a2ce3d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c610d11bf00846b1a3df00c0037bf3ce', 'request_id': 'req-fbb7e071-d0bc-4524-995f-0e75a2ce3d5e'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.998359 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fbb7e071-d0bc-4524-995f-0e75a2ce3d5e admin admin] The token cache is being invalidate because project c610d11bf00846b1a3df00c0037bf3ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:31.998649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fbb7e071-d0bc-4524-995f-0e75a2ce3d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.999486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-fbb7e071-d0bc-4524-995f-0e75a2ce3d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:32.003994 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1257/2506] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:31 2022] DELETE /identity/v3/projects/c610d11bf00846b1a3df00c0037bf3ce => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:32.007891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6694-6eb9-499b-b455-d0d24a366667 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:32.008553 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6694-6eb9-499b-b455-d0d24a366667 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:32.009025 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6694-6eb9-499b-b455-d0d24a366667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.032434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-373f6694-6eb9-499b-b455-d0d24a366667 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:32.034843 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-373f6694-6eb9-499b-b455-d0d24a366667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:32.057545 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:32.119816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1250/2507] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:32.128549 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade14c03-b35e-4ef6-8c7b-2a88ecd48f7e None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:32.129084 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade14c03-b35e-4ef6-8c7b-2a88ecd48f7e None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:32.129506 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade14c03-b35e-4ef6-8c7b-2a88ecd48f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.153521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-ade14c03-b35e-4ef6-8c7b-2a88ecd48f7e None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:32.155159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ade14c03-b35e-4ef6-8c7b-2a88ecd48f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:32.165208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1258/2508] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:32.169603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f6694-6eb9-499b-b455-d0d24a366667 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:32.180947 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f6694-6eb9-499b-b455-d0d24a366667 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:32.187048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1370d-4120-4d77-8e3c-cbbeaee0cab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:32.187674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1370d-4120-4d77-8e3c-cbbeaee0cab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:32.187985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1370d-4120-4d77-8e3c-cbbeaee0cab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:32.188267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1370d-4120-4d77-8e3c-cbbeaee0cab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.188926 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1370d-4120-4d77-8e3c-cbbeaee0cab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:32.189225 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1370d-4120-4d77-8e3c-cbbeaee0cab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:32.191576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1370d-4120-4d77-8e3c-cbbeaee0cab4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:32.231013 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1251/2509] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:32.231574 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade14c03-b35e-4ef6-8c7b-2a88ecd48f7e None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:32.261088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade14c03-b35e-4ef6-8c7b-2a88ecd48f7e None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:32.283807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415941e8-c426-4423-86f2-1236cd9481d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:32.284752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415941e8-c426-4423-86f2-1236cd9481d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:32.284857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415941e8-c426-4423-86f2-1236cd9481d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:32.285132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415941e8-c426-4423-86f2-1236cd9481d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.285799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415941e8-c426-4423-86f2-1236cd9481d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:32.291476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415941e8-c426-4423-86f2-1236cd9481d6 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:32.330222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:32.339524 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1259/2510] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:32 2022] POST /identity/v3/projects => generated 353 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:10:32.343564 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1370d-4120-4d77-8e3c-cbbeaee0cab4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:32.355194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1370d-4120-4d77-8e3c-cbbeaee0cab4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:32.421063 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ca9ac-4c9d-444b-a3f5-82c5dbf6f1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:32.421694 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ca9ac-4c9d-444b-a3f5-82c5dbf6f1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:32.421975 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ca9ac-4c9d-444b-a3f5-82c5dbf6f1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:32.422247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ca9ac-4c9d-444b-a3f5-82c5dbf6f1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.422915 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ca9ac-4c9d-444b-a3f5-82c5dbf6f1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:32.425091 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ca9ac-4c9d-444b-a3f5-82c5dbf6f1b3 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:32.460537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1252/2511] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:32 2022] POST /identity/v3/users => generated 277 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:32.462098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415941e8-c426-4423-86f2-1236cd9481d6 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:32.475032 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415941e8-c426-4423-86f2-1236cd9481d6 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:32.483825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f8986-6d6d-407c-bdd6-4d5ee4d13b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:32.484762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f8986-6d6d-407c-bdd6-4d5ee4d13b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:32.486300 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f8986-6d6d-407c-bdd6-4d5ee4d13b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:32.486730 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f8986-6d6d-407c-bdd6-4d5ee4d13b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.487464 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f8986-6d6d-407c-bdd6-4d5ee4d13b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:32.489609 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f8986-6d6d-407c-bdd6-4d5ee4d13b20 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:32.508944 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1260/2512] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:32.510744 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ca9ac-4c9d-444b-a3f5-82c5dbf6f1b3 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:32.521842 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ca9ac-4c9d-444b-a3f5-82c5dbf6f1b3 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:32.528254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb6236-95b1-40d3-8544-49d4214a9792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:32.529105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb6236-95b1-40d3-8544-49d4214a9792 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:32.529451 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb6236-95b1-40d3-8544-49d4214a9792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:32.529801 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb6236-95b1-40d3-8544-49d4214a9792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.530521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb6236-95b1-40d3-8544-49d4214a9792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:32.532476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb6236-95b1-40d3-8544-49d4214a9792 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:32.550171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1253/2513] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:10:32.552430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f8986-6d6d-407c-bdd6-4d5ee4d13b20 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:32.564086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f8986-6d6d-407c-bdd6-4d5ee4d13b20 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:32.571239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa48b4-489f-4f34-a331-337c06143aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:32.572177 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa48b4-489f-4f34-a331-337c06143aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:32.572613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa48b4-489f-4f34-a331-337c06143aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:32.573043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa48b4-489f-4f34-a331-337c06143aa3 admin admin] PATH_INFO: `/v3/projects/a98c46a711bc4e6fb2fe0d59b68547b2/users/fc46f3f7e72f446ebd8d82fd649a6a73/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.595958 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa48b4-489f-4f34-a331-337c06143aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98c46a711bc4e6fb2fe0d59b68547b2, user_id=fc46f3f7e72f446ebd8d82fd649a6a73, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:32.599417 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa48b4-489f-4f34-a331-337c06143aa3 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:32.617432 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1261/2514] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:32 2022] PUT /identity/v3/projects/a98c46a711bc4e6fb2fe0d59b68547b2/users/fc46f3f7e72f446ebd8d82fd649a6a73/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:32.628672 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a3979-a96e-4fee-974d-08766693014f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:32.629426 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a3979-a96e-4fee-974d-08766693014f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:32.630044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a3979-a96e-4fee-974d-08766693014f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.672286 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-645a3979-a96e-4fee-974d-08766693014f None None] MFA Rules not processed for user `fc46f3f7e72f446ebd8d82fd649a6a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:32.673903 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-645a3979-a96e-4fee-974d-08766693014f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:32.753854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1254/2515] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:32.764475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa48b4-489f-4f34-a331-337c06143aa3 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:32.766467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-effa48b4-489f-4f34-a331-337c06143aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:32.826997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa48b4-489f-4f34-a331-337c06143aa3 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:32.830815 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d8d64-7ff9-4ff5-96b6-7a58ea3b1f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:32.831425 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d8d64-7ff9-4ff5-96b6-7a58ea3b1f32 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:32.831702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d8d64-7ff9-4ff5-96b6-7a58ea3b1f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:32.831999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d8d64-7ff9-4ff5-96b6-7a58ea3b1f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.841719 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d8d64-7ff9-4ff5-96b6-7a58ea3b1f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:32.843151 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d8d64-7ff9-4ff5-96b6-7a58ea3b1f32 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:32.853218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1262/2516] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:34.803772 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a3979-a96e-4fee-974d-08766693014f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:34.825237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:34.890579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a3979-a96e-4fee-974d-08766693014f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:34.895505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba234cc-f485-48c2-95ee-3862af12b5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:34.896186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba234cc-f485-48c2-95ee-3862af12b5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:34.897443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba234cc-f485-48c2-95ee-3862af12b5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:34.897984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba234cc-f485-48c2-95ee-3862af12b5bf admin admin] PATH_INFO: `/v3/users/fc46f3f7e72f446ebd8d82fd649a6a73` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:34.899346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba234cc-f485-48c2-95ee-3862af12b5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc46f3f7e72f446ebd8d82fd649a6a73)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:34.901891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba234cc-f485-48c2-95ee-3862af12b5bf admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:34.955350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9ba234cc-f485-48c2-95ee-3862af12b5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc46f3f7e72f446ebd8d82fd649a6a73'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:34.963681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9ba234cc-f485-48c2-95ee-3862af12b5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc46f3f7e72f446ebd8d82fd649a6a73'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:34.977849 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9ba234cc-f485-48c2-95ee-3862af12b5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc46f3f7e72f446ebd8d82fd649a6a73'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:34.987870 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9ba234cc-f485-48c2-95ee-3862af12b5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc46f3f7e72f446ebd8d82fd649a6a73'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:34.988920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-9ba234cc-f485-48c2-95ee-3862af12b5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc46f3f7e72f446ebd8d82fd649a6a73'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:34.999829 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1255/2517] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:34 2022] DELETE /identity/v3/users/fc46f3f7e72f446ebd8d82fd649a6a73 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:35.005686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9998b8-c64d-4798-8997-f52709bf2157 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:35.006600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9998b8-c64d-4798-8997-f52709bf2157 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:35.006963 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9998b8-c64d-4798-8997-f52709bf2157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:35.026852 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-cf9998b8-c64d-4798-8997-f52709bf2157 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:35.028091 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-cf9998b8-c64d-4798-8997-f52709bf2157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:35.089731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1263/2518] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:35.099399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba234cc-f485-48c2-95ee-3862af12b5bf admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:35.102074 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9ba234cc-f485-48c2-95ee-3862af12b5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:35.161209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba234cc-f485-48c2-95ee-3862af12b5bf admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:35.167045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada7eb7-0daf-406d-b46e-d1a79de5596e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:35.167674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada7eb7-0daf-406d-b46e-d1a79de5596e service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:35.167984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada7eb7-0daf-406d-b46e-d1a79de5596e service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:35.168262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada7eb7-0daf-406d-b46e-d1a79de5596e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:35.178648 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada7eb7-0daf-406d-b46e-d1a79de5596e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:35.180116 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada7eb7-0daf-406d-b46e-d1a79de5596e service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:35.190432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1256/2519] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:35.381433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9998b8-c64d-4798-8997-f52709bf2157 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:35.383284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-cf9998b8-c64d-4798-8997-f52709bf2157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:35.397202 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9998b8-c64d-4798-8997-f52709bf2157 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:35.402741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff3f05-eed1-430c-bde9-af3d4fe632a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:35.403624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff3f05-eed1-430c-bde9-af3d4fe632a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:35.403969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff3f05-eed1-430c-bde9-af3d4fe632a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:35.404325 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff3f05-eed1-430c-bde9-af3d4fe632a8 admin admin] PATH_INFO: `/v3/projects/a98c46a711bc4e6fb2fe0d59b68547b2` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:35.405565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff3f05-eed1-430c-bde9-af3d4fe632a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98c46a711bc4e6fb2fe0d59b68547b2)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:35.408339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff3f05-eed1-430c-bde9-af3d4fe632a8 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:35.461649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-90ff3f05-eed1-430c-bde9-af3d4fe632a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98c46a711bc4e6fb2fe0d59b68547b2', 'request_id': 'req-90ff3f05-eed1-430c-bde9-af3d4fe632a8'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:35.468106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-90ff3f05-eed1-430c-bde9-af3d4fe632a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98c46a711bc4e6fb2fe0d59b68547b2', 'request_id': 'req-90ff3f05-eed1-430c-bde9-af3d4fe632a8'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:35.476688 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-90ff3f05-eed1-430c-bde9-af3d4fe632a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98c46a711bc4e6fb2fe0d59b68547b2', 'request_id': 'req-90ff3f05-eed1-430c-bde9-af3d4fe632a8'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:35.478848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:35.489959 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-90ff3f05-eed1-430c-bde9-af3d4fe632a8 admin admin] The token cache is being invalidate because project a98c46a711bc4e6fb2fe0d59b68547b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:35.490897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-90ff3f05-eed1-430c-bde9-af3d4fe632a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:35.491648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-90ff3f05-eed1-430c-bde9-af3d4fe632a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:35.493190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1264/2520] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:35 2022] DELETE /identity/v3/projects/a98c46a711bc4e6fb2fe0d59b68547b2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:45.185957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:45.489120 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:46.732093 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada7eb7-0daf-406d-b46e-d1a79de5596e service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:46.742640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada7eb7-0daf-406d-b46e-d1a79de5596e service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:46.803996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33bcf9-1993-4c65-bbac-83eeed8d2b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:46.804635 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33bcf9-1993-4c65-bbac-83eeed8d2b4d service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:46.804920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33bcf9-1993-4c65-bbac-83eeed8d2b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:46.805198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33bcf9-1993-4c65-bbac-83eeed8d2b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:46.807027 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3d33bcf9-1993-4c65-bbac-83eeed8d2b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:46.904607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33bcf9-1993-4c65-bbac-83eeed8d2b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:46.905970 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33bcf9-1993-4c65-bbac-83eeed8d2b4d service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:46.918895 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1257/2521] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:56.917049 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=65 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:08.123257 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a47f5-8645-4328-a305-bf39381934d5 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:08.123888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a47f5-8645-4328-a305-bf39381934d5 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:08.123888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a47f5-8645-4328-a305-bf39381934d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:08.152278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e28a47f5-8645-4328-a305-bf39381934d5 None None] MFA Rules not processed for user `53afc903595c4a07a4003f72228a8291`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:08.154227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e28a47f5-8645-4328-a305-bf39381934d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:08.219876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1265/2522] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:11:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:11:18.213119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=25 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:33.506117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33bcf9-1993-4c65-bbac-83eeed8d2b4d service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:33.507673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3d33bcf9-1993-4c65-bbac-83eeed8d2b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:33.619143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33bcf9-1993-4c65-bbac-83eeed8d2b4d service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:33.624047 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463ff7a-935e-4caa-bae6-62d767c22acf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:33.624639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463ff7a-935e-4caa-bae6-62d767c22acf service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:33.624913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463ff7a-935e-4caa-bae6-62d767c22acf service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:33.625178 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463ff7a-935e-4caa-bae6-62d767c22acf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:33.626882 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8463ff7a-935e-4caa-bae6-62d767c22acf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:33.643579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463ff7a-935e-4caa-bae6-62d767c22acf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:33.645652 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463ff7a-935e-4caa-bae6-62d767c22acf service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:33.660551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1258/2523] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:38.285119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a47f5-8645-4328-a305-bf39381934d5 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:38.287250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e28a47f5-8645-4328-a305-bf39381934d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:38.401956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a47f5-8645-4328-a305-bf39381934d5 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:38.407215 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa9af5-e089-48a7-9d8d-d31c6107e565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:38.408043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa9af5-e089-48a7-9d8d-d31c6107e565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:38.408432 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa9af5-e089-48a7-9d8d-d31c6107e565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:38.408825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa9af5-e089-48a7-9d8d-d31c6107e565 admin admin] PATH_INFO: `/v3/users/fd66b47f86264f24b68283accebb7bd6` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:38.410379 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa9af5-e089-48a7-9d8d-d31c6107e565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd66b47f86264f24b68283accebb7bd6)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:38.412740 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa9af5-e089-48a7-9d8d-d31c6107e565 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:38.473760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d9aa9af5-e089-48a7-9d8d-d31c6107e565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd66b47f86264f24b68283accebb7bd6'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:38.482077 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d9aa9af5-e089-48a7-9d8d-d31c6107e565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd66b47f86264f24b68283accebb7bd6'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:38.495542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d9aa9af5-e089-48a7-9d8d-d31c6107e565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd66b47f86264f24b68283accebb7bd6'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:38.496299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d9aa9af5-e089-48a7-9d8d-d31c6107e565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd66b47f86264f24b68283accebb7bd6'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:38.496912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d9aa9af5-e089-48a7-9d8d-d31c6107e565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd66b47f86264f24b68283accebb7bd6'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:38.513941 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1266/2524] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:38 2022] DELETE /identity/v3/users/fd66b47f86264f24b68283accebb7bd6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:38.517092 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44f858-9a92-4fe1-bd9a-0a2f23072347 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:38.517092 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44f858-9a92-4fe1-bd9a-0a2f23072347 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:38.517092 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44f858-9a92-4fe1-bd9a-0a2f23072347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:38.549784 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ae44f858-9a92-4fe1-bd9a-0a2f23072347 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:38.551710 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ae44f858-9a92-4fe1-bd9a-0a2f23072347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:38.621351 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1259/2525] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:38.631889 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa9af5-e089-48a7-9d8d-d31c6107e565 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:38.633588 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d9aa9af5-e089-48a7-9d8d-d31c6107e565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:38.700051 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:38.726392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa9af5-e089-48a7-9d8d-d31c6107e565 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:38.730511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121ef5-2a3a-451d-9b48-3681413c3aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:38.731116 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121ef5-2a3a-451d-9b48-3681413c3aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:38.731392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121ef5-2a3a-451d-9b48-3681413c3aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:38.731661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121ef5-2a3a-451d-9b48-3681413c3aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:38.742079 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15121ef5-2a3a-451d-9b48-3681413c3aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:38.743663 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15121ef5-2a3a-451d-9b48-3681413c3aa9 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:38.754669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1267/2526] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:38.941980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44f858-9a92-4fe1-bd9a-0a2f23072347 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:38.943485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ae44f858-9a92-4fe1-bd9a-0a2f23072347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:38.955635 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44f858-9a92-4fe1-bd9a-0a2f23072347 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:38.961011 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab0f0f-3ac3-4651-b95f-c71de98aa318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:38.961677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab0f0f-3ac3-4651-b95f-c71de98aa318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:38.961953 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab0f0f-3ac3-4651-b95f-c71de98aa318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:38.962218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab0f0f-3ac3-4651-b95f-c71de98aa318 admin admin] PATH_INFO: `/v3/projects/bf43cbd4a4284a1bac069b993485dfe7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:38.963338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab0f0f-3ac3-4651-b95f-c71de98aa318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf43cbd4a4284a1bac069b993485dfe7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:38.965270 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab0f0f-3ac3-4651-b95f-c71de98aa318 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:39.010375 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:39.014611 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eab0f0f-3ac3-4651-b95f-c71de98aa318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf43cbd4a4284a1bac069b993485dfe7', 'request_id': 'req-7eab0f0f-3ac3-4651-b95f-c71de98aa318'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.022631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eab0f0f-3ac3-4651-b95f-c71de98aa318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf43cbd4a4284a1bac069b993485dfe7', 'request_id': 'req-7eab0f0f-3ac3-4651-b95f-c71de98aa318'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.031358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eab0f0f-3ac3-4651-b95f-c71de98aa318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf43cbd4a4284a1bac069b993485dfe7', 'request_id': 'req-7eab0f0f-3ac3-4651-b95f-c71de98aa318'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.042495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eab0f0f-3ac3-4651-b95f-c71de98aa318 admin admin] The token cache is being invalidate because project bf43cbd4a4284a1bac069b993485dfe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:39.042851 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eab0f0f-3ac3-4651-b95f-c71de98aa318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.043583 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eab0f0f-3ac3-4651-b95f-c71de98aa318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.045162 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1260/2527] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:38 2022] DELETE /identity/v3/projects/bf43cbd4a4284a1bac069b993485dfe7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:39.050667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121ef5-2a3a-451d-9b48-3681413c3aa9 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:39.060495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121ef5-2a3a-451d-9b48-3681413c3aa9 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:39.116143 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4712f84-bfe9-4e2b-bc66-f0c49397fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:39.116762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4712f84-bfe9-4e2b-bc66-f0c49397fa1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:39.117035 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4712f84-bfe9-4e2b-bc66-f0c49397fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:39.117306 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4712f84-bfe9-4e2b-bc66-f0c49397fa1d admin admin] PATH_INFO: `/v3/users/0748006f945346a19a7018ea47b7f450` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:39.118413 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4712f84-bfe9-4e2b-bc66-f0c49397fa1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0748006f945346a19a7018ea47b7f450)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:39.120376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4712f84-bfe9-4e2b-bc66-f0c49397fa1d admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:39.167954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b4712f84-bfe9-4e2b-bc66-f0c49397fa1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0748006f945346a19a7018ea47b7f450'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.175280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b4712f84-bfe9-4e2b-bc66-f0c49397fa1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0748006f945346a19a7018ea47b7f450'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.187562 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b4712f84-bfe9-4e2b-bc66-f0c49397fa1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0748006f945346a19a7018ea47b7f450'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.188222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b4712f84-bfe9-4e2b-bc66-f0c49397fa1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0748006f945346a19a7018ea47b7f450'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.188824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b4712f84-bfe9-4e2b-bc66-f0c49397fa1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0748006f945346a19a7018ea47b7f450'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.201673 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1268/2528] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:39 2022] DELETE /identity/v3/users/0748006f945346a19a7018ea47b7f450 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:39.481339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab0f0f-3ac3-4651-b95f-c71de98aa318 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:39.482995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7eab0f0f-3ac3-4651-b95f-c71de98aa318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:39.499365 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab0f0f-3ac3-4651-b95f-c71de98aa318 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:39.559616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bc5c8-7f48-4080-9c63-0965a8cf4520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:39.560370 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bc5c8-7f48-4080-9c63-0965a8cf4520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:39.560545 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bc5c8-7f48-4080-9c63-0965a8cf4520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:39.560816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bc5c8-7f48-4080-9c63-0965a8cf4520 admin admin] PATH_INFO: `/v3/projects/c875411d73e746a0984e777e2b997e8c` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:39.561923 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bc5c8-7f48-4080-9c63-0965a8cf4520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c875411d73e746a0984e777e2b997e8c)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:39.563826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bc5c8-7f48-4080-9c63-0965a8cf4520 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:39.612152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f84bc5c8-7f48-4080-9c63-0965a8cf4520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c875411d73e746a0984e777e2b997e8c', 'request_id': 'req-f84bc5c8-7f48-4080-9c63-0965a8cf4520'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.618411 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f84bc5c8-7f48-4080-9c63-0965a8cf4520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c875411d73e746a0984e777e2b997e8c', 'request_id': 'req-f84bc5c8-7f48-4080-9c63-0965a8cf4520'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.625628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f84bc5c8-7f48-4080-9c63-0965a8cf4520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c875411d73e746a0984e777e2b997e8c', 'request_id': 'req-f84bc5c8-7f48-4080-9c63-0965a8cf4520'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.637298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f84bc5c8-7f48-4080-9c63-0965a8cf4520 admin admin] The token cache is being invalidate because project c875411d73e746a0984e777e2b997e8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:39.637587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f84bc5c8-7f48-4080-9c63-0965a8cf4520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.638242 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f84bc5c8-7f48-4080-9c63-0965a8cf4520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.640217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1261/2529] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:39 2022] DELETE /identity/v3/projects/c875411d73e746a0984e777e2b997e8c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:49.198142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=65,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:49.634322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=59,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:07.243734 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3568031-eed8-4121-b8ca-f8186b242c56 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:07.244373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3568031-eed8-4121-b8ca-f8186b242c56 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:07.244373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3568031-eed8-4121-b8ca-f8186b242c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:07.266027 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-a3568031-eed8-4121-b8ca-f8186b242c56 None None] MFA Rules not processed for user `53afc903595c4a07a4003f72228a8291`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:07.267979 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a3568031-eed8-4121-b8ca-f8186b242c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:07.330997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1269/2530] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:12:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:17.323339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=25 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:56.499714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfb468-fbae-492d-883c-571ffb03e914 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:56.500712 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfb468-fbae-492d-883c-571ffb03e914 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:56.500712 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfb468-fbae-492d-883c-571ffb03e914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:56.523836 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-74cfb468-fbae-492d-883c-571ffb03e914 None None] MFA Rules not processed for user `c30148c955ca4b79864da62e70820af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:56.525222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-74cfb468-fbae-492d-883c-571ffb03e914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:56.592763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1262/2531] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:12:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:06.583115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=25 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:09.067022 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7957e7-58cb-4046-b376-0e437c8455e4 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:09.067446 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7957e7-58cb-4046-b376-0e437c8455e4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:09.067557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7957e7-58cb-4046-b376-0e437c8455e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:09.088400 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3d7957e7-58cb-4046-b376-0e437c8455e4 None None] MFA Rules not processed for user `53afc903595c4a07a4003f72228a8291`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:09.089641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3d7957e7-58cb-4046-b376-0e437c8455e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:09.098460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1270/2532] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:13:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:19.082434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:05.034511 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ebe47-d8a7-44b5-b2e4-e9ef37b48a67 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:05.035045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ebe47-d8a7-44b5-b2e4-e9ef37b48a67 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:05.035045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ebe47-d8a7-44b5-b2e4-e9ef37b48a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:05.054444 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0f8ebe47-d8a7-44b5-b2e4-e9ef37b48a67 None None] MFA Rules not processed for user `53afc903595c4a07a4003f72228a8291`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:05.055698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0f8ebe47-d8a7-44b5-b2e4-e9ef37b48a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:05.063613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1263/2533] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:15.049887 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:53.693511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7957e7-58cb-4046-b376-0e437c8455e4 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:53.695168 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3d7957e7-58cb-4046-b376-0e437c8455e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:53.756260 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7957e7-58cb-4046-b376-0e437c8455e4 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:53.760068 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277d065-0695-4062-9a5c-52ee584e5446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:53.760728 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277d065-0695-4062-9a5c-52ee584e5446 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:53.760948 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277d065-0695-4062-9a5c-52ee584e5446 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:53.761214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277d065-0695-4062-9a5c-52ee584e5446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:53.762917 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8277d065-0695-4062-9a5c-52ee584e5446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:53.855594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277d065-0695-4062-9a5c-52ee584e5446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:53.857100 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277d065-0695-4062-9a5c-52ee584e5446 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:53.878057 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1271/2534] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:55.068963 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ebe47-d8a7-44b5-b2e4-e9ef37b48a67 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:55.080139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ebe47-d8a7-44b5-b2e4-e9ef37b48a67 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:55.083624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad19a4d-438e-4146-b923-9a0d0fc9cd78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:55.084293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad19a4d-438e-4146-b923-9a0d0fc9cd78 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:55.084569 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad19a4d-438e-4146-b923-9a0d0fc9cd78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:55.084840 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad19a4d-438e-4146-b923-9a0d0fc9cd78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:55.086505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8ad19a4d-438e-4146-b923-9a0d0fc9cd78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:55.102038 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad19a4d-438e-4146-b923-9a0d0fc9cd78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:55.103658 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad19a4d-438e-4146-b923-9a0d0fc9cd78 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:55.117018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1264/2535] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:56.038257 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277d065-0695-4062-9a5c-52ee584e5446 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:56.040652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8277d065-0695-4062-9a5c-52ee584e5446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:56.058495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277d065-0695-4062-9a5c-52ee584e5446 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:56.065157 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b180d-d6d1-49a3-b21b-6e4b1e1d6566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:56.066163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b180d-d6d1-49a3-b21b-6e4b1e1d6566 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:56.066665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b180d-d6d1-49a3-b21b-6e4b1e1d6566 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:56.067214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b180d-d6d1-49a3-b21b-6e4b1e1d6566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:56.069581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4b8b180d-d6d1-49a3-b21b-6e4b1e1d6566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:56.086006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b180d-d6d1-49a3-b21b-6e4b1e1d6566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:56.088802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b180d-d6d1-49a3-b21b-6e4b1e1d6566 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:56.102739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1272/2536] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:57.453593 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad19a4d-438e-4146-b923-9a0d0fc9cd78 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:57.464958 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad19a4d-438e-4146-b923-9a0d0fc9cd78 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:57.471123 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71804368-5943-4df5-82ed-8e55bdc2efa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:57.471713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71804368-5943-4df5-82ed-8e55bdc2efa6 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:57.472045 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71804368-5943-4df5-82ed-8e55bdc2efa6 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:57.472305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71804368-5943-4df5-82ed-8e55bdc2efa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:57.474024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-71804368-5943-4df5-82ed-8e55bdc2efa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:57.485189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71804368-5943-4df5-82ed-8e55bdc2efa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:57.486743 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71804368-5943-4df5-82ed-8e55bdc2efa6 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:57.495590 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1265/2537] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:58.646191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b180d-d6d1-49a3-b21b-6e4b1e1d6566 service nova] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:58.647579 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4b8b180d-d6d1-49a3-b21b-6e4b1e1d6566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:58.717495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=100 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:58.727375 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b180d-d6d1-49a3-b21b-6e4b1e1d6566 service nova] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:58.731218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76046e1-d1c6-40a4-869c-aca960915387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '803d0ab121784d688b58374aaa6a8e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:58.731826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76046e1-d1c6-40a4-869c-aca960915387 service cinder] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:58.732135 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76046e1-d1c6-40a4-869c-aca960915387 service cinder] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:58.732411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76046e1-d1c6-40a4-869c-aca960915387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:58.735640 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b76046e1-d1c6-40a4-869c-aca960915387 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:58.746460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76046e1-d1c6-40a4-869c-aca960915387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:58.747884 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76046e1-d1c6-40a4-869c-aca960915387 service cinder] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:58.758285 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1273/2538] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:05.616612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71804368-5943-4df5-82ed-8e55bdc2efa6 service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:05.619269 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-71804368-5943-4df5-82ed-8e55bdc2efa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:05.754909 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71804368-5943-4df5-82ed-8e55bdc2efa6 service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:05.760275 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a99d3d-c296-4d75-b4a6-843e5697b433 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:05.761137 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a99d3d-c296-4d75-b4a6-843e5697b433 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:05.761600 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a99d3d-c296-4d75-b4a6-843e5697b433 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:05.761882 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a99d3d-c296-4d75-b4a6-843e5697b433 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:05.788654 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-76a99d3d-c296-4d75-b4a6-843e5697b433 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:05.814358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a99d3d-c296-4d75-b4a6-843e5697b433 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:05.821423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a99d3d-c296-4d75-b4a6-843e5697b433 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:05.847505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1266/2539] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:08.531094 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76046e1-d1c6-40a4-869c-aca960915387 service cinder] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:08.531094 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b76046e1-d1c6-40a4-869c-aca960915387 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:08.552241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76046e1-d1c6-40a4-869c-aca960915387 service cinder] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:08.555994 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9293-f911-428e-9b47-ecba13c79bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:08.556609 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9293-f911-428e-9b47-ecba13c79bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:08.556888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9293-f911-428e-9b47-ecba13c79bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:08.557212 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9293-f911-428e-9b47-ecba13c79bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:08.558962 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-458c9293-f911-428e-9b47-ecba13c79bc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:08.651857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c9293-f911-428e-9b47-ecba13c79bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:08.653442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c9293-f911-428e-9b47-ecba13c79bc1 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:08.668367 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1274/2540] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:11.373565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d009f66-c604-4808-948c-0bfbeb0e25af None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:11.374138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d009f66-c604-4808-948c-0bfbeb0e25af None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:11.374529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d009f66-c604-4808-948c-0bfbeb0e25af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:11.395760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5d009f66-c604-4808-948c-0bfbeb0e25af None None] MFA Rules not processed for user `c30148c955ca4b79864da62e70820af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:11.397028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5d009f66-c604-4808-948c-0bfbeb0e25af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:11.405274 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1267/2541] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:12.393296 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9293-f911-428e-9b47-ecba13c79bc1 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:12.408550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9293-f911-428e-9b47-ecba13c79bc1 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:12.419011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682de995-b8b7-4f55-a62e-771117bc4caf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:12.419516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682de995-b8b7-4f55-a62e-771117bc4caf service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:12.419791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682de995-b8b7-4f55-a62e-771117bc4caf service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:12.420253 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682de995-b8b7-4f55-a62e-771117bc4caf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:12.422403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-682de995-b8b7-4f55-a62e-771117bc4caf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:12.438993 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682de995-b8b7-4f55-a62e-771117bc4caf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:12.443923 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682de995-b8b7-4f55-a62e-771117bc4caf service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:12.463580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1275/2542] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:14.409976 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5021909-7057-4120-9a4d-1878e490ddd1 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:14.410532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5021909-7057-4120-9a4d-1878e490ddd1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:14.410532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5021909-7057-4120-9a4d-1878e490ddd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:14.437427 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b5021909-7057-4120-9a4d-1878e490ddd1 None None] MFA Rules not processed for user `53afc903595c4a07a4003f72228a8291`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:14.439266 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b5021909-7057-4120-9a4d-1878e490ddd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:14.453075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1268/2543] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:15:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:14.897151 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682de995-b8b7-4f55-a62e-771117bc4caf service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:14.938820 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682de995-b8b7-4f55-a62e-771117bc4caf service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:14.964421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21ef22-6dc4-43cf-91e9-b516bfea0ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:14.965438 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21ef22-6dc4-43cf-91e9-b516bfea0ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:14.969189 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21ef22-6dc4-43cf-91e9-b516bfea0ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:14.971115 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21ef22-6dc4-43cf-91e9-b516bfea0ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:14.977437 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4d21ef22-6dc4-43cf-91e9-b516bfea0ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:15.016942 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21ef22-6dc4-43cf-91e9-b516bfea0ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:15.019310 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21ef22-6dc4-43cf-91e9-b516bfea0ff1 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:15.052389 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1276/2544] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:15.196182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5021909-7057-4120-9a4d-1878e490ddd1 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:15.215262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5021909-7057-4120-9a4d-1878e490ddd1 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:15.220197 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df597e-f3c3-49af-9342-3a38956d5485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:15.221260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df597e-f3c3-49af-9342-3a38956d5485 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:15.221828 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df597e-f3c3-49af-9342-3a38956d5485 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:15.222330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df597e-f3c3-49af-9342-3a38956d5485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:15.224521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-73df597e-f3c3-49af-9342-3a38956d5485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:15.242471 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df597e-f3c3-49af-9342-3a38956d5485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:15.244334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df597e-f3c3-49af-9342-3a38956d5485 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:15.256248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1269/2545] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:15.932471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05266364-6d0e-4ba3-ad4f-07b64e216124 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:15.933654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05266364-6d0e-4ba3-ad4f-07b64e216124 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:15.934092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05266364-6d0e-4ba3-ad4f-07b64e216124 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:15.936408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1277/2546] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:15:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:15:15.944861 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea7dab-3851-4bfe-a558-c3bc3ab0c3af None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:15.945438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea7dab-3851-4bfe-a558-c3bc3ab0c3af None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:15.945592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea7dab-3851-4bfe-a558-c3bc3ab0c3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:16.088010 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-78ea7dab-3851-4bfe-a558-c3bc3ab0c3af None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:16.089572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-78ea7dab-3851-4bfe-a558-c3bc3ab0c3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:16.107117 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1270/2547] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:15:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:16.120092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05266364-6d0e-4ba3-ad4f-07b64e216124 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:16.135282 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05266364-6d0e-4ba3-ad4f-07b64e216124 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:16.139472 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac078b84-cd24-4460-b115-ec7d7754fda7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:16.140390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078b84-cd24-4460-b115-ec7d7754fda7 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:16.140879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078b84-cd24-4460-b115-ec7d7754fda7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:16.141401 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078b84-cd24-4460-b115-ec7d7754fda7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:16.153125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac078b84-cd24-4460-b115-ec7d7754fda7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:16.155132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac078b84-cd24-4460-b115-ec7d7754fda7 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:16.193223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1278/2548] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:15:25.400119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea7dab-3851-4bfe-a558-c3bc3ab0c3af None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:25.401897 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-78ea7dab-3851-4bfe-a558-c3bc3ab0c3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:25.410965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=74 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:25.418928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea7dab-3851-4bfe-a558-c3bc3ab0c3af None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:25.425126 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb4eb4-63e0-4616-8d29-c5331820018b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:25.425742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb4eb4-63e0-4616-8d29-c5331820018b service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:25.426021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb4eb4-63e0-4616-8d29-c5331820018b service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:25.426296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb4eb4-63e0-4616-8d29-c5331820018b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:25.428055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b3bb4eb4-63e0-4616-8d29-c5331820018b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:25.441113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb4eb4-63e0-4616-8d29-c5331820018b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:25.442711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb4eb4-63e0-4616-8d29-c5331820018b service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:25.454545 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1271/2549] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:26.185105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=55 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:30.229873 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac078b84-cd24-4460-b115-ec7d7754fda7 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:30.244698 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac078b84-cd24-4460-b115-ec7d7754fda7 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:30.250984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7010e-8ee0-4267-a1b5-6cedfe517e93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:30.252632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7010e-8ee0-4267-a1b5-6cedfe517e93 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:30.252632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7010e-8ee0-4267-a1b5-6cedfe517e93 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:30.252632 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7010e-8ee0-4267-a1b5-6cedfe517e93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:30.253953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f2a7010e-8ee0-4267-a1b5-6cedfe517e93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:30.272860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7010e-8ee0-4267-a1b5-6cedfe517e93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:30.274503 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7010e-8ee0-4267-a1b5-6cedfe517e93 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:30.297457 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1279/2550] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:15:35.450096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:35.977781 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aff39-35ac-4172-a367-e3bfe2bfbfbe None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:35.978273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aff39-35ac-4172-a367-e3bfe2bfbfbe None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:35.978623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aff39-35ac-4172-a367-e3bfe2bfbfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:35.999786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-9f4aff39-35ac-4172-a367-e3bfe2bfbfbe None None] MFA Rules not processed for user `53afc903595c4a07a4003f72228a8291`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:36.001131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-9f4aff39-35ac-4172-a367-e3bfe2bfbfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:36.008923 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1272/2551] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:15:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:36.658344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec53336-09ea-444c-9508-717117224ade None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:36.658949 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec53336-09ea-444c-9508-717117224ade None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:36.659118 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec53336-09ea-444c-9508-717117224ade None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:36.661200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1280/2552] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:15:36.678585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e461-1703-4950-b44a-d5ebc09d693b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:36.680615 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e461-1703-4950-b44a-d5ebc09d693b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:36.681023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e461-1703-4950-b44a-d5ebc09d693b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:36.724029 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-91b6e461-1703-4950-b44a-d5ebc09d693b None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:36.725821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-91b6e461-1703-4950-b44a-d5ebc09d693b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:36.738456 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1273/2553] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:15:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:36.751292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec53336-09ea-444c-9508-717117224ade None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:36.765938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec53336-09ea-444c-9508-717117224ade None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:36.780900 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69889c0a-a110-4e7c-a785-578c3789762c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:36.781730 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69889c0a-a110-4e7c-a785-578c3789762c service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:36.782997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69889c0a-a110-4e7c-a785-578c3789762c service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:36.782997 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69889c0a-a110-4e7c-a785-578c3789762c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:36.802964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69889c0a-a110-4e7c-a785-578c3789762c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:36.805671 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69889c0a-a110-4e7c-a785-578c3789762c service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:36.826978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1281/2554] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:46.717515 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:46.818308 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=12 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:03.325796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b75a0e-a69b-4a81-9168-94d1220f25f6 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:03.326398 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b75a0e-a69b-4a81-9168-94d1220f25f6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:03.326398 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b75a0e-a69b-4a81-9168-94d1220f25f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:03.349273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-02b75a0e-a69b-4a81-9168-94d1220f25f6 None None] MFA Rules not processed for user `53afc903595c4a07a4003f72228a8291`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:03.350488 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-02b75a0e-a69b-4a81-9168-94d1220f25f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:03.358982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1274/2555] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:16:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:03.710244 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69889c0a-a110-4e7c-a785-578c3789762c service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:03.719920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69889c0a-a110-4e7c-a785-578c3789762c service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:03.723618 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a263e4-0b03-4adb-ae11-89d7580a9047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:03.724258 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a263e4-0b03-4adb-ae11-89d7580a9047 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:03.724542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a263e4-0b03-4adb-ae11-89d7580a9047 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:03.724810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a263e4-0b03-4adb-ae11-89d7580a9047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:03.726561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-33a263e4-0b03-4adb-ae11-89d7580a9047 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:03.737769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a263e4-0b03-4adb-ae11-89d7580a9047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:03.739216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a263e4-0b03-4adb-ae11-89d7580a9047 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:03.748693 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1282/2556] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:16:13.340222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:13.744136 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=6 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:58.161033 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b75a0e-a69b-4a81-9168-94d1220f25f6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:58.162644 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-02b75a0e-a69b-4a81-9168-94d1220f25f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:58.178621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b75a0e-a69b-4a81-9168-94d1220f25f6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:58.183887 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14b8a9-beab-4715-ad90-4b870b35b0a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:58.184521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14b8a9-beab-4715-ad90-4b870b35b0a1 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:58.184812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14b8a9-beab-4715-ad90-4b870b35b0a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:58.185089 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14b8a9-beab-4715-ad90-4b870b35b0a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:58.186823 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1c14b8a9-beab-4715-ad90-4b870b35b0a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:58.200830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14b8a9-beab-4715-ad90-4b870b35b0a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:58.202462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14b8a9-beab-4715-ad90-4b870b35b0a1 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:58.213739 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1275/2557] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:02.526541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a263e4-0b03-4adb-ae11-89d7580a9047 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:02.544820 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a263e4-0b03-4adb-ae11-89d7580a9047 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:02.549791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bf549-ed1f-4459-8b92-9b12b3106bed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:02.550389 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bf549-ed1f-4459-8b92-9b12b3106bed service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:02.550736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bf549-ed1f-4459-8b92-9b12b3106bed service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:02.550960 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bf549-ed1f-4459-8b92-9b12b3106bed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:02.552774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ad3bf549-ed1f-4459-8b92-9b12b3106bed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:02.565453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bf549-ed1f-4459-8b92-9b12b3106bed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:02.567040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bf549-ed1f-4459-8b92-9b12b3106bed service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:02.578930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1283/2558] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:08.208614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:10.882076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ae263-5aa0-4532-b62f-10b7051fe593 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:10.882777 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ae263-5aa0-4532-b62f-10b7051fe593 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:10.882777 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ae263-5aa0-4532-b62f-10b7051fe593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:10.910789 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-677ae263-5aa0-4532-b62f-10b7051fe593 None None] MFA Rules not processed for user `53afc903595c4a07a4003f72228a8291`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:10.912165 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-677ae263-5aa0-4532-b62f-10b7051fe593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:10.925915 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1276/2559] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:12.573185 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=6 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:20.904526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:34.940475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bf549-ed1f-4459-8b92-9b12b3106bed service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:34.952064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bf549-ed1f-4459-8b92-9b12b3106bed service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:34.955826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5585586-d6ab-4de3-9fc6-949ae4beb1dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:34.956576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5585586-d6ab-4de3-9fc6-949ae4beb1dc service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:34.956921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5585586-d6ab-4de3-9fc6-949ae4beb1dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:34.957270 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5585586-d6ab-4de3-9fc6-949ae4beb1dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:34.959200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c5585586-d6ab-4de3-9fc6-949ae4beb1dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:35.026771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5585586-d6ab-4de3-9fc6-949ae4beb1dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:35.028331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5585586-d6ab-4de3-9fc6-949ae4beb1dc service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:35.038154 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1284/2560] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:41.502448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ae263-5aa0-4532-b62f-10b7051fe593 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:41.504062 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-677ae263-5aa0-4532-b62f-10b7051fe593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:41.517974 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ae263-5aa0-4532-b62f-10b7051fe593 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:41.522938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf8b8f-31f7-43c8-a3c0-52f2bae81180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:41.523578 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf8b8f-31f7-43c8-a3c0-52f2bae81180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:41.523861 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf8b8f-31f7-43c8-a3c0-52f2bae81180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:41.524174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf8b8f-31f7-43c8-a3c0-52f2bae81180 admin admin] PATH_INFO: `/v3/users/c30148c955ca4b79864da62e70820af0` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:41.525296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf8b8f-31f7-43c8-a3c0-52f2bae81180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30148c955ca4b79864da62e70820af0)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:41.527604 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf8b8f-31f7-43c8-a3c0-52f2bae81180 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:41.575572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9bf8b8f-31f7-43c8-a3c0-52f2bae81180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30148c955ca4b79864da62e70820af0'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.584263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9bf8b8f-31f7-43c8-a3c0-52f2bae81180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30148c955ca4b79864da62e70820af0'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.596938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9bf8b8f-31f7-43c8-a3c0-52f2bae81180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30148c955ca4b79864da62e70820af0'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.604721 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9bf8b8f-31f7-43c8-a3c0-52f2bae81180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30148c955ca4b79864da62e70820af0'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.605384 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c9bf8b8f-31f7-43c8-a3c0-52f2bae81180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30148c955ca4b79864da62e70820af0'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.611292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1277/2561] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:41 2022] DELETE /identity/v3/users/c30148c955ca4b79864da62e70820af0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:41.796474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5585586-d6ab-4de3-9fc6-949ae4beb1dc service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:41.808661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5585586-d6ab-4de3-9fc6-949ae4beb1dc service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:41.867094 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743baa5-51dc-49fe-a154-33533cc9b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:41.867721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743baa5-51dc-49fe-a154-33533cc9b0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:41.868034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743baa5-51dc-49fe-a154-33533cc9b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:41.868306 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743baa5-51dc-49fe-a154-33533cc9b0fa admin admin] PATH_INFO: `/v3/projects/56c054ea85384ababbd7a271cba9b87c` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:41.869451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743baa5-51dc-49fe-a154-33533cc9b0fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=56c054ea85384ababbd7a271cba9b87c)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:41.871823 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743baa5-51dc-49fe-a154-33533cc9b0fa admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:41.920303 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4743baa5-51dc-49fe-a154-33533cc9b0fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56c054ea85384ababbd7a271cba9b87c', 'request_id': 'req-4743baa5-51dc-49fe-a154-33533cc9b0fa'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.926463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4743baa5-51dc-49fe-a154-33533cc9b0fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56c054ea85384ababbd7a271cba9b87c', 'request_id': 'req-4743baa5-51dc-49fe-a154-33533cc9b0fa'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.934113 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4743baa5-51dc-49fe-a154-33533cc9b0fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56c054ea85384ababbd7a271cba9b87c', 'request_id': 'req-4743baa5-51dc-49fe-a154-33533cc9b0fa'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.944683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4743baa5-51dc-49fe-a154-33533cc9b0fa admin admin] The token cache is being invalidate because project 56c054ea85384ababbd7a271cba9b87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:41.944969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4743baa5-51dc-49fe-a154-33533cc9b0fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.945611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4743baa5-51dc-49fe-a154-33533cc9b0fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:41.947095 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1285/2562] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:41 2022] DELETE /identity/v3/projects/56c054ea85384ababbd7a271cba9b87c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:41.952064 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf8b8f-31f7-43c8-a3c0-52f2bae81180 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:41.953480 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c9bf8b8f-31f7-43c8-a3c0-52f2bae81180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:41.967257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf8b8f-31f7-43c8-a3c0-52f2bae81180 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:42.033693 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bc686-ffd4-4115-a1c7-2933ec8477ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:42.034370 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bc686-ffd4-4115-a1c7-2933ec8477ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:42.034650 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bc686-ffd4-4115-a1c7-2933ec8477ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:42.034924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bc686-ffd4-4115-a1c7-2933ec8477ec admin admin] PATH_INFO: `/v3/users/e5a63398ba0749d58fb6b8426f775bda` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:42.036082 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bc686-ffd4-4115-a1c7-2933ec8477ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a63398ba0749d58fb6b8426f775bda)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:42.037994 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2bc686-ffd4-4115-a1c7-2933ec8477ec admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:42.086364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-6a2bc686-ffd4-4115-a1c7-2933ec8477ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a63398ba0749d58fb6b8426f775bda'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.094690 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-6a2bc686-ffd4-4115-a1c7-2933ec8477ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a63398ba0749d58fb6b8426f775bda'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.107355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-6a2bc686-ffd4-4115-a1c7-2933ec8477ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a63398ba0749d58fb6b8426f775bda'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.109398 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:42.115270 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-6a2bc686-ffd4-4115-a1c7-2933ec8477ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a63398ba0749d58fb6b8426f775bda'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.116197 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-6a2bc686-ffd4-4115-a1c7-2933ec8477ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a63398ba0749d58fb6b8426f775bda'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.123105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1278/2563] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:41 2022] DELETE /identity/v3/users/e5a63398ba0749d58fb6b8426f775bda => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:42.296240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743baa5-51dc-49fe-a154-33533cc9b0fa admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:42.297672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4743baa5-51dc-49fe-a154-33533cc9b0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:42.313964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743baa5-51dc-49fe-a154-33533cc9b0fa admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:42.335701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:42.376892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eed64-77a8-4204-be8b-733318534b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:42.377567 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eed64-77a8-4204-be8b-733318534b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:42.377854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eed64-77a8-4204-be8b-733318534b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:42.378122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eed64-77a8-4204-be8b-733318534b39 admin admin] PATH_INFO: `/v3/projects/9784350979e848e2874c8ba459cecd05` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:42.379274 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9eed64-77a8-4204-be8b-733318534b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9784350979e848e2874c8ba459cecd05)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:42.381371 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9eed64-77a8-4204-be8b-733318534b39 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:42.429485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1f9eed64-77a8-4204-be8b-733318534b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9784350979e848e2874c8ba459cecd05', 'request_id': 'req-1f9eed64-77a8-4204-be8b-733318534b39'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.436179 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1f9eed64-77a8-4204-be8b-733318534b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9784350979e848e2874c8ba459cecd05', 'request_id': 'req-1f9eed64-77a8-4204-be8b-733318534b39'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.443398 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1f9eed64-77a8-4204-be8b-733318534b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9784350979e848e2874c8ba459cecd05', 'request_id': 'req-1f9eed64-77a8-4204-be8b-733318534b39'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.453851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1f9eed64-77a8-4204-be8b-733318534b39 admin admin] The token cache is being invalidate because project 9784350979e848e2874c8ba459cecd05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:42.454125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1f9eed64-77a8-4204-be8b-733318534b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.454755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1f9eed64-77a8-4204-be8b-733318534b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:42.456312 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1286/2564] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:42 2022] DELETE /identity/v3/projects/9784350979e848e2874c8ba459cecd05 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:52.121137 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:52.450844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:03.385407 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bc686-ffd4-4115-a1c7-2933ec8477ec admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:03.386843 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6a2bc686-ffd4-4115-a1c7-2933ec8477ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:03.444670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bc686-ffd4-4115-a1c7-2933ec8477ec admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:03.494617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5771c-f56b-40eb-b25b-cfc60f44b236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:03.495227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5771c-f56b-40eb-b25b-cfc60f44b236 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:03.495506 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5771c-f56b-40eb-b25b-cfc60f44b236 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:03.495776 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5771c-f56b-40eb-b25b-cfc60f44b236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:03.497566 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8ef5771c-f56b-40eb-b25b-cfc60f44b236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:03.577908 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5771c-f56b-40eb-b25b-cfc60f44b236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:03.579338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5771c-f56b-40eb-b25b-cfc60f44b236 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:03.598306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1279/2565] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:04.436673 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eed64-77a8-4204-be8b-733318534b39 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:04.438158 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1f9eed64-77a8-4204-be8b-733318534b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:04.520678 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eed64-77a8-4204-be8b-733318534b39 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:04.526782 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b2644-aa18-46b5-9624-142cc4380a14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:04.527597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b2644-aa18-46b5-9624-142cc4380a14 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:04.527717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b2644-aa18-46b5-9624-142cc4380a14 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:04.527971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b2644-aa18-46b5-9624-142cc4380a14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:04.530608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-512b2644-aa18-46b5-9624-142cc4380a14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:04.546112 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b2644-aa18-46b5-9624-142cc4380a14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:04.548032 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b2644-aa18-46b5-9624-142cc4380a14 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:04.561423 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1287/2566] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:04.634222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5771c-f56b-40eb-b25b-cfc60f44b236 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:04.635832 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8ef5771c-f56b-40eb-b25b-cfc60f44b236 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:04.650949 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5771c-f56b-40eb-b25b-cfc60f44b236 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:04.654906 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ec7d4-cad6-4d16-9c18-e8f49a845a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:04.655513 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec7d4-cad6-4d16-9c18-e8f49a845a94 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:04.655795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec7d4-cad6-4d16-9c18-e8f49a845a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:04.656104 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec7d4-cad6-4d16-9c18-e8f49a845a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:04.657799 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e31ec7d4-cad6-4d16-9c18-e8f49a845a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:04.672213 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ec7d4-cad6-4d16-9c18-e8f49a845a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:04.673696 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ec7d4-cad6-4d16-9c18-e8f49a845a94 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:04.685700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1280/2567] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:05.866537 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b2644-aa18-46b5-9624-142cc4380a14 service nova] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:05.876370 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b2644-aa18-46b5-9624-142cc4380a14 service nova] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:05.880243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d5bb1-e6a1-43b5-919a-1769f4761530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:05.881475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d5bb1-e6a1-43b5-919a-1769f4761530 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:05.881755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d5bb1-e6a1-43b5-919a-1769f4761530 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:05.882030 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d5bb1-e6a1-43b5-919a-1769f4761530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:05.883805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d44d5bb1-e6a1-43b5-919a-1769f4761530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:05.897848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d5bb1-e6a1-43b5-919a-1769f4761530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:05.899214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d5bb1-e6a1-43b5-919a-1769f4761530 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:05.910499 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1288/2568] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:13.426702 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ec7d4-cad6-4d16-9c18-e8f49a845a94 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:13.429022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e31ec7d4-cad6-4d16-9c18-e8f49a845a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:13.440074 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ec7d4-cad6-4d16-9c18-e8f49a845a94 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:13.444080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ea7fc-4db1-4eaf-9c32-8e3f2ea95e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:13.444847 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ea7fc-4db1-4eaf-9c32-8e3f2ea95e61 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:13.445260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ea7fc-4db1-4eaf-9c32-8e3f2ea95e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:13.445632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ea7fc-4db1-4eaf-9c32-8e3f2ea95e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:13.447491 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-be7ea7fc-4db1-4eaf-9c32-8e3f2ea95e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:13.477116 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:13.535096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ea7fc-4db1-4eaf-9c32-8e3f2ea95e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:13.536556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ea7fc-4db1-4eaf-9c32-8e3f2ea95e61 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:13.557018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1281/2569] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:15.905442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=40 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:18.159783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d056fd-0c9d-4c2a-8761-ad3c8d4aa8ee None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.160381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d056fd-0c9d-4c2a-8761-ad3c8d4aa8ee None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.160381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d056fd-0c9d-4c2a-8761-ad3c8d4aa8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.191361 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-03d056fd-0c9d-4c2a-8761-ad3c8d4aa8ee None None] MFA Rules not processed for user `53afc903595c4a07a4003f72228a8291`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:18.192568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-03d056fd-0c9d-4c2a-8761-ad3c8d4aa8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:18.200243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1289/2570] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:18.548259 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ea7fc-4db1-4eaf-9c32-8e3f2ea95e61 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:18.558348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ea7fc-4db1-4eaf-9c32-8e3f2ea95e61 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:18.562036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f878408-d767-4c30-94fe-3c423c64a702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:18.562647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f878408-d767-4c30-94fe-3c423c64a702 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.562928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f878408-d767-4c30-94fe-3c423c64a702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.563212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f878408-d767-4c30-94fe-3c423c64a702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.565097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2f878408-d767-4c30-94fe-3c423c64a702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:18.575868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f878408-d767-4c30-94fe-3c423c64a702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:18.577315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f878408-d767-4c30-94fe-3c423c64a702 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:18.586333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1282/2571] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:18.961889 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d056fd-0c9d-4c2a-8761-ad3c8d4aa8ee None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:18.963488 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-03d056fd-0c9d-4c2a-8761-ad3c8d4aa8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:19.055474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d056fd-0c9d-4c2a-8761-ad3c8d4aa8ee None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:19.060526 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403deec2-ff73-4f44-a034-b907bc77dc03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:19.061137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403deec2-ff73-4f44-a034-b907bc77dc03 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:19.061415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403deec2-ff73-4f44-a034-b907bc77dc03 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:19.061686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403deec2-ff73-4f44-a034-b907bc77dc03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:19.063430 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-403deec2-ff73-4f44-a034-b907bc77dc03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:19.075600 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403deec2-ff73-4f44-a034-b907bc77dc03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:19.077223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403deec2-ff73-4f44-a034-b907bc77dc03 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:19.088245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1290/2572] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:20.879561 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f878408-d767-4c30-94fe-3c423c64a702 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:20.891475 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f878408-d767-4c30-94fe-3c423c64a702 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:20.898058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb3216-418d-4b90-9925-822687ebe2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:20.898836 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb3216-418d-4b90-9925-822687ebe2fa service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:20.899589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb3216-418d-4b90-9925-822687ebe2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:20.900558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb3216-418d-4b90-9925-822687ebe2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:20.902537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b5cb3216-418d-4b90-9925-822687ebe2fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:20.915095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb3216-418d-4b90-9925-822687ebe2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:20.916701 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb3216-418d-4b90-9925-822687ebe2fa service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:20.926973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1283/2573] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:26.931029 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403deec2-ff73-4f44-a034-b907bc77dc03 service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:26.932517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-403deec2-ff73-4f44-a034-b907bc77dc03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:26.948298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403deec2-ff73-4f44-a034-b907bc77dc03 service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:26.953726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc2299-4500-46da-abc8-198782bbd5cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:26.954327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc2299-4500-46da-abc8-198782bbd5cb service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:26.954603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc2299-4500-46da-abc8-198782bbd5cb service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:26.954872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc2299-4500-46da-abc8-198782bbd5cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:26.956667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e5bc2299-4500-46da-abc8-198782bbd5cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:26.970139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc2299-4500-46da-abc8-198782bbd5cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:26.971733 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc2299-4500-46da-abc8-198782bbd5cb service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:26.984400 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1291/2574] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:30.922433 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=42 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:31.676305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb3216-418d-4b90-9925-822687ebe2fa service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:31.697784 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb3216-418d-4b90-9925-822687ebe2fa service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:31.704295 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416284d-147b-41f3-b139-c7597acf270a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:31.705149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416284d-147b-41f3-b139-c7597acf270a service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:31.705617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416284d-147b-41f3-b139-c7597acf270a service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:31.706024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416284d-147b-41f3-b139-c7597acf270a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:31.708103 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4416284d-147b-41f3-b139-c7597acf270a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:31.727223 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416284d-147b-41f3-b139-c7597acf270a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:31.728913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416284d-147b-41f3-b139-c7597acf270a service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:31.741290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1284/2575] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:32.889685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa654f09-33e4-4c80-9257-e734ac924e4d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:32.890191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa654f09-33e4-4c80-9257-e734ac924e4d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:32.890289 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa654f09-33e4-4c80-9257-e734ac924e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:32.910111 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-aa654f09-33e4-4c80-9257-e734ac924e4d None None] MFA Rules not processed for user `53afc903595c4a07a4003f72228a8291`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:32.912253 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-aa654f09-33e4-4c80-9257-e734ac924e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:32.919991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1292/2576] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:20:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:41.736141 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:42.905452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=47 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:40.299348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416284d-147b-41f3-b139-c7597acf270a service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:40.301253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4416284d-147b-41f3-b139-c7597acf270a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:40.437514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416284d-147b-41f3-b139-c7597acf270a service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:40.445140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b7011-1744-4fe2-8de7-34268cdb54e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:40.445772 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b7011-1744-4fe2-8de7-34268cdb54e2 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:40.446058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b7011-1744-4fe2-8de7-34268cdb54e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:40.446333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b7011-1744-4fe2-8de7-34268cdb54e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:40.448368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0f5b7011-1744-4fe2-8de7-34268cdb54e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:40.467402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b7011-1744-4fe2-8de7-34268cdb54e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:40.469097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b7011-1744-4fe2-8de7-34268cdb54e2 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:40.481146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1285/2577] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:21:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:21:46.312597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db8e7f-c672-4c1c-8228-e9f2903b2ba6 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:46.313112 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db8e7f-c672-4c1c-8228-e9f2903b2ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:46.313200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db8e7f-c672-4c1c-8228-e9f2903b2ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:46.333385 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-08db8e7f-c672-4c1c-8228-e9f2903b2ba6 None None] MFA Rules not processed for user `53afc903595c4a07a4003f72228a8291`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:46.334611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-08db8e7f-c672-4c1c-8228-e9f2903b2ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:46.341845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1293/2578] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:50.475711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=37 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:56.327655 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:07.515381 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b7011-1744-4fe2-8de7-34268cdb54e2 service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:07.526731 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b7011-1744-4fe2-8de7-34268cdb54e2 service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:07.531737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc3ad4-304b-44a1-a073-39a5c2898c9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:07.532362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc3ad4-304b-44a1-a073-39a5c2898c9f service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:07.532645 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc3ad4-304b-44a1-a073-39a5c2898c9f service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:07.533027 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc3ad4-304b-44a1-a073-39a5c2898c9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:07.535608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5ccc3ad4-304b-44a1-a073-39a5c2898c9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:07.547208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc3ad4-304b-44a1-a073-39a5c2898c9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:07.548954 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc3ad4-304b-44a1-a073-39a5c2898c9f service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:07.559057 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1286/2579] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:17.554852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:42.845112 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db8e7f-c672-4c1c-8228-e9f2903b2ba6 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:42.846515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-08db8e7f-c672-4c1c-8228-e9f2903b2ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:42.950743 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db8e7f-c672-4c1c-8228-e9f2903b2ba6 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:42.955793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178a196-d857-4268-900f-7e49bc8cc549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:42.956442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178a196-d857-4268-900f-7e49bc8cc549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:42.956716 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178a196-d857-4268-900f-7e49bc8cc549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:42.956984 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178a196-d857-4268-900f-7e49bc8cc549 admin admin] PATH_INFO: `/v3/users/53afc903595c4a07a4003f72228a8291` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:42.958098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178a196-d857-4268-900f-7e49bc8cc549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53afc903595c4a07a4003f72228a8291)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:42.960036 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178a196-d857-4268-900f-7e49bc8cc549 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:43.007038 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6178a196-d857-4268-900f-7e49bc8cc549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53afc903595c4a07a4003f72228a8291'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.015171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6178a196-d857-4268-900f-7e49bc8cc549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53afc903595c4a07a4003f72228a8291'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.027373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6178a196-d857-4268-900f-7e49bc8cc549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53afc903595c4a07a4003f72228a8291'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.028031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6178a196-d857-4268-900f-7e49bc8cc549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53afc903595c4a07a4003f72228a8291'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.028633 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-6178a196-d857-4268-900f-7e49bc8cc549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53afc903595c4a07a4003f72228a8291'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.041201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1294/2580] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:22:42 2022] DELETE /identity/v3/users/53afc903595c4a07a4003f72228a8291 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:22:43.046265 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3c006-9d09-4584-8d17-96bda99d5b97 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:43.046747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3c006-9d09-4584-8d17-96bda99d5b97 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:43.046849 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3c006-9d09-4584-8d17-96bda99d5b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:43.076094 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-34a3c006-9d09-4584-8d17-96bda99d5b97 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:43.077364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-34a3c006-9d09-4584-8d17-96bda99d5b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:43.145959 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1287/2581] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:43.154344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178a196-d857-4268-900f-7e49bc8cc549 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:43.155775 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-6178a196-d857-4268-900f-7e49bc8cc549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:43.214547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:43.239174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178a196-d857-4268-900f-7e49bc8cc549 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:43.242891 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723616a-7d93-4f18-b877-04bf76238bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:43.243490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723616a-7d93-4f18-b877-04bf76238bfa service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:43.243772 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723616a-7d93-4f18-b877-04bf76238bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:43.244079 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723616a-7d93-4f18-b877-04bf76238bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:43.253117 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723616a-7d93-4f18-b877-04bf76238bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:43.254533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723616a-7d93-4f18-b877-04bf76238bfa service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:43.263925 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1295/2582] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:43.434438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3c006-9d09-4584-8d17-96bda99d5b97 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:43.436952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-34a3c006-9d09-4584-8d17-96bda99d5b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:43.449585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3c006-9d09-4584-8d17-96bda99d5b97 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:43.454763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715b937-1404-414a-a3ff-7ebea2011e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:43.455337 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715b937-1404-414a-a3ff-7ebea2011e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:43.455617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715b937-1404-414a-a3ff-7ebea2011e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:43.455886 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715b937-1404-414a-a3ff-7ebea2011e98 admin admin] PATH_INFO: `/v3/projects/902cfe4a1a854c3aad6e64cc9fb4549f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:43.457035 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715b937-1404-414a-a3ff-7ebea2011e98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=902cfe4a1a854c3aad6e64cc9fb4549f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:43.458927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715b937-1404-414a-a3ff-7ebea2011e98 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:43.509415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e715b937-1404-414a-a3ff-7ebea2011e98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902cfe4a1a854c3aad6e64cc9fb4549f', 'request_id': 'req-e715b937-1404-414a-a3ff-7ebea2011e98'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.516880 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e715b937-1404-414a-a3ff-7ebea2011e98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902cfe4a1a854c3aad6e64cc9fb4549f', 'request_id': 'req-e715b937-1404-414a-a3ff-7ebea2011e98'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.527769 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e715b937-1404-414a-a3ff-7ebea2011e98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902cfe4a1a854c3aad6e64cc9fb4549f', 'request_id': 'req-e715b937-1404-414a-a3ff-7ebea2011e98'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.539422 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e715b937-1404-414a-a3ff-7ebea2011e98 admin admin] The token cache is being invalidate because project 902cfe4a1a854c3aad6e64cc9fb4549f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:22:43.539711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e715b937-1404-414a-a3ff-7ebea2011e98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.540360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e715b937-1404-414a-a3ff-7ebea2011e98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.541850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1288/2583] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:22:43 2022] DELETE /identity/v3/projects/902cfe4a1a854c3aad6e64cc9fb4549f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:22:43.546122 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723616a-7d93-4f18-b877-04bf76238bfa service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:43.555890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723616a-7d93-4f18-b877-04bf76238bfa service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:43.611713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95950c-0f3e-41bb-aa89-1429f287a4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:43.612420 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95950c-0f3e-41bb-aa89-1429f287a4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:43.612702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95950c-0f3e-41bb-aa89-1429f287a4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:43.612976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95950c-0f3e-41bb-aa89-1429f287a4e3 admin admin] PATH_INFO: `/v3/users/ee474d3c46a542319ed22abb25d7ecfe` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:43.614096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95950c-0f3e-41bb-aa89-1429f287a4e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee474d3c46a542319ed22abb25d7ecfe)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:43.616045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95950c-0f3e-41bb-aa89-1429f287a4e3 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:43.663809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4c95950c-0f3e-41bb-aa89-1429f287a4e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee474d3c46a542319ed22abb25d7ecfe'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.671214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4c95950c-0f3e-41bb-aa89-1429f287a4e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee474d3c46a542319ed22abb25d7ecfe'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.683815 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4c95950c-0f3e-41bb-aa89-1429f287a4e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee474d3c46a542319ed22abb25d7ecfe'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.684515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4c95950c-0f3e-41bb-aa89-1429f287a4e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee474d3c46a542319ed22abb25d7ecfe'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.685124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-4c95950c-0f3e-41bb-aa89-1429f287a4e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee474d3c46a542319ed22abb25d7ecfe'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.698341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1296/2584] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:22:43 2022] DELETE /identity/v3/users/ee474d3c46a542319ed22abb25d7ecfe => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:22:43.973609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715b937-1404-414a-a3ff-7ebea2011e98 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:43.974997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e715b937-1404-414a-a3ff-7ebea2011e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:43.990866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715b937-1404-414a-a3ff-7ebea2011e98 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:44.048657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54b4f8-66e7-436c-b73e-0ed9db45c0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:44.049276 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54b4f8-66e7-436c-b73e-0ed9db45c0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:44.049548 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54b4f8-66e7-436c-b73e-0ed9db45c0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:44.049816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54b4f8-66e7-436c-b73e-0ed9db45c0cb admin admin] PATH_INFO: `/v3/projects/7652bf25dfb744898b491b8feb984d45` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:44.050916 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54b4f8-66e7-436c-b73e-0ed9db45c0cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7652bf25dfb744898b491b8feb984d45)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:44.052868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54b4f8-66e7-436c-b73e-0ed9db45c0cb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:44.073158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:44.099061 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bf54b4f8-66e7-436c-b73e-0ed9db45c0cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7652bf25dfb744898b491b8feb984d45', 'request_id': 'req-bf54b4f8-66e7-436c-b73e-0ed9db45c0cb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:44.105513 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bf54b4f8-66e7-436c-b73e-0ed9db45c0cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7652bf25dfb744898b491b8feb984d45', 'request_id': 'req-bf54b4f8-66e7-436c-b73e-0ed9db45c0cb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:44.113030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bf54b4f8-66e7-436c-b73e-0ed9db45c0cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7652bf25dfb744898b491b8feb984d45', 'request_id': 'req-bf54b4f8-66e7-436c-b73e-0ed9db45c0cb'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:44.123952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bf54b4f8-66e7-436c-b73e-0ed9db45c0cb admin admin] The token cache is being invalidate because project 7652bf25dfb744898b491b8feb984d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:22:44.124245 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bf54b4f8-66e7-436c-b73e-0ed9db45c0cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:44.124875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bf54b4f8-66e7-436c-b73e-0ed9db45c0cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:44.126388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1289/2585] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:22:43 2022] DELETE /identity/v3/projects/7652bf25dfb744898b491b8feb984d45 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:22:50.012771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94524bb-9e2c-45dd-92a0-997cc35911bb None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.013330 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94524bb-9e2c-45dd-92a0-997cc35911bb None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.013330 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94524bb-9e2c-45dd-92a0-997cc35911bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:50.054541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-b94524bb-9e2c-45dd-92a0-997cc35911bb None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:50.055755 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b94524bb-9e2c-45dd-92a0-997cc35911bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:50.088588 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:50.116776 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1297/2586] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:50.126502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b94a8-1cbf-4344-a82e-cfb6841240e7 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.126967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b94a8-1cbf-4344-a82e-cfb6841240e7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.127076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b94a8-1cbf-4344-a82e-cfb6841240e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:50.146756 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d24b94a8-1cbf-4344-a82e-cfb6841240e7 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:50.148001 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d24b94a8-1cbf-4344-a82e-cfb6841240e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:50.155763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1290/2587] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:50.161078 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94524bb-9e2c-45dd-92a0-997cc35911bb None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:50.171137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94524bb-9e2c-45dd-92a0-997cc35911bb None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:50.175828 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112171a-88cb-48cb-99a5-f802da72ae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:50.176449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112171a-88cb-48cb-99a5-f802da72ae6d admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.176727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112171a-88cb-48cb-99a5-f802da72ae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.176995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112171a-88cb-48cb-99a5-f802da72ae6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:50.177667 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112171a-88cb-48cb-99a5-f802da72ae6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:22:50.177964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112171a-88cb-48cb-99a5-f802da72ae6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:50.179541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112171a-88cb-48cb-99a5-f802da72ae6d admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:50.191423 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1298/2588] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:22:50.199284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b94a8-1cbf-4344-a82e-cfb6841240e7 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:50.208954 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b94a8-1cbf-4344-a82e-cfb6841240e7 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:50.213592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f0a89-0edf-42f7-b3cb-ea940dfea0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:50.214186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f0a89-0edf-42f7-b3cb-ea940dfea0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.214466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f0a89-0edf-42f7-b3cb-ea940dfea0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.214733 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f0a89-0edf-42f7-b3cb-ea940dfea0b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:50.215349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f0a89-0edf-42f7-b3cb-ea940dfea0b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:50.217280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f0a89-0edf-42f7-b3cb-ea940dfea0b0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:50.257249 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1291/2589] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:22:50 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:22:50.261551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112171a-88cb-48cb-99a5-f802da72ae6d admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:50.271512 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112171a-88cb-48cb-99a5-f802da72ae6d admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:50.326794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e62cc-10c0-49bb-bfa9-458d314bb256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:50.327380 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e62cc-10c0-49bb-bfa9-458d314bb256 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.327658 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e62cc-10c0-49bb-bfa9-458d314bb256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.327953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e62cc-10c0-49bb-bfa9-458d314bb256 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:50.329096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e62cc-10c0-49bb-bfa9-458d314bb256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:50.331137 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e62cc-10c0-49bb-bfa9-458d314bb256 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:50.352766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1299/2590] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:22:50 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:22:50.356951 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f0a89-0edf-42f7-b3cb-ea940dfea0b0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:50.367412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f0a89-0edf-42f7-b3cb-ea940dfea0b0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:50.372087 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d087365-a045-463d-a2f4-279c4d3041ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:50.372683 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d087365-a045-463d-a2f4-279c4d3041ee admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.372964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d087365-a045-463d-a2f4-279c4d3041ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.373236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d087365-a045-463d-a2f4-279c4d3041ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:50.373873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d087365-a045-463d-a2f4-279c4d3041ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:50.375823 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d087365-a045-463d-a2f4-279c4d3041ee admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:50.385663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1292/2591] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:22:50.389456 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e62cc-10c0-49bb-bfa9-458d314bb256 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:50.400683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e62cc-10c0-49bb-bfa9-458d314bb256 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:50.405258 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218ec87-c6c5-4cad-93e8-e03f4f07e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:50.405845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218ec87-c6c5-4cad-93e8-e03f4f07e72f admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.406112 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218ec87-c6c5-4cad-93e8-e03f4f07e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.406379 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218ec87-c6c5-4cad-93e8-e03f4f07e72f admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:50.407919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218ec87-c6c5-4cad-93e8-e03f4f07e72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:50.409496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218ec87-c6c5-4cad-93e8-e03f4f07e72f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:50.420077 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1300/2592] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:22:50.424164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d087365-a045-463d-a2f4-279c4d3041ee admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:50.434078 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d087365-a045-463d-a2f4-279c4d3041ee admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:50.439467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3bd47-8dd6-4488-9f72-253d84eeb9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:50.440164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3bd47-8dd6-4488-9f72-253d84eeb9df admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.440518 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3bd47-8dd6-4488-9f72-253d84eeb9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.440717 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3bd47-8dd6-4488-9f72-253d84eeb9df admin admin] PATH_INFO: `/v3/projects/3b07ce2650e647a18fb3b600c318d26e/users/f035f18dae494fbdb08e0da6144ab542/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:50.457603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3bd47-8dd6-4488-9f72-253d84eeb9df admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b07ce2650e647a18fb3b600c318d26e, user_id=f035f18dae494fbdb08e0da6144ab542, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:50.460331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3bd47-8dd6-4488-9f72-253d84eeb9df admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:50.473904 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1293/2593] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:22:50 2022] PUT /identity/v3/projects/3b07ce2650e647a18fb3b600c318d26e/users/f035f18dae494fbdb08e0da6144ab542/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:22:50.487595 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019b2d2-790b-4e58-89ed-d45271f1b8e0 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.487875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019b2d2-790b-4e58-89ed-d45271f1b8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.488250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019b2d2-790b-4e58-89ed-d45271f1b8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:50.516597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-a019b2d2-790b-4e58-89ed-d45271f1b8e0 None None] MFA Rules not processed for user `f035f18dae494fbdb08e0da6144ab542`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:50.517832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a019b2d2-790b-4e58-89ed-d45271f1b8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:50.581272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1301/2594] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:22:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:50.585632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3bd47-8dd6-4488-9f72-253d84eeb9df admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:50.647640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3bd47-8dd6-4488-9f72-253d84eeb9df admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:50.652280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc6076-3e81-4fe7-b6fa-f102a8d3559c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:50.652877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc6076-3e81-4fe7-b6fa-f102a8d3559c admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.653153 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc6076-3e81-4fe7-b6fa-f102a8d3559c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.653423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc6076-3e81-4fe7-b6fa-f102a8d3559c admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:50.654042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc6076-3e81-4fe7-b6fa-f102a8d3559c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:50.655940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc6076-3e81-4fe7-b6fa-f102a8d3559c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:50.683400 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1294/2595] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:22:50 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:22:50.687267 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019b2d2-790b-4e58-89ed-d45271f1b8e0 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:50.698162 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019b2d2-790b-4e58-89ed-d45271f1b8e0 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:50.728005 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:50.755047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e6b25-86f5-4de5-a2cf-1a4d6f6b3300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:50.755653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e6b25-86f5-4de5-a2cf-1a4d6f6b3300 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.755965 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e6b25-86f5-4de5-a2cf-1a4d6f6b3300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.756246 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e6b25-86f5-4de5-a2cf-1a4d6f6b3300 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:50.756880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e6b25-86f5-4de5-a2cf-1a4d6f6b3300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:50.758825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e6b25-86f5-4de5-a2cf-1a4d6f6b3300 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:50.779779 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1302/2596] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:22:50 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:22:50.783796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc6076-3e81-4fe7-b6fa-f102a8d3559c admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:50.794421 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc6076-3e81-4fe7-b6fa-f102a8d3559c admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:50.799233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95943e9-66f6-43c2-81b5-bf7fba76d997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:50.799836 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95943e9-66f6-43c2-81b5-bf7fba76d997 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.800163 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95943e9-66f6-43c2-81b5-bf7fba76d997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.800452 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95943e9-66f6-43c2-81b5-bf7fba76d997 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:50.801081 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95943e9-66f6-43c2-81b5-bf7fba76d997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:50.802752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95943e9-66f6-43c2-81b5-bf7fba76d997 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:50.813892 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1295/2597] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:22:50.817948 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e6b25-86f5-4de5-a2cf-1a4d6f6b3300 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:50.827865 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e6b25-86f5-4de5-a2cf-1a4d6f6b3300 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:50.833440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c1f12-b15c-4946-a719-fddc7b676cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:50.834021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c1f12-b15c-4946-a719-fddc7b676cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.834306 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c1f12-b15c-4946-a719-fddc7b676cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.834583 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c1f12-b15c-4946-a719-fddc7b676cf4 admin admin] PATH_INFO: `/v3/projects/54ac6e32e001497bbe09ea24c3953fe4/users/108a58168e784b7581a685c42cf9c459/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:50.849731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c1f12-b15c-4946-a719-fddc7b676cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ac6e32e001497bbe09ea24c3953fe4, user_id=108a58168e784b7581a685c42cf9c459, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:50.852499 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c1f12-b15c-4946-a719-fddc7b676cf4 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:50.865953 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1303/2598] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:22:50 2022] PUT /identity/v3/projects/54ac6e32e001497bbe09ea24c3953fe4/users/108a58168e784b7581a685c42cf9c459/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:22:50.869763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95943e9-66f6-43c2-81b5-bf7fba76d997 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:50.880378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95943e9-66f6-43c2-81b5-bf7fba76d997 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:50.885120 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:50.939007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f0162-fe98-4a06-a7b3-41d3da42ebd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:50.939636 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f0162-fe98-4a06-a7b3-41d3da42ebd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.939941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f0162-fe98-4a06-a7b3-41d3da42ebd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.940222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f0162-fe98-4a06-a7b3-41d3da42ebd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:50.940863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f0162-fe98-4a06-a7b3-41d3da42ebd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:50.942450 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f0162-fe98-4a06-a7b3-41d3da42ebd1 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:50.952178 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1296/2599] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:22:50.956910 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c1f12-b15c-4946-a719-fddc7b676cf4 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:50.967269 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c1f12-b15c-4946-a719-fddc7b676cf4 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:50.972256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed7b5a-f51d-4ade-a44f-c149db6238c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:50.972912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed7b5a-f51d-4ade-a44f-c149db6238c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.973193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed7b5a-f51d-4ade-a44f-c149db6238c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.973483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed7b5a-f51d-4ade-a44f-c149db6238c8 admin admin] PATH_INFO: `/v3/projects/54ac6e32e001497bbe09ea24c3953fe4/users/108a58168e784b7581a685c42cf9c459/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:50.975423 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed7b5a-f51d-4ade-a44f-c149db6238c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ac6e32e001497bbe09ea24c3953fe4, user_id=108a58168e784b7581a685c42cf9c459, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:50.978089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed7b5a-f51d-4ade-a44f-c149db6238c8 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:50.989029 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1304/2600] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:22:50 2022] PUT /identity/v3/projects/54ac6e32e001497bbe09ea24c3953fe4/users/108a58168e784b7581a685c42cf9c459/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:22:50.999046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269869da-e976-4e84-aaa5-e661394a71e3 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:50.999341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269869da-e976-4e84-aaa5-e661394a71e3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:50.999621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269869da-e976-4e84-aaa5-e661394a71e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:51.027433 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-269869da-e976-4e84-aaa5-e661394a71e3 None None] MFA Rules not processed for user `108a58168e784b7581a685c42cf9c459`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:51.028695 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-269869da-e976-4e84-aaa5-e661394a71e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:51.097398 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1297/2601] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:22:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:51.109212 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06012aa-d3e4-4a90-8cef-6b7e805744de None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:51.109687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06012aa-d3e4-4a90-8cef-6b7e805744de None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:51.109851 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06012aa-d3e4-4a90-8cef-6b7e805744de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:51.128688 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-d06012aa-d3e4-4a90-8cef-6b7e805744de None None] MFA Rules not processed for user `f035f18dae494fbdb08e0da6144ab542`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:51.129893 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d06012aa-d3e4-4a90-8cef-6b7e805744de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:51.184388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1305/2602] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:22:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:51.197876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269869da-e976-4e84-aaa5-e661394a71e3 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:51.199533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-269869da-e976-4e84-aaa5-e661394a71e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:51.273231 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269869da-e976-4e84-aaa5-e661394a71e3 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:51.278791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378b00-60d4-4220-b524-159833289a4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:51.279393 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378b00-60d4-4220-b524-159833289a4c service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:51.279675 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378b00-60d4-4220-b524-159833289a4c service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:51.279986 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378b00-60d4-4220-b524-159833289a4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:51.288579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f378b00-60d4-4220-b524-159833289a4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:51.290153 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f378b00-60d4-4220-b524-159833289a4c service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:51.299877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1298/2603] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:01.177615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=54,keystone:INSERT=5 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:01.295159 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=93 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:06.788108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06012aa-d3e4-4a90-8cef-6b7e805744de None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:06.789561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d06012aa-d3e4-4a90-8cef-6b7e805744de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:06.806308 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06012aa-d3e4-4a90-8cef-6b7e805744de None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:06.811926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b6dd3-1d4d-4a71-b2d4-10b0490216a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:06.812561 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b6dd3-1d4d-4a71-b2d4-10b0490216a6 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:06.812881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b6dd3-1d4d-4a71-b2d4-10b0490216a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:06.813151 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b6dd3-1d4d-4a71-b2d4-10b0490216a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:06.821844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b6dd3-1d4d-4a71-b2d4-10b0490216a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:06.823469 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b6dd3-1d4d-4a71-b2d4-10b0490216a6 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:06.833921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1306/2604] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:06 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:06.851039 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed8fe4-3601-4e65-9b37-25df6903f3d6 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:06.851533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed8fe4-3601-4e65-9b37-25df6903f3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:06.851627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed8fe4-3601-4e65-9b37-25df6903f3d6 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:06.852985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1299/2605] 10.222.0.20 () {54 vars in 912 bytes} [Sun Aug 7 01:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:23:06.857613 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b6dd3-1d4d-4a71-b2d4-10b0490216a6 service nova] Authenticating service token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:23:06.869191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-f93b6dd3-1d4d-4a71-b2d4-10b0490216a6 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 07 01:23:06.869443 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b6dd3-1d4d-4a71-b2d4-10b0490216a6 service nova] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:06.877885 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b6dd3-1d4d-4a71-b2d4-10b0490216a6 service nova] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:06.882540 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809a21e-e812-4650-a9ec-4a24bc5d92b6 tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108a58168e784b7581a685c42cf9c459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ac6e32e001497bbe09ea24c3953fe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:06.883174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809a21e-e812-4650-a9ec-4a24bc5d92b6 tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:06.883458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809a21e-e812-4650-a9ec-4a24bc5d92b6 tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:06.883741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809a21e-e812-4650-a9ec-4a24bc5d92b6 tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] PATH_INFO: `/v3/projects/54ac6e32e001497bbe09ea24c3953fe4` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:06.884918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809a21e-e812-4650-a9ec-4a24bc5d92b6 tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] RBAC: Authorizing `identity:get_project(project_id=54ac6e32e001497bbe09ea24c3953fe4)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:06.886705 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809a21e-e812-4650-a9ec-4a24bc5d92b6 tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:06.888405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1307/2606] 10.222.0.20 () {58 vars in 1443 bytes} [Sun Aug 7 01:23:06 2022] GET /identity/v3/projects/54ac6e32e001497bbe09ea24c3953fe4 => generated 393 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:07.241474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a918f73-70fd-4407-8aa2-32e2761459e1 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:07.241758 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a918f73-70fd-4407-8aa2-32e2761459e1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:07.242027 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a918f73-70fd-4407-8aa2-32e2761459e1 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:07.243387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1300/2607] 10.222.0.20 () {54 vars in 912 bytes} [Sun Aug 7 01:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:23:07.248222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809a21e-e812-4650-a9ec-4a24bc5d92b6 tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] Authenticating service token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:23:07.260865 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809a21e-e812-4650-a9ec-4a24bc5d92b6 tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:07.269297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809a21e-e812-4650-a9ec-4a24bc5d92b6 tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:07.273680 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260b386-b9cb-4a3e-b024-9624b137d1cb tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '108a58168e784b7581a685c42cf9c459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ac6e32e001497bbe09ea24c3953fe4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:07.274288 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b386-b9cb-4a3e-b024-9624b137d1cb tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:07.274567 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b386-b9cb-4a3e-b024-9624b137d1cb tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:07.274839 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b386-b9cb-4a3e-b024-9624b137d1cb tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] PATH_INFO: `/v3/projects/54ac6e32e001497bbe09ea24c3953fe4` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:07.275965 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260b386-b9cb-4a3e-b024-9624b137d1cb tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] RBAC: Authorizing `identity:get_project(project_id=54ac6e32e001497bbe09ea24c3953fe4)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:07.277729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260b386-b9cb-4a3e-b024-9624b137d1cb tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:07.279308 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1308/2608] 10.222.0.20 () {58 vars in 1443 bytes} [Sun Aug 7 01:23:07 2022] GET /identity/v3/projects/54ac6e32e001497bbe09ea24c3953fe4 => generated 393 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:07.447004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a918f73-70fd-4407-8aa2-32e2761459e1 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:07.448857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5a918f73-70fd-4407-8aa2-32e2761459e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:07.507694 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a918f73-70fd-4407-8aa2-32e2761459e1 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:07.511136 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a7663-51d3-459c-92c4-1d73cd055fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:07.511727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a7663-51d3-459c-92c4-1d73cd055fff service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:07.512028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a7663-51d3-459c-92c4-1d73cd055fff service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:07.512304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a7663-51d3-459c-92c4-1d73cd055fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:07.513997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-547a7663-51d3-459c-92c4-1d73cd055fff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:07.523733 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a7663-51d3-459c-92c4-1d73cd055fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:07.525171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a7663-51d3-459c-92c4-1d73cd055fff service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:07.533190 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1301/2609] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:11.318882 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260b386-b9cb-4a3e-b024-9624b137d1cb tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:11.384259 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260b386-b9cb-4a3e-b024-9624b137d1cb tempest-ServersAdminNegativeTestJSON-1786091157 tempest-ServersAdminNegativeTestJSON-1786091157-project-admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:11.389571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f15c0-541c-4b84-be81-19f7f0f99a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:11.390725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f15c0-541c-4b84-be81-19f7f0f99a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:11.391199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f15c0-541c-4b84-be81-19f7f0f99a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:11.391546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f15c0-541c-4b84-be81-19f7f0f99a9f admin admin] PATH_INFO: `/v3/users/f035f18dae494fbdb08e0da6144ab542` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:11.392752 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f15c0-541c-4b84-be81-19f7f0f99a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f035f18dae494fbdb08e0da6144ab542)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:11.395335 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f15c0-541c-4b84-be81-19f7f0f99a9f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:11.459133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1b3f15c0-541c-4b84-be81-19f7f0f99a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f035f18dae494fbdb08e0da6144ab542'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:11.468643 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1b3f15c0-541c-4b84-be81-19f7f0f99a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f035f18dae494fbdb08e0da6144ab542'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:11.488521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1b3f15c0-541c-4b84-be81-19f7f0f99a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f035f18dae494fbdb08e0da6144ab542'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:11.489249 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1b3f15c0-541c-4b84-be81-19f7f0f99a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f035f18dae494fbdb08e0da6144ab542'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:11.489845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1b3f15c0-541c-4b84-be81-19f7f0f99a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f035f18dae494fbdb08e0da6144ab542'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:11.504918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1309/2610] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:23:11 2022] DELETE /identity/v3/users/f035f18dae494fbdb08e0da6144ab542 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:11.512848 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac2e05-5c1b-4a04-87e3-a95b6f346589 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:11.514408 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac2e05-5c1b-4a04-87e3-a95b6f346589 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:11.514408 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac2e05-5c1b-4a04-87e3-a95b6f346589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:11.533922 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f0ac2e05-5c1b-4a04-87e3-a95b6f346589 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:11.535150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f0ac2e05-5c1b-4a04-87e3-a95b6f346589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:11.601873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1302/2611] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:11.612026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f15c0-541c-4b84-be81-19f7f0f99a9f admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:11.613513 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1b3f15c0-541c-4b84-be81-19f7f0f99a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:11.673617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:11.679391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f15c0-541c-4b84-be81-19f7f0f99a9f admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:11.684838 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d8a2b-6047-4873-a299-9cab38d963c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:11.685467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d8a2b-6047-4873-a299-9cab38d963c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:11.685937 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d8a2b-6047-4873-a299-9cab38d963c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:11.686357 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d8a2b-6047-4873-a299-9cab38d963c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:11.699141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d8a2b-6047-4873-a299-9cab38d963c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:11.700670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d8a2b-6047-4873-a299-9cab38d963c2 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:11.711660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1310/2612] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:11.894792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac2e05-5c1b-4a04-87e3-a95b6f346589 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:11.896352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f0ac2e05-5c1b-4a04-87e3-a95b6f346589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:11.910109 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac2e05-5c1b-4a04-87e3-a95b6f346589 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:11.914806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfe43d-94c4-44e4-b1dd-61b661da14c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:11.915450 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfe43d-94c4-44e4-b1dd-61b661da14c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:11.916093 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfe43d-94c4-44e4-b1dd-61b661da14c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:11.916093 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfe43d-94c4-44e4-b1dd-61b661da14c9 admin admin] PATH_INFO: `/v3/projects/3b07ce2650e647a18fb3b600c318d26e` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:11.917930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfe43d-94c4-44e4-b1dd-61b661da14c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b07ce2650e647a18fb3b600c318d26e)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:11.922065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfe43d-94c4-44e4-b1dd-61b661da14c9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:11.982499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-56dfe43d-94c4-44e4-b1dd-61b661da14c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b07ce2650e647a18fb3b600c318d26e', 'request_id': 'req-56dfe43d-94c4-44e4-b1dd-61b661da14c9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:11.993228 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-56dfe43d-94c4-44e4-b1dd-61b661da14c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b07ce2650e647a18fb3b600c318d26e', 'request_id': 'req-56dfe43d-94c4-44e4-b1dd-61b661da14c9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:12.003194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-56dfe43d-94c4-44e4-b1dd-61b661da14c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b07ce2650e647a18fb3b600c318d26e', 'request_id': 'req-56dfe43d-94c4-44e4-b1dd-61b661da14c9'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:12.014891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-56dfe43d-94c4-44e4-b1dd-61b661da14c9 admin admin] The token cache is being invalidate because project 3b07ce2650e647a18fb3b600c318d26e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:12.015180 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-56dfe43d-94c4-44e4-b1dd-61b661da14c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:12.015825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-56dfe43d-94c4-44e4-b1dd-61b661da14c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:12.017354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1303/2613] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:11 2022] DELETE /identity/v3/projects/3b07ce2650e647a18fb3b600c318d26e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:12.022292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d8a2b-6047-4873-a299-9cab38d963c2 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:12.033657 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d8a2b-6047-4873-a299-9cab38d963c2 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:12.094435 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d871df4-ebb4-490c-9a22-079b260e232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:12.095066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d871df4-ebb4-490c-9a22-079b260e232e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:12.095348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d871df4-ebb4-490c-9a22-079b260e232e admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:12.095621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d871df4-ebb4-490c-9a22-079b260e232e admin admin] PATH_INFO: `/v3/users/108a58168e784b7581a685c42cf9c459` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:12.096812 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d871df4-ebb4-490c-9a22-079b260e232e admin admin] RBAC: Authorizing `identity:delete_user(user_id=108a58168e784b7581a685c42cf9c459)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:12.098749 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d871df4-ebb4-490c-9a22-079b260e232e admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:12.145106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1d871df4-ebb4-490c-9a22-079b260e232e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '108a58168e784b7581a685c42cf9c459'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:12.152641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1d871df4-ebb4-490c-9a22-079b260e232e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '108a58168e784b7581a685c42cf9c459'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:12.164563 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1d871df4-ebb4-490c-9a22-079b260e232e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '108a58168e784b7581a685c42cf9c459'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:12.165222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1d871df4-ebb4-490c-9a22-079b260e232e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '108a58168e784b7581a685c42cf9c459'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:12.165824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-1d871df4-ebb4-490c-9a22-079b260e232e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '108a58168e784b7581a685c42cf9c459'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:12.178599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1311/2614] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:23:12 2022] DELETE /identity/v3/users/108a58168e784b7581a685c42cf9c459 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:12.467660 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfe43d-94c4-44e4-b1dd-61b661da14c9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:12.469633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-56dfe43d-94c4-44e4-b1dd-61b661da14c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:12.484832 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfe43d-94c4-44e4-b1dd-61b661da14c9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:12.512065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:12.550279 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4319f-cef3-4021-9d56-f61c40109f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:12.550933 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4319f-cef3-4021-9d56-f61c40109f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:12.551181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4319f-cef3-4021-9d56-f61c40109f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:12.551451 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4319f-cef3-4021-9d56-f61c40109f8e admin admin] PATH_INFO: `/v3/projects/54ac6e32e001497bbe09ea24c3953fe4` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:12.552591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4319f-cef3-4021-9d56-f61c40109f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ac6e32e001497bbe09ea24c3953fe4)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:12.554476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4319f-cef3-4021-9d56-f61c40109f8e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:12.600899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f3e4319f-cef3-4021-9d56-f61c40109f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ac6e32e001497bbe09ea24c3953fe4', 'request_id': 'req-f3e4319f-cef3-4021-9d56-f61c40109f8e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:12.607035 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f3e4319f-cef3-4021-9d56-f61c40109f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ac6e32e001497bbe09ea24c3953fe4', 'request_id': 'req-f3e4319f-cef3-4021-9d56-f61c40109f8e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:12.616233 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f3e4319f-cef3-4021-9d56-f61c40109f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ac6e32e001497bbe09ea24c3953fe4', 'request_id': 'req-f3e4319f-cef3-4021-9d56-f61c40109f8e'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:12.627027 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f3e4319f-cef3-4021-9d56-f61c40109f8e admin admin] The token cache is being invalidate because project 54ac6e32e001497bbe09ea24c3953fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:12.627313 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f3e4319f-cef3-4021-9d56-f61c40109f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:12.627966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f3e4319f-cef3-4021-9d56-f61c40109f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:12.629442 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1304/2615] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:12 2022] DELETE /identity/v3/projects/54ac6e32e001497bbe09ea24c3953fe4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:23:12.636327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963194d-4954-4730-a86d-9871d383930f None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:12.636825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963194d-4954-4730-a86d-9871d383930f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:12.636928 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963194d-4954-4730-a86d-9871d383930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:12.657753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5963194d-4954-4730-a86d-9871d383930f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:12.658946 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5963194d-4954-4730-a86d-9871d383930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:12.723854 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1312/2616] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:12.733102 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d779a-ea2d-4b91-afcc-ef9593236611 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:12.733387 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d779a-ea2d-4b91-afcc-ef9593236611 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:12.733706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d779a-ea2d-4b91-afcc-ef9593236611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:12.754189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a29d779a-ea2d-4b91-afcc-ef9593236611 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:12.755556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a29d779a-ea2d-4b91-afcc-ef9593236611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:12.764034 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1305/2617] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:12.769003 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963194d-4954-4730-a86d-9871d383930f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:12.778656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963194d-4954-4730-a86d-9871d383930f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:12.783887 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26cb7d-1092-404f-8286-f355c5435702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:12.784502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26cb7d-1092-404f-8286-f355c5435702 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:12.784796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26cb7d-1092-404f-8286-f355c5435702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:12.785046 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26cb7d-1092-404f-8286-f355c5435702 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:12.785714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26cb7d-1092-404f-8286-f355c5435702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:23:12.786011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26cb7d-1092-404f-8286-f355c5435702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:12.787624 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26cb7d-1092-404f-8286-f355c5435702 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:12.794535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:12.800884 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1313/2618] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:12.805445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d779a-ea2d-4b91-afcc-ef9593236611 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:12.815130 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d779a-ea2d-4b91-afcc-ef9593236611 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:12.820083 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058ab79-9168-414d-a2cc-0f001dc7d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:12.820674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ab79-9168-414d-a2cc-0f001dc7d381 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:12.821003 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ab79-9168-414d-a2cc-0f001dc7d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:12.821374 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ab79-9168-414d-a2cc-0f001dc7d381 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:12.822021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058ab79-9168-414d-a2cc-0f001dc7d381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:12.823938 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058ab79-9168-414d-a2cc-0f001dc7d381 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:12.853624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1306/2619] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:23:12 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:12.858159 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26cb7d-1092-404f-8286-f355c5435702 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:12.868785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26cb7d-1092-404f-8286-f355c5435702 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:12.925612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d288cd1-210f-4058-a106-ac655bce3f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:12.926215 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d288cd1-210f-4058-a106-ac655bce3f5d admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:12.926494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d288cd1-210f-4058-a106-ac655bce3f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:12.926762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d288cd1-210f-4058-a106-ac655bce3f5d admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:12.927390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d288cd1-210f-4058-a106-ac655bce3f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:12.929329 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d288cd1-210f-4058-a106-ac655bce3f5d admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:12.950912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1314/2620] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:23:12 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:23:12.955173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058ab79-9168-414d-a2cc-0f001dc7d381 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:12.965423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058ab79-9168-414d-a2cc-0f001dc7d381 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:12.970068 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fce4b-8f25-4763-8204-8a23075926b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:12.970664 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fce4b-8f25-4763-8204-8a23075926b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:12.970939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fce4b-8f25-4763-8204-8a23075926b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:12.971208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993fce4b-8f25-4763-8204-8a23075926b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:12.971841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fce4b-8f25-4763-8204-8a23075926b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:12.973433 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993fce4b-8f25-4763-8204-8a23075926b4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:12.983221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1307/2621] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:12.988037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d288cd1-210f-4058-a106-ac655bce3f5d admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:12.997926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d288cd1-210f-4058-a106-ac655bce3f5d admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:13.003280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89b899-f9e5-4f13-a5da-0c3fc1113cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:13.003867 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89b899-f9e5-4f13-a5da-0c3fc1113cac admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:13.004177 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89b899-f9e5-4f13-a5da-0c3fc1113cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:13.004449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89b899-f9e5-4f13-a5da-0c3fc1113cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:13.005144 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89b899-f9e5-4f13-a5da-0c3fc1113cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:13.006728 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89b899-f9e5-4f13-a5da-0c3fc1113cac admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:13.017728 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1315/2622] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:13.021746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fce4b-8f25-4763-8204-8a23075926b4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:13.031651 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993fce4b-8f25-4763-8204-8a23075926b4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:13.036301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8010e61-218a-43a3-b2e2-c5e6f13ab953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:13.036965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8010e61-218a-43a3-b2e2-c5e6f13ab953 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:13.037280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8010e61-218a-43a3-b2e2-c5e6f13ab953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:13.037772 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8010e61-218a-43a3-b2e2-c5e6f13ab953 admin admin] PATH_INFO: `/v3/projects/a9fe0a7afe194ae2b28af9cb4cb06d37/users/c88f71dd9b59431294c050281d8056c7/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:13.052793 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8010e61-218a-43a3-b2e2-c5e6f13ab953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9fe0a7afe194ae2b28af9cb4cb06d37, user_id=c88f71dd9b59431294c050281d8056c7, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:13.055435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8010e61-218a-43a3-b2e2-c5e6f13ab953 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:13.068824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1308/2623] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:23:13 2022] PUT /identity/v3/projects/a9fe0a7afe194ae2b28af9cb4cb06d37/users/c88f71dd9b59431294c050281d8056c7/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:13.073771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e2b4d-75b6-4179-8ae6-8239f9427797 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:13.074058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e2b4d-75b6-4179-8ae6-8239f9427797 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:13.074352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e2b4d-75b6-4179-8ae6-8239f9427797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:13.092709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-4b7e2b4d-75b6-4179-8ae6-8239f9427797 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:13.094648 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4b7e2b4d-75b6-4179-8ae6-8239f9427797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:13.153447 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1316/2624] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:13.163734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8010e61-218a-43a3-b2e2-c5e6f13ab953 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:13.165519 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a8010e61-218a-43a3-b2e2-c5e6f13ab953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:13.223376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8010e61-218a-43a3-b2e2-c5e6f13ab953 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:13.227159 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82337fe9-afa1-41c6-a0fa-290dc9cd7f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:13.227761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82337fe9-afa1-41c6-a0fa-290dc9cd7f34 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:13.228088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82337fe9-afa1-41c6-a0fa-290dc9cd7f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:13.228364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82337fe9-afa1-41c6-a0fa-290dc9cd7f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:13.236024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:13.238651 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82337fe9-afa1-41c6-a0fa-290dc9cd7f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:13.240618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82337fe9-afa1-41c6-a0fa-290dc9cd7f34 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:13.251863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1309/2625] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:17.362553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85783d32-8f01-48d3-b698-c6d7bbea1e18 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:17.363064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85783d32-8f01-48d3-b698-c6d7bbea1e18 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:17.363142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85783d32-8f01-48d3-b698-c6d7bbea1e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:17.395845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-85783d32-8f01-48d3-b698-c6d7bbea1e18 None None] MFA Rules not processed for user `c88f71dd9b59431294c050281d8056c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:17.397229 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-85783d32-8f01-48d3-b698-c6d7bbea1e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:17.469557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1317/2626] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:23:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:17.481985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97a3b4-806b-4489-ab4e-4df29b2247f7 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:17.482533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97a3b4-806b-4489-ab4e-4df29b2247f7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:17.482533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97a3b4-806b-4489-ab4e-4df29b2247f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:17.505382 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-db97a3b4-806b-4489-ab4e-4df29b2247f7 None None] MFA Rules not processed for user `c88f71dd9b59431294c050281d8056c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:17.506594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-db97a3b4-806b-4489-ab4e-4df29b2247f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:17.513547 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1310/2627] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:23:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:17.527228 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85783d32-8f01-48d3-b698-c6d7bbea1e18 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:17.528840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-85783d32-8f01-48d3-b698-c6d7bbea1e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:17.540871 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:17.612610 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85783d32-8f01-48d3-b698-c6d7bbea1e18 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:17.618374 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2f706-3ca8-4b49-aa0c-976d4b7d808e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:17.619029 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2f706-3ca8-4b49-aa0c-976d4b7d808e service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:17.619327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2f706-3ca8-4b49-aa0c-976d4b7d808e service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:17.619597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2f706-3ca8-4b49-aa0c-976d4b7d808e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:17.628834 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2f706-3ca8-4b49-aa0c-976d4b7d808e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:17.630506 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2f706-3ca8-4b49-aa0c-976d4b7d808e service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:17.640418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1318/2628] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:27.500019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:27.635750 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=31 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:29.184410 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0db70b-68cc-433f-8c12-bfb45f2604f1 None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:29.184917 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0db70b-68cc-433f-8c12-bfb45f2604f1 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:29.185019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0db70b-68cc-433f-8c12-bfb45f2604f1 None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:29.186436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1311/2629] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:23:29.192655 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a416686-b9de-4416-b305-8f2a59fb1236 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:29.193134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a416686-b9de-4416-b305-8f2a59fb1236 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:29.193232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a416686-b9de-4416-b305-8f2a59fb1236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:29.232689 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-9a416686-b9de-4416-b305-8f2a59fb1236 None None] MFA Rules not processed for user `e393d9c50bbb4f69a48ae635d13b1197`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:29.233991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9a416686-b9de-4416-b305-8f2a59fb1236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:29.240749 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1319/2630] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:23:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:29.253842 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0db70b-68cc-433f-8c12-bfb45f2604f1 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:29.255578 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7f0db70b-68cc-433f-8c12-bfb45f2604f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:29.269509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0db70b-68cc-433f-8c12-bfb45f2604f1 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:29.273390 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60209193-bdb2-4b2c-a9c7-6f5fd94ced45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:29.274111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60209193-bdb2-4b2c-a9c7-6f5fd94ced45 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:29.274531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60209193-bdb2-4b2c-a9c7-6f5fd94ced45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:29.274903 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60209193-bdb2-4b2c-a9c7-6f5fd94ced45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:29.283222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60209193-bdb2-4b2c-a9c7-6f5fd94ced45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:29.284841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60209193-bdb2-4b2c-a9c7-6f5fd94ced45 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:29.293261 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1312/2631] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:29.396770 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b7ea3-4e3c-4bab-ba3a-7bf8f9002b37 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:29.396980 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b7ea3-4e3c-4bab-ba3a-7bf8f9002b37 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:29.397293 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b7ea3-4e3c-4bab-ba3a-7bf8f9002b37 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:29.398652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1320/2632] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:23:29.403601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6e28e-3d9c-4c8e-8d76-bad33ddd534b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:29.403885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6e28e-3d9c-4c8e-8d76-bad33ddd534b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:29.404183 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6e28e-3d9c-4c8e-8d76-bad33ddd534b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:29.442967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7bf6e28e-3d9c-4c8e-8d76-bad33ddd534b None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:29.444206 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7bf6e28e-3d9c-4c8e-8d76-bad33ddd534b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:29.508290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1313/2633] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:23:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:29.530713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b7ea3-4e3c-4bab-ba3a-7bf8f9002b37 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:29.533029 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f11b7ea3-4e3c-4bab-ba3a-7bf8f9002b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:29.550494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b7ea3-4e3c-4bab-ba3a-7bf8f9002b37 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:29.555822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68648fca-1a6e-4264-ab4c-3a57839f3d3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:29.556453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68648fca-1a6e-4264-ab4c-3a57839f3d3e service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:29.556751 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68648fca-1a6e-4264-ab4c-3a57839f3d3e service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:29.557007 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68648fca-1a6e-4264-ab4c-3a57839f3d3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:29.566105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68648fca-1a6e-4264-ab4c-3a57839f3d3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:29.567707 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68648fca-1a6e-4264-ab4c-3a57839f3d3e service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:29.578318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1321/2634] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:29.749302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6e28e-3d9c-4c8e-8d76-bad33ddd534b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:29.759036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6e28e-3d9c-4c8e-8d76-bad33ddd534b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:29.762617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a160d02-b1cb-4a6f-baaf-c9f86ec067e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:29.763218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a160d02-b1cb-4a6f-baaf-c9f86ec067e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:29.763498 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a160d02-b1cb-4a6f-baaf-c9f86ec067e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:29.763770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a160d02-b1cb-4a6f-baaf-c9f86ec067e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:29.766441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7a160d02-b1cb-4a6f-baaf-c9f86ec067e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:29.779676 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a160d02-b1cb-4a6f-baaf-c9f86ec067e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:29.781774 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a160d02-b1cb-4a6f-baaf-c9f86ec067e0 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:29.792643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1314/2635] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:39.573310 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=15 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:39.788288 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=47 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:10.259090 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68648fca-1a6e-4264-ab4c-3a57839f3d3e service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:10.270413 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68648fca-1a6e-4264-ab4c-3a57839f3d3e service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:10.275727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2f1b7-292f-47eb-887e-0b8a285d9a9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:10.276373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2f1b7-292f-47eb-887e-0b8a285d9a9f service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.276834 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2f1b7-292f-47eb-887e-0b8a285d9a9f service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.277275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2f1b7-292f-47eb-887e-0b8a285d9a9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.279726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-03c2f1b7-292f-47eb-887e-0b8a285d9a9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:10.293975 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2f1b7-292f-47eb-887e-0b8a285d9a9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:10.296684 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2f1b7-292f-47eb-887e-0b8a285d9a9f service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:10.312073 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1322/2636] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:10.321609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a160d02-b1cb-4a6f-baaf-c9f86ec067e0 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:10.333606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a160d02-b1cb-4a6f-baaf-c9f86ec067e0 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:10.351741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee0117-d19d-4bd5-9b55-805ec1c28a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:10.352436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee0117-d19d-4bd5-9b55-805ec1c28a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.352720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee0117-d19d-4bd5-9b55-805ec1c28a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.353019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee0117-d19d-4bd5-9b55-805ec1c28a51 admin admin] PATH_INFO: `/v3/users/c88f71dd9b59431294c050281d8056c7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.354161 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee0117-d19d-4bd5-9b55-805ec1c28a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88f71dd9b59431294c050281d8056c7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:10.356122 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee0117-d19d-4bd5-9b55-805ec1c28a51 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:10.406921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5eee0117-d19d-4bd5-9b55-805ec1c28a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88f71dd9b59431294c050281d8056c7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:10.414110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5eee0117-d19d-4bd5-9b55-805ec1c28a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88f71dd9b59431294c050281d8056c7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:10.431040 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5eee0117-d19d-4bd5-9b55-805ec1c28a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88f71dd9b59431294c050281d8056c7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:10.442098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5eee0117-d19d-4bd5-9b55-805ec1c28a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88f71dd9b59431294c050281d8056c7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:10.442787 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-5eee0117-d19d-4bd5-9b55-805ec1c28a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88f71dd9b59431294c050281d8056c7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:10.448903 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1315/2637] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:10 2022] DELETE /identity/v3/users/c88f71dd9b59431294c050281d8056c7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:10.633810 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2f1b7-292f-47eb-887e-0b8a285d9a9f service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:10.648635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2f1b7-292f-47eb-887e-0b8a285d9a9f service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:10.705367 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db444cc-b858-4fac-b574-3dc6ba7625e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:10.705977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db444cc-b858-4fac-b574-3dc6ba7625e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.706256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db444cc-b858-4fac-b574-3dc6ba7625e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.706542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db444cc-b858-4fac-b574-3dc6ba7625e9 admin admin] PATH_INFO: `/v3/projects/a9fe0a7afe194ae2b28af9cb4cb06d37` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.707640 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db444cc-b858-4fac-b574-3dc6ba7625e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9fe0a7afe194ae2b28af9cb4cb06d37)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:10.709580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db444cc-b858-4fac-b574-3dc6ba7625e9 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:10.756239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-3db444cc-b858-4fac-b574-3dc6ba7625e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9fe0a7afe194ae2b28af9cb4cb06d37', 'request_id': 'req-3db444cc-b858-4fac-b574-3dc6ba7625e9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:10.762188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-3db444cc-b858-4fac-b574-3dc6ba7625e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9fe0a7afe194ae2b28af9cb4cb06d37', 'request_id': 'req-3db444cc-b858-4fac-b574-3dc6ba7625e9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:10.770015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-3db444cc-b858-4fac-b574-3dc6ba7625e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9fe0a7afe194ae2b28af9cb4cb06d37', 'request_id': 'req-3db444cc-b858-4fac-b574-3dc6ba7625e9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:10.781004 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-3db444cc-b858-4fac-b574-3dc6ba7625e9 admin admin] The token cache is being invalidate because project a9fe0a7afe194ae2b28af9cb4cb06d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:10.781290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-3db444cc-b858-4fac-b574-3dc6ba7625e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:10.781915 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-3db444cc-b858-4fac-b574-3dc6ba7625e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:10.783387 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1323/2638] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:10 2022] DELETE /identity/v3/projects/a9fe0a7afe194ae2b28af9cb4cb06d37 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:10.788528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc073bf-f3bc-4547-91ac-a8c8dff94f70 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.788820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc073bf-f3bc-4547-91ac-a8c8dff94f70 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.789128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc073bf-f3bc-4547-91ac-a8c8dff94f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.809860 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ecc073bf-f3bc-4547-91ac-a8c8dff94f70 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:10.811462 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ecc073bf-f3bc-4547-91ac-a8c8dff94f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:10.873893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1316/2639] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:24:10.881521 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42382f29-94d2-4abc-941b-aa67797add2c None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.881802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42382f29-94d2-4abc-941b-aa67797add2c None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.882073 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42382f29-94d2-4abc-941b-aa67797add2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.902416 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-42382f29-94d2-4abc-941b-aa67797add2c None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:10.903623 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-42382f29-94d2-4abc-941b-aa67797add2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:10.911959 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1324/2640] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:10.916145 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc073bf-f3bc-4547-91ac-a8c8dff94f70 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:10.926209 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc073bf-f3bc-4547-91ac-a8c8dff94f70 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:10.930747 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a193b49-cb46-410b-a17b-093bb72eca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:10.931350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a193b49-cb46-410b-a17b-093bb72eca69 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.931624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a193b49-cb46-410b-a17b-093bb72eca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.931895 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a193b49-cb46-410b-a17b-093bb72eca69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.932591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a193b49-cb46-410b-a17b-093bb72eca69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:10.932915 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a193b49-cb46-410b-a17b-093bb72eca69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:10.934530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a193b49-cb46-410b-a17b-093bb72eca69 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:10.947373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1317/2641] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:10.952921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42382f29-94d2-4abc-941b-aa67797add2c None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:10.962305 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42382f29-94d2-4abc-941b-aa67797add2c None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:10.967297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793964a-7b96-4e2c-be1b-38b1c1fdda85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:10.967897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793964a-7b96-4e2c-be1b-38b1c1fdda85 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.968200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793964a-7b96-4e2c-be1b-38b1c1fdda85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.968497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793964a-7b96-4e2c-be1b-38b1c1fdda85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.969170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793964a-7b96-4e2c-be1b-38b1c1fdda85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:10.971278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793964a-7b96-4e2c-be1b-38b1c1fdda85 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:10.999912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1325/2642] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:10 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:11.004092 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a193b49-cb46-410b-a17b-093bb72eca69 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:11.014525 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a193b49-cb46-410b-a17b-093bb72eca69 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:11.071219 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481dfde-1fe7-4737-92b7-6cf98528a41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:11.071822 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481dfde-1fe7-4737-92b7-6cf98528a41d admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:11.072128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481dfde-1fe7-4737-92b7-6cf98528a41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:11.072400 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481dfde-1fe7-4737-92b7-6cf98528a41d admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:11.073019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481dfde-1fe7-4737-92b7-6cf98528a41d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:11.074907 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481dfde-1fe7-4737-92b7-6cf98528a41d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:11.083220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:11.097991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1318/2643] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:11 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:11.102086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793964a-7b96-4e2c-be1b-38b1c1fdda85 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:11.112787 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793964a-7b96-4e2c-be1b-38b1c1fdda85 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:11.117313 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d9e5c-eeea-4477-89fe-6011bd4624d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:11.117897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d9e5c-eeea-4477-89fe-6011bd4624d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:11.118171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d9e5c-eeea-4477-89fe-6011bd4624d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:11.118439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d9e5c-eeea-4477-89fe-6011bd4624d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:11.119071 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d9e5c-eeea-4477-89fe-6011bd4624d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:11.120713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d9e5c-eeea-4477-89fe-6011bd4624d3 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:11.130431 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1326/2644] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:11.134179 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481dfde-1fe7-4737-92b7-6cf98528a41d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:11.144180 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481dfde-1fe7-4737-92b7-6cf98528a41d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:11.148816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f581dd-f490-4c6c-914e-c63c3d89cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:11.149413 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f581dd-f490-4c6c-914e-c63c3d89cead admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:11.149692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f581dd-f490-4c6c-914e-c63c3d89cead admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:11.149966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f581dd-f490-4c6c-914e-c63c3d89cead admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:11.150603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f581dd-f490-4c6c-914e-c63c3d89cead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:11.152239 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f581dd-f490-4c6c-914e-c63c3d89cead admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:11.163261 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1319/2645] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:11.167203 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d9e5c-eeea-4477-89fe-6011bd4624d3 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:11.178118 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d9e5c-eeea-4477-89fe-6011bd4624d3 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:11.182649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9fbb4-2b62-4bb5-a54a-45a6a1d69704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:11.183278 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9fbb4-2b62-4bb5-a54a-45a6a1d69704 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:11.183555 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9fbb4-2b62-4bb5-a54a-45a6a1d69704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:11.183826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9fbb4-2b62-4bb5-a54a-45a6a1d69704 admin admin] PATH_INFO: `/v3/projects/2c281c0ba76241849dfce585ff1e50bc/users/b9acdc0eda564bd5befe9406eeaaf450/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:11.197969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9fbb4-2b62-4bb5-a54a-45a6a1d69704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c281c0ba76241849dfce585ff1e50bc, user_id=b9acdc0eda564bd5befe9406eeaaf450, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:11.200626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9fbb4-2b62-4bb5-a54a-45a6a1d69704 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:11.214045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1327/2646] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:11 2022] PUT /identity/v3/projects/2c281c0ba76241849dfce585ff1e50bc/users/b9acdc0eda564bd5befe9406eeaaf450/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:11.219640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf77971-7d72-403d-81b7-e1810ecf76be None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:11.219969 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf77971-7d72-403d-81b7-e1810ecf76be None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:11.220253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf77971-7d72-403d-81b7-e1810ecf76be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:11.239770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-bbf77971-7d72-403d-81b7-e1810ecf76be None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:11.241014 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bbf77971-7d72-403d-81b7-e1810ecf76be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:11.300933 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1320/2647] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:11.311241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9fbb4-2b62-4bb5-a54a-45a6a1d69704 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:11.313002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f5a9fbb4-2b62-4bb5-a54a-45a6a1d69704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:11.327191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:11.371506 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9fbb4-2b62-4bb5-a54a-45a6a1d69704 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:11.376191 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc806b-54ec-4761-a7bb-2938a3ef4a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:11.376789 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc806b-54ec-4761-a7bb-2938a3ef4a7c service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:11.377069 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc806b-54ec-4761-a7bb-2938a3ef4a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:11.377339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc806b-54ec-4761-a7bb-2938a3ef4a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:11.386168 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc806b-54ec-4761-a7bb-2938a3ef4a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:11.387584 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc806b-54ec-4761-a7bb-2938a3ef4a7c service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:11.397381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1328/2648] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:15.715306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349cbde-7705-4392-ba1d-39e2f5e42dd2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:15.715810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349cbde-7705-4392-ba1d-39e2f5e42dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:15.715935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349cbde-7705-4392-ba1d-39e2f5e42dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:15.753508 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c349cbde-7705-4392-ba1d-39e2f5e42dd2 None None] MFA Rules not processed for user `b9acdc0eda564bd5befe9406eeaaf450`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:15.754750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c349cbde-7705-4392-ba1d-39e2f5e42dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:15.824394 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1321/2649] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:24:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:15.834878 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efffe5-9faf-4966-bbe7-812a77774029 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:15.835349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efffe5-9faf-4966-bbe7-812a77774029 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:15.835542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efffe5-9faf-4966-bbe7-812a77774029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:15.854794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e9efffe5-9faf-4966-bbe7-812a77774029 None None] MFA Rules not processed for user `b9acdc0eda564bd5befe9406eeaaf450`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:15.856043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e9efffe5-9faf-4966-bbe7-812a77774029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:15.863571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1329/2650] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:24:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:15.875868 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349cbde-7705-4392-ba1d-39e2f5e42dd2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:15.877299 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c349cbde-7705-4392-ba1d-39e2f5e42dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:15.954997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349cbde-7705-4392-ba1d-39e2f5e42dd2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:15.960806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef865cd-5d6c-43d5-a08d-739ba757a724 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:15.961423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef865cd-5d6c-43d5-a08d-739ba757a724 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:15.961705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef865cd-5d6c-43d5-a08d-739ba757a724 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:15.961978 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef865cd-5d6c-43d5-a08d-739ba757a724 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:15.966875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:15.971616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef865cd-5d6c-43d5-a08d-739ba757a724 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:15.973497 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef865cd-5d6c-43d5-a08d-739ba757a724 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:15.983018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1322/2651] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:25.849701 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=23 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:25.978445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:27.190205 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effd2f2-08ed-4962-84dd-66a224e10ce2 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:27.190769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effd2f2-08ed-4962-84dd-66a224e10ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:27.190769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effd2f2-08ed-4962-84dd-66a224e10ce2 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:27.192291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1330/2652] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:24:27.197333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b635c-03fa-4574-ae72-88dcefed2030 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:27.197803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b635c-03fa-4574-ae72-88dcefed2030 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:27.197902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b635c-03fa-4574-ae72-88dcefed2030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:27.218993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-322b635c-03fa-4574-ae72-88dcefed2030 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:27.220270 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-322b635c-03fa-4574-ae72-88dcefed2030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:27.284415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1323/2653] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:24:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:27.305601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effd2f2-08ed-4962-84dd-66a224e10ce2 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:27.307326 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-0effd2f2-08ed-4962-84dd-66a224e10ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:27.325593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effd2f2-08ed-4962-84dd-66a224e10ce2 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:27.330611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e9025-eec5-455a-b7c5-52b976797684 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:27.331200 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e9025-eec5-455a-b7c5-52b976797684 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:27.331504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e9025-eec5-455a-b7c5-52b976797684 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:27.331775 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e9025-eec5-455a-b7c5-52b976797684 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:27.340083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e9025-eec5-455a-b7c5-52b976797684 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:27.342344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e9025-eec5-455a-b7c5-52b976797684 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:27.351814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1331/2654] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:37.275470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=29 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:37.347853 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=6 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:02.696192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc04f26-7ac0-43e5-95e7-3a87edc27ff8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:02.696761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc04f26-7ac0-43e5-95e7-3a87edc27ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:02.696761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc04f26-7ac0-43e5-95e7-3a87edc27ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:02.717030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1fc04f26-7ac0-43e5-95e7-3a87edc27ff8 None None] MFA Rules not processed for user `b9acdc0eda564bd5befe9406eeaaf450`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:02.718228 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1fc04f26-7ac0-43e5-95e7-3a87edc27ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:02.725024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1324/2655] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:05.538074 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e9025-eec5-455a-b7c5-52b976797684 service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:05.539733 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c77e9025-eec5-455a-b7c5-52b976797684 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:05.552823 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e9025-eec5-455a-b7c5-52b976797684 service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:05.556538 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e55a2f-7cae-44a3-b48e-1d4e75f883d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:05.557335 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e55a2f-7cae-44a3-b48e-1d4e75f883d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:05.557621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e55a2f-7cae-44a3-b48e-1d4e75f883d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:05.557896 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e55a2f-7cae-44a3-b48e-1d4e75f883d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:05.560358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-73e55a2f-7cae-44a3-b48e-1d4e75f883d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:05.598746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e55a2f-7cae-44a3-b48e-1d4e75f883d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:05.600583 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e55a2f-7cae-44a3-b48e-1d4e75f883d5 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:05.609284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc04f26-7ac0-43e5-95e7-3a87edc27ff8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:05.627252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc04f26-7ac0-43e5-95e7-3a87edc27ff8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:05.627822 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1332/2656] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:25:05.635164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492c2a5-5969-4531-b3d0-d6a88da10376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:05.636051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492c2a5-5969-4531-b3d0-d6a88da10376 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:05.636493 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492c2a5-5969-4531-b3d0-d6a88da10376 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:05.637076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492c2a5-5969-4531-b3d0-d6a88da10376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:05.639203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a492c2a5-5969-4531-b3d0-d6a88da10376 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:05.657180 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492c2a5-5969-4531-b3d0-d6a88da10376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:05.658558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492c2a5-5969-4531-b3d0-d6a88da10376 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:05.683854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1325/2657] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:09.280551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e55a2f-7cae-44a3-b48e-1d4e75f883d5 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:09.289303 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e55a2f-7cae-44a3-b48e-1d4e75f883d5 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:09.293966 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6e4f6-807a-4cff-b607-d8b5ab1a29d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:09.294558 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6e4f6-807a-4cff-b607-d8b5ab1a29d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:09.294837 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6e4f6-807a-4cff-b607-d8b5ab1a29d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:09.295109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6e4f6-807a-4cff-b607-d8b5ab1a29d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:09.296855 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-41a6e4f6-807a-4cff-b607-d8b5ab1a29d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:09.310256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6e4f6-807a-4cff-b607-d8b5ab1a29d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:09.311670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6e4f6-807a-4cff-b607-d8b5ab1a29d2 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:09.322626 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1333/2658] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:14.584173 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413547-bb65-4f5c-81f3-c766285b50ad None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:14.584725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413547-bb65-4f5c-81f3-c766285b50ad None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:14.584814 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413547-bb65-4f5c-81f3-c766285b50ad None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:14.586152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1326/2659] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:25:14.591868 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf203b-33ff-4ef2-be02-37629cddac49 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:14.592335 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf203b-33ff-4ef2-be02-37629cddac49 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:14.592432 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf203b-33ff-4ef2-be02-37629cddac49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:14.612672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-6aaf203b-33ff-4ef2-be02-37629cddac49 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:14.614009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-6aaf203b-33ff-4ef2-be02-37629cddac49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:14.623126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1334/2660] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:25:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:14.645263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8413547-bb65-4f5c-81f3-c766285b50ad None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:14.659725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8413547-bb65-4f5c-81f3-c766285b50ad None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:14.664649 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a2a98-10fb-4798-bf9e-17a374380efe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:14.665244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a2a98-10fb-4798-bf9e-17a374380efe service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:14.665523 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a2a98-10fb-4798-bf9e-17a374380efe service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:14.665797 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a2a98-10fb-4798-bf9e-17a374380efe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:14.674706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a2a98-10fb-4798-bf9e-17a374380efe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:14.676367 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a2a98-10fb-4798-bf9e-17a374380efe service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:14.686086 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1327/2661] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:24.607003 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=27 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:24.681948 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=15 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:42.951573 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf203b-33ff-4ef2-be02-37629cddac49 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:42.961106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf203b-33ff-4ef2-be02-37629cddac49 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:42.965692 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fd678-25f5-452b-b6ea-6e3dee5f930f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:42.966299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fd678-25f5-452b-b6ea-6e3dee5f930f service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:42.966577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fd678-25f5-452b-b6ea-6e3dee5f930f service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:42.966844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fd678-25f5-452b-b6ea-6e3dee5f930f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:42.968630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-034fd678-25f5-452b-b6ea-6e3dee5f930f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:42.978073 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fd678-25f5-452b-b6ea-6e3dee5f930f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:42.979491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fd678-25f5-452b-b6ea-6e3dee5f930f service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:42.987395 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1335/2662] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:25:46.539315 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a2a98-10fb-4798-bf9e-17a374380efe service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:46.569267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a2a98-10fb-4798-bf9e-17a374380efe service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:46.577090 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf96a1-599f-454f-887c-0bbf749c293f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:46.577716 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf96a1-599f-454f-887c-0bbf749c293f service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:46.578001 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf96a1-599f-454f-887c-0bbf749c293f service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:46.578272 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf96a1-599f-454f-887c-0bbf749c293f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:46.580111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6fcf96a1-599f-454f-887c-0bbf749c293f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:46.596919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf96a1-599f-454f-887c-0bbf749c293f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:46.598531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf96a1-599f-454f-887c-0bbf749c293f service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:46.616090 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1328/2663] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:52.983872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=6 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:55.823429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fd678-25f5-452b-b6ea-6e3dee5f930f service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:55.835485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fd678-25f5-452b-b6ea-6e3dee5f930f service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:55.840456 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e6d10-4c63-400e-8784-67b92853c135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:55.841088 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e6d10-4c63-400e-8784-67b92853c135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:55.841369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e6d10-4c63-400e-8784-67b92853c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:55.841646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e6d10-4c63-400e-8784-67b92853c135 admin admin] PATH_INFO: `/v3/users/b9acdc0eda564bd5befe9406eeaaf450` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:55.842777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e6d10-4c63-400e-8784-67b92853c135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9acdc0eda564bd5befe9406eeaaf450)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:55.844738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e6d10-4c63-400e-8784-67b92853c135 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:55.894452 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-ae9e6d10-4c63-400e-8784-67b92853c135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9acdc0eda564bd5befe9406eeaaf450'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:55.901761 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-ae9e6d10-4c63-400e-8784-67b92853c135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9acdc0eda564bd5befe9406eeaaf450'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:55.914605 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-ae9e6d10-4c63-400e-8784-67b92853c135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9acdc0eda564bd5befe9406eeaaf450'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:55.915234 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-ae9e6d10-4c63-400e-8784-67b92853c135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9acdc0eda564bd5befe9406eeaaf450'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:55.916472 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-ae9e6d10-4c63-400e-8784-67b92853c135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9acdc0eda564bd5befe9406eeaaf450'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:55.928750 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1336/2664] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:25:55 2022] DELETE /identity/v3/users/b9acdc0eda564bd5befe9406eeaaf450 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:56.104217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf96a1-599f-454f-887c-0bbf749c293f service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:56.115533 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf96a1-599f-454f-887c-0bbf749c293f service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:56.182826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7623fc-38c0-49ad-bc6d-501503cf8383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:56.183452 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7623fc-38c0-49ad-bc6d-501503cf8383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:56.183723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7623fc-38c0-49ad-bc6d-501503cf8383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:56.184086 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7623fc-38c0-49ad-bc6d-501503cf8383 admin admin] PATH_INFO: `/v3/projects/2c281c0ba76241849dfce585ff1e50bc` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:56.185178 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7623fc-38c0-49ad-bc6d-501503cf8383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c281c0ba76241849dfce585ff1e50bc)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:56.187094 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7623fc-38c0-49ad-bc6d-501503cf8383 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:56.236709 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7d7623fc-38c0-49ad-bc6d-501503cf8383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c281c0ba76241849dfce585ff1e50bc', 'request_id': 'req-7d7623fc-38c0-49ad-bc6d-501503cf8383'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:56.242832 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7d7623fc-38c0-49ad-bc6d-501503cf8383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c281c0ba76241849dfce585ff1e50bc', 'request_id': 'req-7d7623fc-38c0-49ad-bc6d-501503cf8383'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:56.250323 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7d7623fc-38c0-49ad-bc6d-501503cf8383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c281c0ba76241849dfce585ff1e50bc', 'request_id': 'req-7d7623fc-38c0-49ad-bc6d-501503cf8383'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:56.261441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7d7623fc-38c0-49ad-bc6d-501503cf8383 admin admin] The token cache is being invalidate because project 2c281c0ba76241849dfce585ff1e50bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:25:56.261729 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7d7623fc-38c0-49ad-bc6d-501503cf8383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:56.262364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7d7623fc-38c0-49ad-bc6d-501503cf8383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:56.263895 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1329/2665] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:56 2022] DELETE /identity/v3/projects/2c281c0ba76241849dfce585ff1e50bc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:56.268788 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cf5f1-5e30-4609-aa8b-54c8167a62f4 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:56.269086 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cf5f1-5e30-4609-aa8b-54c8167a62f4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:56.269364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cf5f1-5e30-4609-aa8b-54c8167a62f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:56.300247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-445cf5f1-5e30-4609-aa8b-54c8167a62f4 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:56.301392 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-445cf5f1-5e30-4609-aa8b-54c8167a62f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:56.362935 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1337/2666] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:56.371457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7569dc4-3fcb-4b8b-9657-7097572dffb6 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:56.371745 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7569dc4-3fcb-4b8b-9657-7097572dffb6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:56.372058 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7569dc4-3fcb-4b8b-9657-7097572dffb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:56.392244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-a7569dc4-3fcb-4b8b-9657-7097572dffb6 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:56.393463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a7569dc4-3fcb-4b8b-9657-7097572dffb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:56.402439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1330/2667] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:56.406671 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cf5f1-5e30-4609-aa8b-54c8167a62f4 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:56.417164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cf5f1-5e30-4609-aa8b-54c8167a62f4 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:56.422006 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcf5be-149d-4a56-a442-e76aa2099937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:56.422597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcf5be-149d-4a56-a442-e76aa2099937 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:56.422874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcf5be-149d-4a56-a442-e76aa2099937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:56.423141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcf5be-149d-4a56-a442-e76aa2099937 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:56.423785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcf5be-149d-4a56-a442-e76aa2099937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:25:56.424114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcf5be-149d-4a56-a442-e76aa2099937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:56.425693 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcf5be-149d-4a56-a442-e76aa2099937 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:56.437656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1338/2668] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:25:56.441834 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7569dc4-3fcb-4b8b-9657-7097572dffb6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:56.451980 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7569dc4-3fcb-4b8b-9657-7097572dffb6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:56.456758 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9256213-4a12-490d-befa-0ddb07a7cf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:56.457364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9256213-4a12-490d-befa-0ddb07a7cf1a admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:56.457646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9256213-4a12-490d-befa-0ddb07a7cf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:56.457916 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9256213-4a12-490d-befa-0ddb07a7cf1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:56.458683 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9256213-4a12-490d-befa-0ddb07a7cf1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:56.460627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9256213-4a12-490d-befa-0ddb07a7cf1a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:56.487869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1331/2669] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:25:56 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:56.492141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcf5be-149d-4a56-a442-e76aa2099937 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:56.502803 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcf5be-149d-4a56-a442-e76aa2099937 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:56.550557 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:56.562335 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251c918-0a97-4d76-86e0-4cb4d1e18f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:56.562934 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251c918-0a97-4d76-86e0-4cb4d1e18f6d admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:56.563209 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251c918-0a97-4d76-86e0-4cb4d1e18f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:56.563477 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251c918-0a97-4d76-86e0-4cb4d1e18f6d admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:56.564133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251c918-0a97-4d76-86e0-4cb4d1e18f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:56.566025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251c918-0a97-4d76-86e0-4cb4d1e18f6d admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:56.586610 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1339/2670] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:25:56 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:25:56.591503 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9256213-4a12-490d-befa-0ddb07a7cf1a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:56.601763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9256213-4a12-490d-befa-0ddb07a7cf1a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:56.606947 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db5626-d36f-424c-96ea-4b9e328469ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:56.607542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db5626-d36f-424c-96ea-4b9e328469ba admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:56.607823 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db5626-d36f-424c-96ea-4b9e328469ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:56.608126 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db5626-d36f-424c-96ea-4b9e328469ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:56.608767 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db5626-d36f-424c-96ea-4b9e328469ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:56.610343 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db5626-d36f-424c-96ea-4b9e328469ba admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:56.620552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1332/2671] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:25:56.624525 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251c918-0a97-4d76-86e0-4cb4d1e18f6d admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:56.635000 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251c918-0a97-4d76-86e0-4cb4d1e18f6d admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:56.640148 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d72b8a-6b9c-4737-a5a2-43778bd8ddb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:56.640754 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d72b8a-6b9c-4737-a5a2-43778bd8ddb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:56.641032 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d72b8a-6b9c-4737-a5a2-43778bd8ddb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:56.641303 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d72b8a-6b9c-4737-a5a2-43778bd8ddb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:56.641956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d72b8a-6b9c-4737-a5a2-43778bd8ddb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:56.643689 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d72b8a-6b9c-4737-a5a2-43778bd8ddb5 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:56.655447 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1340/2672] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:56.659621 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db5626-d36f-424c-96ea-4b9e328469ba admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:56.669915 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db5626-d36f-424c-96ea-4b9e328469ba admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:56.674540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d75746-943f-45d3-a584-d6583e7ea302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:56.675214 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d75746-943f-45d3-a584-d6583e7ea302 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:56.675496 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d75746-943f-45d3-a584-d6583e7ea302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:56.675770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d75746-943f-45d3-a584-d6583e7ea302 admin admin] PATH_INFO: `/v3/projects/b313fe8a20284bf0a6a81d857ac473c3/users/82155c52edb74e559083be82b44112b9/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:56.690748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d75746-943f-45d3-a584-d6583e7ea302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b313fe8a20284bf0a6a81d857ac473c3, user_id=82155c52edb74e559083be82b44112b9, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:56.693435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d75746-943f-45d3-a584-d6583e7ea302 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:56.706730 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1333/2673] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:56 2022] PUT /identity/v3/projects/b313fe8a20284bf0a6a81d857ac473c3/users/82155c52edb74e559083be82b44112b9/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:56.711713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cf218-90a6-437f-9b95-39e7416f73c8 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:56.712039 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cf218-90a6-437f-9b95-39e7416f73c8 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:56.712315 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cf218-90a6-437f-9b95-39e7416f73c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:56.730799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-0f0cf218-90a6-437f-9b95-39e7416f73c8 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:56.732041 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-0f0cf218-90a6-437f-9b95-39e7416f73c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:56.789762 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1341/2674] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:25:56.800125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d75746-943f-45d3-a584-d6583e7ea302 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:56.801885 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-07d75746-943f-45d3-a584-d6583e7ea302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:56.816596 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:56.863791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d75746-943f-45d3-a584-d6583e7ea302 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:56.867579 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81918b-ff1e-44e1-88bf-752bd33172ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:56.868210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81918b-ff1e-44e1-88bf-752bd33172ea service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:56.868487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81918b-ff1e-44e1-88bf-752bd33172ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:56.869358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81918b-ff1e-44e1-88bf-752bd33172ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:56.878441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81918b-ff1e-44e1-88bf-752bd33172ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:56.879878 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81918b-ff1e-44e1-88bf-752bd33172ea service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:56.889736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1334/2675] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:00.950119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855292d1-fdae-45bc-a91b-5e856a827b35 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:00.950647 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855292d1-fdae-45bc-a91b-5e856a827b35 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:00.950647 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855292d1-fdae-45bc-a91b-5e856a827b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:00.986073 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-855292d1-fdae-45bc-a91b-5e856a827b35 None None] MFA Rules not processed for user `82155c52edb74e559083be82b44112b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:00.987488 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-855292d1-fdae-45bc-a91b-5e856a827b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:01.070440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1342/2676] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:26:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:26:01.079248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81918b-ff1e-44e1-88bf-752bd33172ea service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:01.085146 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0c81918b-ff1e-44e1-88bf-752bd33172ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:01.202267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81918b-ff1e-44e1-88bf-752bd33172ea service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:01.207823 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e0558-5aa7-4464-baef-594f7d98db33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:01.208495 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e0558-5aa7-4464-baef-594f7d98db33 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:01.208771 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e0558-5aa7-4464-baef-594f7d98db33 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:01.209042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e0558-5aa7-4464-baef-594f7d98db33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:01.218970 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e0558-5aa7-4464-baef-594f7d98db33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:01.220997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e0558-5aa7-4464-baef-594f7d98db33 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:01.233463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1335/2677] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:02.580731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6ca48-eea8-47e3-8156-d62c4810543d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:02.581329 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6ca48-eea8-47e3-8156-d62c4810543d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:02.581329 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6ca48-eea8-47e3-8156-d62c4810543d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:02.602741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-2ed6ca48-eea8-47e3-8156-d62c4810543d None None] MFA Rules not processed for user `82155c52edb74e559083be82b44112b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:02.604394 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2ed6ca48-eea8-47e3-8156-d62c4810543d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:02.612229 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1343/2678] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:26:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:03.312843 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e0558-5aa7-4464-baef-594f7d98db33 service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:03.314526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3d6e0558-5aa7-4464-baef-594f7d98db33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:03.399025 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e0558-5aa7-4464-baef-594f7d98db33 service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:03.404250 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e33efc-43d5-4ef8-9877-cd232008e68b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:03.404869 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e33efc-43d5-4ef8-9877-cd232008e68b service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:03.405152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e33efc-43d5-4ef8-9877-cd232008e68b service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:03.405424 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e33efc-43d5-4ef8-9877-cd232008e68b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:03.407158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-63e33efc-43d5-4ef8-9877-cd232008e68b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:03.419807 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e33efc-43d5-4ef8-9877-cd232008e68b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:03.421450 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e33efc-43d5-4ef8-9877-cd232008e68b service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:03.432698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1336/2679] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:12.597222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:13.427372 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=86 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:50.665301 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b1c33-f083-42f3-b3c4-0a1e73d8810d None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:50.665871 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b1c33-f083-42f3-b3c4-0a1e73d8810d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:50.665871 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b1c33-f083-42f3-b3c4-0a1e73d8810d None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:50.667262 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1344/2680] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:26:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:26:50.672397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a5448-7eb4-4300-a573-3e667359cdbc None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:50.672897 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a5448-7eb4-4300-a573-3e667359cdbc None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:50.672997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a5448-7eb4-4300-a573-3e667359cdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:50.706098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-864a5448-7eb4-4300-a573-3e667359cdbc None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:50.707297 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-864a5448-7eb4-4300-a573-3e667359cdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:50.716552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1337/2681] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:26:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:50.739785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b1c33-f083-42f3-b3c4-0a1e73d8810d None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:50.753938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b1c33-f083-42f3-b3c4-0a1e73d8810d None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:50.759422 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef563581-ea61-44fc-8f2f-ee9f77841c42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:50.760045 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef563581-ea61-44fc-8f2f-ee9f77841c42 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:50.760324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef563581-ea61-44fc-8f2f-ee9f77841c42 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:50.760602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef563581-ea61-44fc-8f2f-ee9f77841c42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:50.768808 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef563581-ea61-44fc-8f2f-ee9f77841c42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:50.770374 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef563581-ea61-44fc-8f2f-ee9f77841c42 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:50.780454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1345/2682] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:00.701242 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=7 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:00.776463 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=6 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:10.177592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a5448-7eb4-4300-a573-3e667359cdbc None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:10.192659 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a5448-7eb4-4300-a573-3e667359cdbc None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:10.198399 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f0aed-6fe8-485b-808f-17dec051eefa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:10.198994 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f0aed-6fe8-485b-808f-17dec051eefa service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:10.199271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f0aed-6fe8-485b-808f-17dec051eefa service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:10.199539 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f0aed-6fe8-485b-808f-17dec051eefa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:10.201257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-246f0aed-6fe8-485b-808f-17dec051eefa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:10.212974 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f0aed-6fe8-485b-808f-17dec051eefa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:10.214513 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f0aed-6fe8-485b-808f-17dec051eefa service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:10.224407 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1338/2683] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:19.001785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90e6f5-f928-43bd-be11-d235cb8b48c9 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:19.002240 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90e6f5-f928-43bd-be11-d235cb8b48c9 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:19.002335 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90e6f5-f928-43bd-be11-d235cb8b48c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:19.023788 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-7b90e6f5-f928-43bd-be11-d235cb8b48c9 None None] MFA Rules not processed for user `82155c52edb74e559083be82b44112b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:19.025031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7b90e6f5-f928-43bd-be11-d235cb8b48c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:19.031883 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1346/2684] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:27:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:20.220306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:29.017961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:22.722894 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8ffc8-7e95-48cc-a247-5eead2fbd5fe None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:22.723625 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8ffc8-7e95-48cc-a247-5eead2fbd5fe None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:22.723625 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8ffc8-7e95-48cc-a247-5eead2fbd5fe None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:22.724845 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1339/2685] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:28:22.729631 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866d412-b3a7-4cf2-bbfb-d3799ead1549 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:22.730107 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866d412-b3a7-4cf2-bbfb-d3799ead1549 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:22.730203 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866d412-b3a7-4cf2-bbfb-d3799ead1549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:22.750054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-6866d412-b3a7-4cf2-bbfb-d3799ead1549 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:22.751352 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-6866d412-b3a7-4cf2-bbfb-d3799ead1549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:22.761047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1347/2686] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:28:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:22.783727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8ffc8-7e95-48cc-a247-5eead2fbd5fe None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:22.785499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d0b8ffc8-7e95-48cc-a247-5eead2fbd5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:22.802234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8ffc8-7e95-48cc-a247-5eead2fbd5fe None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:22.807140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dbf4c-4d96-4dfb-aa53-eccdf65fda0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:22.807732 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dbf4c-4d96-4dfb-aa53-eccdf65fda0c service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:22.808168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dbf4c-4d96-4dfb-aa53-eccdf65fda0c service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:22.808446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dbf4c-4d96-4dfb-aa53-eccdf65fda0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:22.817118 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dbf4c-4d96-4dfb-aa53-eccdf65fda0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:22.818698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dbf4c-4d96-4dfb-aa53-eccdf65fda0c service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:22.828222 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1340/2687] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:28:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:28:32.744625 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:32.824293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:36.803064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee946fd5-499f-4673-b549-50f3692eec22 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:36.803529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee946fd5-499f-4673-b549-50f3692eec22 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:36.803638 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee946fd5-499f-4673-b549-50f3692eec22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:36.823269 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-ee946fd5-499f-4673-b549-50f3692eec22 None None] MFA Rules not processed for user `82155c52edb74e559083be82b44112b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:36.824612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ee946fd5-499f-4673-b549-50f3692eec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:36.832409 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1348/2688] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:28:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:37.151616 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dbf4c-4d96-4dfb-aa53-eccdf65fda0c service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:37.153108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e53dbf4c-4d96-4dfb-aa53-eccdf65fda0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:37.165487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dbf4c-4d96-4dfb-aa53-eccdf65fda0c service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:37.169320 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e488528-1b7c-42b5-b719-57cc695578c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:37.169915 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e488528-1b7c-42b5-b719-57cc695578c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:37.170200 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e488528-1b7c-42b5-b719-57cc695578c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:37.170474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e488528-1b7c-42b5-b719-57cc695578c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:37.172176 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7e488528-1b7c-42b5-b719-57cc695578c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:37.182014 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e488528-1b7c-42b5-b719-57cc695578c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:37.183423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e488528-1b7c-42b5-b719-57cc695578c8 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:37.191352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1341/2689] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:28:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:28:46.817602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:47.187936 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:22.670952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee946fd5-499f-4673-b549-50f3692eec22 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:22.681066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee946fd5-499f-4673-b549-50f3692eec22 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:22.684668 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befea6b8-e414-4195-b7da-093ff45da66f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:22.685272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befea6b8-e414-4195-b7da-093ff45da66f service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:22.685547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befea6b8-e414-4195-b7da-093ff45da66f service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:22.685814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befea6b8-e414-4195-b7da-093ff45da66f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:22.687577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-befea6b8-e414-4195-b7da-093ff45da66f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:22.698416 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befea6b8-e414-4195-b7da-093ff45da66f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:22.699939 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befea6b8-e414-4195-b7da-093ff45da66f service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:22.708857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1349/2690] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:29:22.786119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb3a4-7096-477d-b468-95a52e57d7fa None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:22.786718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb3a4-7096-477d-b468-95a52e57d7fa None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:22.786718 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeb3a4-7096-477d-b468-95a52e57d7fa None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:22.788123 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1342/2691] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:29:22.793121 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a1cfd-372a-4ab3-a473-eaa819e40bf4 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:22.793957 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a1cfd-372a-4ab3-a473-eaa819e40bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:22.793957 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a1cfd-372a-4ab3-a473-eaa819e40bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:22.813241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-650a1cfd-372a-4ab3-a473-eaa819e40bf4 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:22.814947 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-650a1cfd-372a-4ab3-a473-eaa819e40bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:22.823386 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1350/2692] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:29:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:22.843786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeb3a4-7096-477d-b468-95a52e57d7fa None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:22.858181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeb3a4-7096-477d-b468-95a52e57d7fa None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:22.863728 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eec9cb-d8d3-4627-ae82-c01fe1bab078 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:22.864344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eec9cb-d8d3-4627-ae82-c01fe1bab078 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:22.864622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eec9cb-d8d3-4627-ae82-c01fe1bab078 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:22.864889 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eec9cb-d8d3-4627-ae82-c01fe1bab078 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:22.873125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eec9cb-d8d3-4627-ae82-c01fe1bab078 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:22.874665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eec9cb-d8d3-4627-ae82-c01fe1bab078 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:22.884425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1343/2693] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:29:23.059258 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a1cfd-372a-4ab3-a473-eaa819e40bf4 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:23.068926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a1cfd-372a-4ab3-a473-eaa819e40bf4 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:23.072492 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96194f5-e554-43ea-beef-582696145872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:23.073083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96194f5-e554-43ea-beef-582696145872 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:23.073402 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96194f5-e554-43ea-beef-582696145872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:23.073674 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96194f5-e554-43ea-beef-582696145872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:23.075403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d96194f5-e554-43ea-beef-582696145872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:23.089182 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96194f5-e554-43ea-beef-582696145872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:23.090723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96194f5-e554-43ea-beef-582696145872 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:23.102383 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1351/2694] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:29:32.880481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:33.097460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=15 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:57.276910 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5fcf4-34e7-44a5-b478-e99bf9036f31 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:57.277397 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5fcf4-34e7-44a5-b478-e99bf9036f31 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:57.277490 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5fcf4-34e7-44a5-b478-e99bf9036f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:57.296707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-71e5fcf4-34e7-44a5-b478-e99bf9036f31 None None] MFA Rules not processed for user `82155c52edb74e559083be82b44112b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:57.297933 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-71e5fcf4-34e7-44a5-b478-e99bf9036f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:57.304704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1344/2695] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:57.611399 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96194f5-e554-43ea-beef-582696145872 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:57.620072 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96194f5-e554-43ea-beef-582696145872 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:57.624511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae4b7c-7b20-4fe1-97b0-30c166d014d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:57.625102 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae4b7c-7b20-4fe1-97b0-30c166d014d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:57.625642 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae4b7c-7b20-4fe1-97b0-30c166d014d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:57.626298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae4b7c-7b20-4fe1-97b0-30c166d014d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:57.627981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-19ae4b7c-7b20-4fe1-97b0-30c166d014d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:57.637517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae4b7c-7b20-4fe1-97b0-30c166d014d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:57.638940 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae4b7c-7b20-4fe1-97b0-30c166d014d8 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:57.647893 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1352/2696] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:30:06.130894 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5fcf4-34e7-44a5-b478-e99bf9036f31 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:06.140900 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5fcf4-34e7-44a5-b478-e99bf9036f31 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:06.144416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047baadd-65f7-4a43-95d6-eb7c63d5f2ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:06.145034 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047baadd-65f7-4a43-95d6-eb7c63d5f2ee service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:06.145310 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047baadd-65f7-4a43-95d6-eb7c63d5f2ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:06.145577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047baadd-65f7-4a43-95d6-eb7c63d5f2ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:06.147311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-047baadd-65f7-4a43-95d6-eb7c63d5f2ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:06.163113 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047baadd-65f7-4a43-95d6-eb7c63d5f2ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:06.164568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047baadd-65f7-4a43-95d6-eb7c63d5f2ee service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:06.176505 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1345/2697] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:30:07.644341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=6 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:08.821338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae4b7c-7b20-4fe1-97b0-30c166d014d8 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:08.835694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae4b7c-7b20-4fe1-97b0-30c166d014d8 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:08.841554 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9fdba-1243-47cd-a6a8-e8c0ab4492f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:08.842230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9fdba-1243-47cd-a6a8-e8c0ab4492f6 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:08.842572 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9fdba-1243-47cd-a6a8-e8c0ab4492f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:08.842915 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9fdba-1243-47cd-a6a8-e8c0ab4492f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:08.845702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-39f9fdba-1243-47cd-a6a8-e8c0ab4492f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:08.858558 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9fdba-1243-47cd-a6a8-e8c0ab4492f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:08.860291 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9fdba-1243-47cd-a6a8-e8c0ab4492f6 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:08.871447 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1353/2698] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:30:16.170926 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=9 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:18.866704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=6 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:43.555740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047baadd-65f7-4a43-95d6-eb7c63d5f2ee service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:43.557318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-047baadd-65f7-4a43-95d6-eb7c63d5f2ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:43.643685 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047baadd-65f7-4a43-95d6-eb7c63d5f2ee service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:43.647244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abbae6-21aa-4d07-9a3b-cbbed833250e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '803d0ab121784d688b58374aaa6a8e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:43.647851 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abbae6-21aa-4d07-9a3b-cbbed833250e service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:43.648161 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abbae6-21aa-4d07-9a3b-cbbed833250e service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:43.648434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abbae6-21aa-4d07-9a3b-cbbed833250e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:43.650171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f2abbae6-21aa-4d07-9a3b-cbbed833250e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:43.665398 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abbae6-21aa-4d07-9a3b-cbbed833250e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:43.667494 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abbae6-21aa-4d07-9a3b-cbbed833250e service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:43.681556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1346/2699] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:30:53.674423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=35 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:55.939592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f54c7c-b293-4865-ad7b-39569f8a7e52 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:55.940210 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f54c7c-b293-4865-ad7b-39569f8a7e52 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:55.940210 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f54c7c-b293-4865-ad7b-39569f8a7e52 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:55.941531 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1354/2700] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:30:55.946429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551b55e-234a-4bcf-939d-d74d8d1482a8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:55.946890 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551b55e-234a-4bcf-939d-d74d8d1482a8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:55.946998 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551b55e-234a-4bcf-939d-d74d8d1482a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:55.969939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-c551b55e-234a-4bcf-939d-d74d8d1482a8 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:55.971261 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c551b55e-234a-4bcf-939d-d74d8d1482a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:55.980411 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1347/2701] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:30:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:56.002487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f54c7c-b293-4865-ad7b-39569f8a7e52 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:56.017501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f54c7c-b293-4865-ad7b-39569f8a7e52 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:56.022616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd21ca7-55f9-4507-9e66-0fdcf1b1f301 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:56.023210 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd21ca7-55f9-4507-9e66-0fdcf1b1f301 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:56.023490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd21ca7-55f9-4507-9e66-0fdcf1b1f301 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:56.023758 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd21ca7-55f9-4507-9e66-0fdcf1b1f301 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:56.032319 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd21ca7-55f9-4507-9e66-0fdcf1b1f301 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:56.033907 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd21ca7-55f9-4507-9e66-0fdcf1b1f301 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:56.043445 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1355/2702] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:30:57.084638 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551b55e-234a-4bcf-939d-d74d8d1482a8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:57.095471 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551b55e-234a-4bcf-939d-d74d8d1482a8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:57.099069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bbb76-cfbb-4548-8d46-69a02189efc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:57.099677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bbb76-cfbb-4548-8d46-69a02189efc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:57.099992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bbb76-cfbb-4548-8d46-69a02189efc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:57.100262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bbb76-cfbb-4548-8d46-69a02189efc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:57.102037 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8b8bbb76-cfbb-4548-8d46-69a02189efc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:57.113738 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bbb76-cfbb-4548-8d46-69a02189efc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:57.115158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bbb76-cfbb-4548-8d46-69a02189efc8 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:57.123935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1348/2703] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:31:01.739056 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd21ca7-55f9-4507-9e66-0fdcf1b1f301 service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:01.740576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-0bd21ca7-55f9-4507-9e66-0fdcf1b1f301 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:01.756322 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd21ca7-55f9-4507-9e66-0fdcf1b1f301 service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:01.761644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e32ae5-2084-4242-913f-850d0fe2004d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:01.762230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e32ae5-2084-4242-913f-850d0fe2004d service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:01.762505 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e32ae5-2084-4242-913f-850d0fe2004d service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:01.762774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e32ae5-2084-4242-913f-850d0fe2004d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:01.770320 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e32ae5-2084-4242-913f-850d0fe2004d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:01.771870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e32ae5-2084-4242-913f-850d0fe2004d service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:01.781439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1356/2704] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:31:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:31:07.119779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=9 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:11.776961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=12 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:19.817874 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bbb76-cfbb-4548-8d46-69a02189efc8 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:19.833463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bbb76-cfbb-4548-8d46-69a02189efc8 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:19.839110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfec446-2e31-423f-8c83-97f33235f5b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:19.839820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfec446-2e31-423f-8c83-97f33235f5b0 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:19.840340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfec446-2e31-423f-8c83-97f33235f5b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:19.841363 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfec446-2e31-423f-8c83-97f33235f5b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:19.843195 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-fcfec446-2e31-423f-8c83-97f33235f5b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:19.858196 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfec446-2e31-423f-8c83-97f33235f5b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:19.859956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfec446-2e31-423f-8c83-97f33235f5b0 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:19.877286 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1349/2705] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:31:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:31:29.870715 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:03.608172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e32ae5-2084-4242-913f-850d0fe2004d service nova] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:03.627875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e32ae5-2084-4242-913f-850d0fe2004d service nova] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:03.631503 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cfbe3-d9ca-4321-af05-7df64cd551bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:03.632151 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cfbe3-d9ca-4321-af05-7df64cd551bb service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:03.632410 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cfbe3-d9ca-4321-af05-7df64cd551bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:03.632791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cfbe3-d9ca-4321-af05-7df64cd551bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:03.664354 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cfbe3-d9ca-4321-af05-7df64cd551bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:03.665790 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cfbe3-d9ca-4321-af05-7df64cd551bb service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:03.675440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1357/2706] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:06.765135 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfec446-2e31-423f-8c83-97f33235f5b0 service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:06.831532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cfbe3-d9ca-4321-af05-7df64cd551bb service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:06.842767 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cfbe3-d9ca-4321-af05-7df64cd551bb service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:06.848619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd669ba-f34c-4b07-b068-ea675f529194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:06.849453 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd669ba-f34c-4b07-b068-ea675f529194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:06.849729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd669ba-f34c-4b07-b068-ea675f529194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:06.850174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd669ba-f34c-4b07-b068-ea675f529194 admin admin] PATH_INFO: `/v3/users/82155c52edb74e559083be82b44112b9` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:06.851373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd669ba-f34c-4b07-b068-ea675f529194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82155c52edb74e559083be82b44112b9)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:06.852084 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfec446-2e31-423f-8c83-97f33235f5b0 service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:06.854000 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd669ba-f34c-4b07-b068-ea675f529194 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:06.858302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43890c7-2fc7-4596-971c-156eac324afa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:06.859001 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43890c7-2fc7-4596-971c-156eac324afa service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:06.859356 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43890c7-2fc7-4596-971c-156eac324afa service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:06.859697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43890c7-2fc7-4596-971c-156eac324afa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:06.861681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-c43890c7-2fc7-4596-971c-156eac324afa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:06.898446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43890c7-2fc7-4596-971c-156eac324afa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:06.900284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43890c7-2fc7-4596-971c-156eac324afa service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:06.909097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5dd669ba-f34c-4b07-b068-ea675f529194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82155c52edb74e559083be82b44112b9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:06.911643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1350/2707] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:06.916646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5dd669ba-f34c-4b07-b068-ea675f529194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82155c52edb74e559083be82b44112b9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:06.930319 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5dd669ba-f34c-4b07-b068-ea675f529194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82155c52edb74e559083be82b44112b9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:06.931201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5dd669ba-f34c-4b07-b068-ea675f529194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82155c52edb74e559083be82b44112b9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:06.932985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5dd669ba-f34c-4b07-b068-ea675f529194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82155c52edb74e559083be82b44112b9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:06.945954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1358/2708] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:32:06 2022] DELETE /identity/v3/users/82155c52edb74e559083be82b44112b9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:32:07.119638 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43890c7-2fc7-4596-971c-156eac324afa service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:07.131040 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43890c7-2fc7-4596-971c-156eac324afa service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:07.194736 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7899b-1949-406a-bfa1-7b991f6d7300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:07.195489 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7899b-1949-406a-bfa1-7b991f6d7300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:07.195641 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7899b-1949-406a-bfa1-7b991f6d7300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:07.196035 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7899b-1949-406a-bfa1-7b991f6d7300 admin admin] PATH_INFO: `/v3/projects/b313fe8a20284bf0a6a81d857ac473c3` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:07.197059 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7899b-1949-406a-bfa1-7b991f6d7300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b313fe8a20284bf0a6a81d857ac473c3)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:07.199530 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7899b-1949-406a-bfa1-7b991f6d7300 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:07.247137 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-07f7899b-1949-406a-bfa1-7b991f6d7300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b313fe8a20284bf0a6a81d857ac473c3', 'request_id': 'req-07f7899b-1949-406a-bfa1-7b991f6d7300'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:07.253415 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-07f7899b-1949-406a-bfa1-7b991f6d7300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b313fe8a20284bf0a6a81d857ac473c3', 'request_id': 'req-07f7899b-1949-406a-bfa1-7b991f6d7300'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:07.260254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-07f7899b-1949-406a-bfa1-7b991f6d7300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b313fe8a20284bf0a6a81d857ac473c3', 'request_id': 'req-07f7899b-1949-406a-bfa1-7b991f6d7300'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:07.272202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-07f7899b-1949-406a-bfa1-7b991f6d7300 admin admin] The token cache is being invalidate because project b313fe8a20284bf0a6a81d857ac473c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:07.272320 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-07f7899b-1949-406a-bfa1-7b991f6d7300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:07.272963 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-07f7899b-1949-406a-bfa1-7b991f6d7300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:07.274473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1351/2709] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:07 2022] DELETE /identity/v3/projects/b313fe8a20284bf0a6a81d857ac473c3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:07.279433 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaa35f-3215-4969-a56f-1f08a4239272 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:07.279719 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaa35f-3215-4969-a56f-1f08a4239272 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:07.280029 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaa35f-3215-4969-a56f-1f08a4239272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:07.300203 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-dedaa35f-3215-4969-a56f-1f08a4239272 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:07.301347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-dedaa35f-3215-4969-a56f-1f08a4239272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:07.359044 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1359/2710] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:07.366570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45d5c3-0984-4118-9868-59a94d8ef917 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:07.366882 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45d5c3-0984-4118-9868-59a94d8ef917 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:07.367158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45d5c3-0984-4118-9868-59a94d8ef917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:07.388292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7c45d5c3-0984-4118-9868-59a94d8ef917 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:07.389954 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7c45d5c3-0984-4118-9868-59a94d8ef917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:07.398404 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1352/2711] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:07.403114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaa35f-3215-4969-a56f-1f08a4239272 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:07.412761 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaa35f-3215-4969-a56f-1f08a4239272 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:07.417360 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46199d87-d600-4bae-ad61-d1fd98a2283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:07.417944 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46199d87-d600-4bae-ad61-d1fd98a2283b admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:07.418218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46199d87-d600-4bae-ad61-d1fd98a2283b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:07.418738 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46199d87-d600-4bae-ad61-d1fd98a2283b admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:07.419377 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46199d87-d600-4bae-ad61-d1fd98a2283b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:32:07.419672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46199d87-d600-4bae-ad61-d1fd98a2283b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:07.421294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46199d87-d600-4bae-ad61-d1fd98a2283b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:07.432840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1360/2712] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:32:07.436934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45d5c3-0984-4118-9868-59a94d8ef917 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:07.442544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:07.446509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45d5c3-0984-4118-9868-59a94d8ef917 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:07.453423 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ce673-33f4-4e7b-b4a8-8fb27e5fcc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:07.454180 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ce673-33f4-4e7b-b4a8-8fb27e5fcc90 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:07.454633 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ce673-33f4-4e7b-b4a8-8fb27e5fcc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:07.454967 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ce673-33f4-4e7b-b4a8-8fb27e5fcc90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:07.455754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ce673-33f4-4e7b-b4a8-8fb27e5fcc90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:07.457712 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ce673-33f4-4e7b-b4a8-8fb27e5fcc90 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:07.485674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1353/2713] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:07 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:07.490730 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46199d87-d600-4bae-ad61-d1fd98a2283b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:07.500813 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46199d87-d600-4bae-ad61-d1fd98a2283b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:07.512543 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:07.559263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071faad-e8d7-4c94-84fc-856d17276206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:07.559870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071faad-e8d7-4c94-84fc-856d17276206 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:07.560177 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071faad-e8d7-4c94-84fc-856d17276206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:07.560442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071faad-e8d7-4c94-84fc-856d17276206 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:07.561053 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071faad-e8d7-4c94-84fc-856d17276206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:07.562951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071faad-e8d7-4c94-84fc-856d17276206 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:07.583932 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1361/2714] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:32:07 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:07.588425 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ce673-33f4-4e7b-b4a8-8fb27e5fcc90 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:07.598663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ce673-33f4-4e7b-b4a8-8fb27e5fcc90 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:07.603220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce13d9-a540-4ce8-bb31-daa7abffc105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:07.603810 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce13d9-a540-4ce8-bb31-daa7abffc105 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:07.604121 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce13d9-a540-4ce8-bb31-daa7abffc105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:07.604391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce13d9-a540-4ce8-bb31-daa7abffc105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:07.605312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce13d9-a540-4ce8-bb31-daa7abffc105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:07.606911 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce13d9-a540-4ce8-bb31-daa7abffc105 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:07.616585 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1354/2715] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:07.621220 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071faad-e8d7-4c94-84fc-856d17276206 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:07.631011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071faad-e8d7-4c94-84fc-856d17276206 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:07.635615 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40039168-b9a3-4649-9139-1c5a96b0f5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:07.637062 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40039168-b9a3-4649-9139-1c5a96b0f5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:07.637344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40039168-b9a3-4649-9139-1c5a96b0f5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:07.637619 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40039168-b9a3-4649-9139-1c5a96b0f5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:07.638265 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40039168-b9a3-4649-9139-1c5a96b0f5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:07.639844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40039168-b9a3-4649-9139-1c5a96b0f5aa admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:07.650746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1362/2716] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:07.655321 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce13d9-a540-4ce8-bb31-daa7abffc105 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:07.665514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce13d9-a540-4ce8-bb31-daa7abffc105 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:07.670787 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f82da-c78c-4513-ad2e-d5f720692fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:07.671435 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f82da-c78c-4513-ad2e-d5f720692fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:07.671713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f82da-c78c-4513-ad2e-d5f720692fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:07.672085 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f82da-c78c-4513-ad2e-d5f720692fa2 admin admin] PATH_INFO: `/v3/projects/c0586377aa724b3ea2b39801186b0b9f/users/26be549eb9bd496bb4e9e731f7208217/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:07.687334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f82da-c78c-4513-ad2e-d5f720692fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0586377aa724b3ea2b39801186b0b9f, user_id=26be549eb9bd496bb4e9e731f7208217, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:07.690043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f82da-c78c-4513-ad2e-d5f720692fa2 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:07.703774 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1355/2717] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:07 2022] PUT /identity/v3/projects/c0586377aa724b3ea2b39801186b0b9f/users/26be549eb9bd496bb4e9e731f7208217/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:07.708764 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdb050-dd70-40e6-8325-4925900d163c None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:07.709052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdb050-dd70-40e6-8325-4925900d163c None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:07.709355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdb050-dd70-40e6-8325-4925900d163c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:07.731211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-8bbdb050-dd70-40e6-8325-4925900d163c None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:07.733368 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8bbdb050-dd70-40e6-8325-4925900d163c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:07.796303 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1363/2718] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:07.805927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f82da-c78c-4513-ad2e-d5f720692fa2 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:07.807674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e78f82da-c78c-4513-ad2e-d5f720692fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:07.863956 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f82da-c78c-4513-ad2e-d5f720692fa2 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:07.867566 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa8e74-d803-4e0e-8999-a89aefc0673a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:07.868194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa8e74-d803-4e0e-8999-a89aefc0673a service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:07.868473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa8e74-d803-4e0e-8999-a89aefc0673a service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:07.868743 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa8e74-d803-4e0e-8999-a89aefc0673a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:07.877711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa8e74-d803-4e0e-8999-a89aefc0673a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:07.879110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa8e74-d803-4e0e-8999-a89aefc0673a service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:07.889084 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1356/2719] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:11.658674 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b849e2-e67a-471d-ac0e-a99797cb710f None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:11.659147 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b849e2-e67a-471d-ac0e-a99797cb710f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:11.659242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b849e2-e67a-471d-ac0e-a99797cb710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:11.689683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-d7b849e2-e67a-471d-ac0e-a99797cb710f None None] MFA Rules not processed for user `26be549eb9bd496bb4e9e731f7208217`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:11.690998 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d7b849e2-e67a-471d-ac0e-a99797cb710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:11.762645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1364/2720] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:32:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:11.774244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db74a9e-a794-43e8-a458-a7986ac668b8 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:11.774850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db74a9e-a794-43e8-a458-a7986ac668b8 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:11.774850 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db74a9e-a794-43e8-a458-a7986ac668b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:11.795218 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5db74a9e-a794-43e8-a458-a7986ac668b8 None None] MFA Rules not processed for user `26be549eb9bd496bb4e9e731f7208217`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:11.796479 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5db74a9e-a794-43e8-a458-a7986ac668b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:11.803546 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1357/2721] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:32:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:32:11.814625 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b849e2-e67a-471d-ac0e-a99797cb710f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:11.816064 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d7b849e2-e67a-471d-ac0e-a99797cb710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:11.846536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:11.898225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b849e2-e67a-471d-ac0e-a99797cb710f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:11.904985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28d010-07e2-4df1-b4c2-73a17c9ff972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:11.905608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28d010-07e2-4df1-b4c2-73a17c9ff972 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:11.905981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28d010-07e2-4df1-b4c2-73a17c9ff972 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:11.906139 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28d010-07e2-4df1-b4c2-73a17c9ff972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:11.914881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28d010-07e2-4df1-b4c2-73a17c9ff972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:11.916516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28d010-07e2-4df1-b4c2-73a17c9ff972 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:11.928821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1365/2722] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:12.509263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db74a9e-a794-43e8-a458-a7986ac668b8 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:12.510763 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5db74a9e-a794-43e8-a458-a7986ac668b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:12.585216 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db74a9e-a794-43e8-a458-a7986ac668b8 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:12.591237 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac873a-625f-4088-9d13-07efcf262bb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:12.591854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac873a-625f-4088-9d13-07efcf262bb0 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:12.592161 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac873a-625f-4088-9d13-07efcf262bb0 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:12.592432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac873a-625f-4088-9d13-07efcf262bb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:12.594158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2aac873a-625f-4088-9d13-07efcf262bb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:12.606563 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac873a-625f-4088-9d13-07efcf262bb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:12.608216 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac873a-625f-4088-9d13-07efcf262bb0 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:12.618796 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1358/2723] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:13.122185 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28d010-07e2-4df1-b4c2-73a17c9ff972 service nova] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:13.123656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ef28d010-07e2-4df1-b4c2-73a17c9ff972 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:13.138903 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28d010-07e2-4df1-b4c2-73a17c9ff972 service nova] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:13.144828 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c7b4f-9b99-4fa0-80fd-1b0f378a6656 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:13.145507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c7b4f-9b99-4fa0-80fd-1b0f378a6656 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:13.146471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c7b4f-9b99-4fa0-80fd-1b0f378a6656 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:13.146471 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c7b4f-9b99-4fa0-80fd-1b0f378a6656 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:13.149266 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-fb8c7b4f-9b99-4fa0-80fd-1b0f378a6656 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:13.169419 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c7b4f-9b99-4fa0-80fd-1b0f378a6656 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:13.171118 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c7b4f-9b99-4fa0-80fd-1b0f378a6656 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:13.191023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1366/2724] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:32:22.141630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa70fa7-82b6-4851-b312-9c8ce0195219 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:22.142143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa70fa7-82b6-4851-b312-9c8ce0195219 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:22.142247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa70fa7-82b6-4851-b312-9c8ce0195219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:22.162991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-caa70fa7-82b6-4851-b312-9c8ce0195219 None None] MFA Rules not processed for user `26be549eb9bd496bb4e9e731f7208217`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:22.164212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-caa70fa7-82b6-4851-b312-9c8ce0195219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:22.172142 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1359/2725] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:23.177483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=29 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:32.158328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=86,keystone:INSERT=2 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:43.754950 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c7b4f-9b99-4fa0-80fd-1b0f378a6656 service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:43.791725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c7b4f-9b99-4fa0-80fd-1b0f378a6656 service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:43.796734 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19742f1a-50a7-46b3-b21a-b9049fb9ad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:43.797359 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742f1a-50a7-46b3-b21a-b9049fb9ad05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:43.797636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742f1a-50a7-46b3-b21a-b9049fb9ad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:43.797907 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742f1a-50a7-46b3-b21a-b9049fb9ad05 admin admin] PATH_INFO: `/v3/users/26be549eb9bd496bb4e9e731f7208217` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:43.799022 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19742f1a-50a7-46b3-b21a-b9049fb9ad05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26be549eb9bd496bb4e9e731f7208217)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:43.801013 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19742f1a-50a7-46b3-b21a-b9049fb9ad05 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:43.851412 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-19742f1a-50a7-46b3-b21a-b9049fb9ad05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26be549eb9bd496bb4e9e731f7208217'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:43.860013 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-19742f1a-50a7-46b3-b21a-b9049fb9ad05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26be549eb9bd496bb4e9e731f7208217'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:43.873347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-19742f1a-50a7-46b3-b21a-b9049fb9ad05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26be549eb9bd496bb4e9e731f7208217'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:43.873990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-19742f1a-50a7-46b3-b21a-b9049fb9ad05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26be549eb9bd496bb4e9e731f7208217'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:43.874607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-19742f1a-50a7-46b3-b21a-b9049fb9ad05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26be549eb9bd496bb4e9e731f7208217'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:43.887494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1367/2726] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:32:43 2022] DELETE /identity/v3/users/26be549eb9bd496bb4e9e731f7208217 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:44.065556 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa70fa7-82b6-4851-b312-9c8ce0195219 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:44.078549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa70fa7-82b6-4851-b312-9c8ce0195219 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:44.141524 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb6acd-8013-4374-92c3-a1fbbf0d5cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:44.142447 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb6acd-8013-4374-92c3-a1fbbf0d5cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.142960 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb6acd-8013-4374-92c3-a1fbbf0d5cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.143299 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb6acd-8013-4374-92c3-a1fbbf0d5cc7 admin admin] PATH_INFO: `/v3/projects/c0586377aa724b3ea2b39801186b0b9f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.145646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb6acd-8013-4374-92c3-a1fbbf0d5cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0586377aa724b3ea2b39801186b0b9f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:44.147551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb6acd-8013-4374-92c3-a1fbbf0d5cc7 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:44.195368 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b5fb6acd-8013-4374-92c3-a1fbbf0d5cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0586377aa724b3ea2b39801186b0b9f', 'request_id': 'req-b5fb6acd-8013-4374-92c3-a1fbbf0d5cc7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:44.202299 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b5fb6acd-8013-4374-92c3-a1fbbf0d5cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0586377aa724b3ea2b39801186b0b9f', 'request_id': 'req-b5fb6acd-8013-4374-92c3-a1fbbf0d5cc7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:44.209613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b5fb6acd-8013-4374-92c3-a1fbbf0d5cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0586377aa724b3ea2b39801186b0b9f', 'request_id': 'req-b5fb6acd-8013-4374-92c3-a1fbbf0d5cc7'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:44.233539 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b5fb6acd-8013-4374-92c3-a1fbbf0d5cc7 admin admin] The token cache is being invalidate because project c0586377aa724b3ea2b39801186b0b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:44.233756 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b5fb6acd-8013-4374-92c3-a1fbbf0d5cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:44.234382 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-b5fb6acd-8013-4374-92c3-a1fbbf0d5cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:44.235863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1360/2727] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:44 2022] DELETE /identity/v3/projects/c0586377aa724b3ea2b39801186b0b9f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:44.240780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044414c1-74ab-48fe-8b95-60c2607fdb98 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.241067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044414c1-74ab-48fe-8b95-60c2607fdb98 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.241341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044414c1-74ab-48fe-8b95-60c2607fdb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.269719 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-044414c1-74ab-48fe-8b95-60c2607fdb98 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:44.270936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-044414c1-74ab-48fe-8b95-60c2607fdb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:44.331418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1368/2728] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:44.339484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02853-ef88-46e3-8098-59ade213d28d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.339877 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02853-ef88-46e3-8098-59ade213d28d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.340289 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02853-ef88-46e3-8098-59ade213d28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.360204 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-f6d02853-ef88-46e3-8098-59ade213d28d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:44.361390 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f6d02853-ef88-46e3-8098-59ade213d28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:44.369772 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1361/2729] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:44.374420 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044414c1-74ab-48fe-8b95-60c2607fdb98 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:44.384274 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044414c1-74ab-48fe-8b95-60c2607fdb98 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:44.390065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcf143-69cf-49be-81fd-ce73ad46ffbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:44.390669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcf143-69cf-49be-81fd-ce73ad46ffbe admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.390948 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcf143-69cf-49be-81fd-ce73ad46ffbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.391219 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcf143-69cf-49be-81fd-ce73ad46ffbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.391869 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcf143-69cf-49be-81fd-ce73ad46ffbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:32:44.392821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcf143-69cf-49be-81fd-ce73ad46ffbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:44.394429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcf143-69cf-49be-81fd-ce73ad46ffbe admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:44.406773 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1369/2730] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:44.411243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02853-ef88-46e3-8098-59ade213d28d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:44.421192 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02853-ef88-46e3-8098-59ade213d28d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:44.425846 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f9b5f-85d6-482e-b80c-97d48416da9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:44.426433 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f9b5f-85d6-482e-b80c-97d48416da9e admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.426712 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f9b5f-85d6-482e-b80c-97d48416da9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.426983 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f9b5f-85d6-482e-b80c-97d48416da9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.427608 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f9b5f-85d6-482e-b80c-97d48416da9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:44.429529 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f9b5f-85d6-482e-b80c-97d48416da9e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:44.458022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1362/2731] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:44 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:44.461608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcf143-69cf-49be-81fd-ce73ad46ffbe admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:44.472319 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcf143-69cf-49be-81fd-ce73ad46ffbe admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:44.507035 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:44.532438 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5717d-2171-4ecc-91d6-a9a74b3957c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:44.533043 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5717d-2171-4ecc-91d6-a9a74b3957c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.533322 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5717d-2171-4ecc-91d6-a9a74b3957c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.533597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5717d-2171-4ecc-91d6-a9a74b3957c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.534232 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5717d-2171-4ecc-91d6-a9a74b3957c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:44.536172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5717d-2171-4ecc-91d6-a9a74b3957c3 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:44.557763 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1370/2732] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:32:44 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:44.562012 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f9b5f-85d6-482e-b80c-97d48416da9e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:44.572359 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f9b5f-85d6-482e-b80c-97d48416da9e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:44.577168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a7feb-7ed9-4341-861b-6921009173a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:44.577764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a7feb-7ed9-4341-861b-6921009173a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.578037 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a7feb-7ed9-4341-861b-6921009173a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.578307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a7feb-7ed9-4341-861b-6921009173a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.578937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a7feb-7ed9-4341-861b-6921009173a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:44.580554 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a7feb-7ed9-4341-861b-6921009173a0 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:44.591019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1363/2733] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:44.595470 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5717d-2171-4ecc-91d6-a9a74b3957c3 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:44.606298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5717d-2171-4ecc-91d6-a9a74b3957c3 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:44.610982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023af565-974c-4da5-8e72-d94ff80d6214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:44.611586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023af565-974c-4da5-8e72-d94ff80d6214 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.611867 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023af565-974c-4da5-8e72-d94ff80d6214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.612170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023af565-974c-4da5-8e72-d94ff80d6214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.612814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023af565-974c-4da5-8e72-d94ff80d6214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:44.614408 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023af565-974c-4da5-8e72-d94ff80d6214 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:44.624961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1371/2734] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:44.629032 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a7feb-7ed9-4341-861b-6921009173a0 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:44.639224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a7feb-7ed9-4341-861b-6921009173a0 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:44.643886 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4be5a2-e4c3-4d18-8f98-e4d800baf447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:44.644560 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4be5a2-e4c3-4d18-8f98-e4d800baf447 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.644834 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4be5a2-e4c3-4d18-8f98-e4d800baf447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.645100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4be5a2-e4c3-4d18-8f98-e4d800baf447 admin admin] PATH_INFO: `/v3/projects/d2de9452b8f040fea943d812d99b2673/users/85a02713ed184daea9a312475d54c7d2/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.660175 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4be5a2-e4c3-4d18-8f98-e4d800baf447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2de9452b8f040fea943d812d99b2673, user_id=85a02713ed184daea9a312475d54c7d2, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:44.662803 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4be5a2-e4c3-4d18-8f98-e4d800baf447 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:44.675919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1364/2735] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:44 2022] PUT /identity/v3/projects/d2de9452b8f040fea943d812d99b2673/users/85a02713ed184daea9a312475d54c7d2/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:44.687272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398aa77d-e347-4d7e-aa0c-8cadd2e1d721 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.687584 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398aa77d-e347-4d7e-aa0c-8cadd2e1d721 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.687862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398aa77d-e347-4d7e-aa0c-8cadd2e1d721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.716958 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-398aa77d-e347-4d7e-aa0c-8cadd2e1d721 None None] MFA Rules not processed for user `85a02713ed184daea9a312475d54c7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:44.718171 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-398aa77d-e347-4d7e-aa0c-8cadd2e1d721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:44.781766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1372/2736] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:44.792030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4be5a2-e4c3-4d18-8f98-e4d800baf447 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:44.793979 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cd4be5a2-e4c3-4d18-8f98-e4d800baf447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:44.813514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:44.876372 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4be5a2-e4c3-4d18-8f98-e4d800baf447 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:44.880119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2afd5d-6627-4bdf-b5f9-de2941d19f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:44.880725 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2afd5d-6627-4bdf-b5f9-de2941d19f74 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.880999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2afd5d-6627-4bdf-b5f9-de2941d19f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.881262 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2afd5d-6627-4bdf-b5f9-de2941d19f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.890061 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2afd5d-6627-4bdf-b5f9-de2941d19f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:44.891468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2afd5d-6627-4bdf-b5f9-de2941d19f74 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:44.900674 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1365/2737] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:32:50.861642 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398aa77d-e347-4d7e-aa0c-8cadd2e1d721 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:50.863237 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-398aa77d-e347-4d7e-aa0c-8cadd2e1d721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:50.966313 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398aa77d-e347-4d7e-aa0c-8cadd2e1d721 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:50.972390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb0eea-1315-4b0e-a2e2-0e6125b9a353 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:50.973150 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb0eea-1315-4b0e-a2e2-0e6125b9a353 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:50.973282 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb0eea-1315-4b0e-a2e2-0e6125b9a353 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:50.973694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb0eea-1315-4b0e-a2e2-0e6125b9a353 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:50.975935 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1ccb0eea-1315-4b0e-a2e2-0e6125b9a353 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:50.989914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb0eea-1315-4b0e-a2e2-0e6125b9a353 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:50.991712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb0eea-1315-4b0e-a2e2-0e6125b9a353 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:51.003645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1373/2738] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:54.896236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=28 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:57.847037 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2afd5d-6627-4bdf-b5f9-de2941d19f74 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:57.909972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2afd5d-6627-4bdf-b5f9-de2941d19f74 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:57.914788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8b271-d31b-4d0a-9706-21bb417a3c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:57.915995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8b271-d31b-4d0a-9706-21bb417a3c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:57.916271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8b271-d31b-4d0a-9706-21bb417a3c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:57.916542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8b271-d31b-4d0a-9706-21bb417a3c3c admin admin] PATH_INFO: `/v3/users/85a02713ed184daea9a312475d54c7d2` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:57.917673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8b271-d31b-4d0a-9706-21bb417a3c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a02713ed184daea9a312475d54c7d2)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:57.919812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8b271-d31b-4d0a-9706-21bb417a3c3c admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:57.965134 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cef8b271-d31b-4d0a-9706-21bb417a3c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a02713ed184daea9a312475d54c7d2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:57.972984 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cef8b271-d31b-4d0a-9706-21bb417a3c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a02713ed184daea9a312475d54c7d2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:57.985688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cef8b271-d31b-4d0a-9706-21bb417a3c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a02713ed184daea9a312475d54c7d2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:57.992739 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cef8b271-d31b-4d0a-9706-21bb417a3c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a02713ed184daea9a312475d54c7d2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:57.993457 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-cef8b271-d31b-4d0a-9706-21bb417a3c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a02713ed184daea9a312475d54c7d2'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:57.999349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1366/2739] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:32:57 2022] DELETE /identity/v3/users/85a02713ed184daea9a312475d54c7d2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:58.003872 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c0e2a-d703-43c7-9cd8-c398df6177ed None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.004374 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c0e2a-d703-43c7-9cd8-c398df6177ed None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.004487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c0e2a-d703-43c7-9cd8-c398df6177ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.023239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-8c6c0e2a-d703-43c7-9cd8-c398df6177ed None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:58.025237 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8c6c0e2a-d703-43c7-9cd8-c398df6177ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:58.054978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:58.084804 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1374/2740] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:58.094979 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8b271-d31b-4d0a-9706-21bb417a3c3c admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:58.096420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-cef8b271-d31b-4d0a-9706-21bb417a3c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:58.153364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8b271-d31b-4d0a-9706-21bb417a3c3c admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:58.157064 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8200e8-e204-4001-a865-3442e92574e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:58.157663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8200e8-e204-4001-a865-3442e92574e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.157944 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8200e8-e204-4001-a865-3442e92574e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.158216 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8200e8-e204-4001-a865-3442e92574e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.167729 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8200e8-e204-4001-a865-3442e92574e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:58.169506 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8200e8-e204-4001-a865-3442e92574e4 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:58.178816 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1367/2741] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:58.353194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c0e2a-d703-43c7-9cd8-c398df6177ed None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:58.355108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8c6c0e2a-d703-43c7-9cd8-c398df6177ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:58.371688 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c0e2a-d703-43c7-9cd8-c398df6177ed None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:58.377063 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e49d0-600a-4ef8-a6e2-46ea9b9b7943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:58.377737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e49d0-600a-4ef8-a6e2-46ea9b9b7943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.377955 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e49d0-600a-4ef8-a6e2-46ea9b9b7943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.378226 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e49d0-600a-4ef8-a6e2-46ea9b9b7943 admin admin] PATH_INFO: `/v3/projects/d2de9452b8f040fea943d812d99b2673` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.379347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e49d0-600a-4ef8-a6e2-46ea9b9b7943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2de9452b8f040fea943d812d99b2673)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:58.381283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e49d0-600a-4ef8-a6e2-46ea9b9b7943 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:58.430236 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d79e49d0-600a-4ef8-a6e2-46ea9b9b7943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2de9452b8f040fea943d812d99b2673', 'request_id': 'req-d79e49d0-600a-4ef8-a6e2-46ea9b9b7943'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:58.436528 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d79e49d0-600a-4ef8-a6e2-46ea9b9b7943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2de9452b8f040fea943d812d99b2673', 'request_id': 'req-d79e49d0-600a-4ef8-a6e2-46ea9b9b7943'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:58.444685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d79e49d0-600a-4ef8-a6e2-46ea9b9b7943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2de9452b8f040fea943d812d99b2673', 'request_id': 'req-d79e49d0-600a-4ef8-a6e2-46ea9b9b7943'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:58.456040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d79e49d0-600a-4ef8-a6e2-46ea9b9b7943 admin admin] The token cache is being invalidate because project d2de9452b8f040fea943d812d99b2673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:58.456330 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d79e49d0-600a-4ef8-a6e2-46ea9b9b7943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:58.456956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-d79e49d0-600a-4ef8-a6e2-46ea9b9b7943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:58.458421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1375/2742] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:58 2022] DELETE /identity/v3/projects/d2de9452b8f040fea943d812d99b2673 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:58.464531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98fd69-b6be-46d7-a82f-24bf904208c3 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.464821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98fd69-b6be-46d7-a82f-24bf904208c3 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.465097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98fd69-b6be-46d7-a82f-24bf904208c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.504606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:58.510456 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1b98fd69-b6be-46d7-a82f-24bf904208c3 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:58.512274 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1b98fd69-b6be-46d7-a82f-24bf904208c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:58.570912 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1368/2743] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:32:58.579056 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88126731-a1a3-47eb-9c59-2d30330977ce None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.579339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88126731-a1a3-47eb-9c59-2d30330977ce None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.579608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88126731-a1a3-47eb-9c59-2d30330977ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.598734 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-88126731-a1a3-47eb-9c59-2d30330977ce None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:58.599926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-88126731-a1a3-47eb-9c59-2d30330977ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:58.607728 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1376/2744] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:58.611751 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98fd69-b6be-46d7-a82f-24bf904208c3 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:58.622150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98fd69-b6be-46d7-a82f-24bf904208c3 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:58.626714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492c040-25a5-4f4d-87ff-a14f52cee133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:58.627307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492c040-25a5-4f4d-87ff-a14f52cee133 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.627591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492c040-25a5-4f4d-87ff-a14f52cee133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.627863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492c040-25a5-4f4d-87ff-a14f52cee133 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.628538 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492c040-25a5-4f4d-87ff-a14f52cee133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:32:58.628842 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492c040-25a5-4f4d-87ff-a14f52cee133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:58.630451 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492c040-25a5-4f4d-87ff-a14f52cee133 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:58.642899 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1369/2745] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:58.647210 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88126731-a1a3-47eb-9c59-2d30330977ce None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:58.656788 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88126731-a1a3-47eb-9c59-2d30330977ce None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:58.661417 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee563a4e-a4dc-453e-9fa2-f8ccdea46c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:58.662011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee563a4e-a4dc-453e-9fa2-f8ccdea46c47 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.662293 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee563a4e-a4dc-453e-9fa2-f8ccdea46c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.662568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee563a4e-a4dc-453e-9fa2-f8ccdea46c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.663201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee563a4e-a4dc-453e-9fa2-f8ccdea46c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:58.665162 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee563a4e-a4dc-453e-9fa2-f8ccdea46c47 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:58.703414 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1377/2746] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:58 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:58.707607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492c040-25a5-4f4d-87ff-a14f52cee133 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:58.718090 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492c040-25a5-4f4d-87ff-a14f52cee133 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:58.773743 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dce2cb-e74c-494d-b9c8-6e6f309a0ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:58.774266 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dce2cb-e74c-494d-b9c8-6e6f309a0ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.774670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dce2cb-e74c-494d-b9c8-6e6f309a0ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.775134 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dce2cb-e74c-494d-b9c8-6e6f309a0ca6 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.775766 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dce2cb-e74c-494d-b9c8-6e6f309a0ca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:58.777695 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dce2cb-e74c-494d-b9c8-6e6f309a0ca6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:58.798243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1370/2747] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:32:58 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:58.802339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee563a4e-a4dc-453e-9fa2-f8ccdea46c47 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:58.813769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee563a4e-a4dc-453e-9fa2-f8ccdea46c47 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:58.818409 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39c576-009e-4b6d-8e7d-1d2fea197e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:58.819004 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39c576-009e-4b6d-8e7d-1d2fea197e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.819284 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39c576-009e-4b6d-8e7d-1d2fea197e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.819559 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39c576-009e-4b6d-8e7d-1d2fea197e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.820242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39c576-009e-4b6d-8e7d-1d2fea197e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:58.822581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39c576-009e-4b6d-8e7d-1d2fea197e89 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:58.832753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1378/2748] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:58.836443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dce2cb-e74c-494d-b9c8-6e6f309a0ca6 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:58.846508 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dce2cb-e74c-494d-b9c8-6e6f309a0ca6 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:58.851050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a7cfd-f404-4552-9cca-066194bc4c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:58.851639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a7cfd-f404-4552-9cca-066194bc4c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.851934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a7cfd-f404-4552-9cca-066194bc4c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.852212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a7cfd-f404-4552-9cca-066194bc4c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.852873 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a7cfd-f404-4552-9cca-066194bc4c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:58.854430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a7cfd-f404-4552-9cca-066194bc4c78 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:58.865079 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1371/2749] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:58.870341 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39c576-009e-4b6d-8e7d-1d2fea197e89 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:58.880683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39c576-009e-4b6d-8e7d-1d2fea197e89 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:58.886379 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a56dc9-e9be-4523-a248-04a22b1e626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:58.887022 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a56dc9-e9be-4523-a248-04a22b1e626e admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.887299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a56dc9-e9be-4523-a248-04a22b1e626e admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.887576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a56dc9-e9be-4523-a248-04a22b1e626e admin admin] PATH_INFO: `/v3/projects/12c4cc6f844442b9b590eb54e0a67605/users/6cabe8291de44a37a2897ac7f63f5c6f/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.902515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a56dc9-e9be-4523-a248-04a22b1e626e admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c4cc6f844442b9b590eb54e0a67605, user_id=6cabe8291de44a37a2897ac7f63f5c6f, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:58.905199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a56dc9-e9be-4523-a248-04a22b1e626e admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:58.918967 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1379/2750] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:58 2022] PUT /identity/v3/projects/12c4cc6f844442b9b590eb54e0a67605/users/6cabe8291de44a37a2897ac7f63f5c6f/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:58.928778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4f303-3e1e-4fb9-a60e-3c347f5f6c97 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.929088 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4f303-3e1e-4fb9-a60e-3c347f5f6c97 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.929355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4f303-3e1e-4fb9-a60e-3c347f5f6c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.956896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3fc4f303-3e1e-4fb9-a60e-3c347f5f6c97 None None] MFA Rules not processed for user `6cabe8291de44a37a2897ac7f63f5c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:58.958087 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3fc4f303-3e1e-4fb9-a60e-3c347f5f6c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:59.021455 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1372/2751] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:59.031376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a56dc9-e9be-4523-a248-04a22b1e626e admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:59.033126 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-34a56dc9-e9be-4523-a248-04a22b1e626e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:59.085553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:59.092247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a56dc9-e9be-4523-a248-04a22b1e626e admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:59.096577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64df927-f185-4119-be7d-4d0e487e3d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:59.097221 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64df927-f185-4119-be7d-4d0e487e3d0b service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:59.097536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64df927-f185-4119-be7d-4d0e487e3d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:59.097809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64df927-f185-4119-be7d-4d0e487e3d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:59.106981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64df927-f185-4119-be7d-4d0e487e3d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:59.108480 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64df927-f185-4119-be7d-4d0e487e3d0b service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:59.117310 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1380/2752] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:03.605541 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4f303-3e1e-4fb9-a60e-3c347f5f6c97 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:03.609921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:03.671105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4f303-3e1e-4fb9-a60e-3c347f5f6c97 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:03.675657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72957d-8a78-489b-bba9-0e2b0388c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:03.676311 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72957d-8a78-489b-bba9-0e2b0388c083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:03.676589 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72957d-8a78-489b-bba9-0e2b0388c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:03.676855 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72957d-8a78-489b-bba9-0e2b0388c083 admin admin] PATH_INFO: `/v3/users/6cabe8291de44a37a2897ac7f63f5c6f` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:03.677959 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72957d-8a78-489b-bba9-0e2b0388c083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cabe8291de44a37a2897ac7f63f5c6f)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:03.679851 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72957d-8a78-489b-bba9-0e2b0388c083 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:03.728322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8d72957d-8a78-489b-bba9-0e2b0388c083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cabe8291de44a37a2897ac7f63f5c6f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:03.735998 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8d72957d-8a78-489b-bba9-0e2b0388c083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cabe8291de44a37a2897ac7f63f5c6f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:03.748572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8d72957d-8a78-489b-bba9-0e2b0388c083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cabe8291de44a37a2897ac7f63f5c6f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:03.755456 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8d72957d-8a78-489b-bba9-0e2b0388c083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cabe8291de44a37a2897ac7f63f5c6f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:03.756164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-8d72957d-8a78-489b-bba9-0e2b0388c083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cabe8291de44a37a2897ac7f63f5c6f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:03.762657 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1373/2753] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:03 2022] DELETE /identity/v3/users/6cabe8291de44a37a2897ac7f63f5c6f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:03.767199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614d90a-a159-4971-bf33-969d50f3aefb None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:03.767658 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614d90a-a159-4971-bf33-969d50f3aefb None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:03.767749 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614d90a-a159-4971-bf33-969d50f3aefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:03.787015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-4614d90a-a159-4971-bf33-969d50f3aefb None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:03.788243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4614d90a-a159-4971-bf33-969d50f3aefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:03.846614 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1381/2754] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:03.856362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72957d-8a78-489b-bba9-0e2b0388c083 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:03.857863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-8d72957d-8a78-489b-bba9-0e2b0388c083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:03.920025 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72957d-8a78-489b-bba9-0e2b0388c083 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:03.923567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f5b76-d816-432f-9262-2fe69ee62ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:03.924210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f5b76-d816-432f-9262-2fe69ee62ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:03.924486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f5b76-d816-432f-9262-2fe69ee62ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:03.924755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f5b76-d816-432f-9262-2fe69ee62ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:03.934046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f5b76-d816-432f-9262-2fe69ee62ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:03.935484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f5b76-d816-432f-9262-2fe69ee62ec4 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:03.944826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1374/2755] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:04.121759 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614d90a-a159-4971-bf33-969d50f3aefb None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:04.123175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4614d90a-a159-4971-bf33-969d50f3aefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:04.139439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614d90a-a159-4971-bf33-969d50f3aefb None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:04.144966 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a875e-cff7-490e-af72-c7667f36a068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:04.145465 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a875e-cff7-490e-af72-c7667f36a068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:04.145743 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a875e-cff7-490e-af72-c7667f36a068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:04.146021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a875e-cff7-490e-af72-c7667f36a068 admin admin] PATH_INFO: `/v3/projects/12c4cc6f844442b9b590eb54e0a67605` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:04.147222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a875e-cff7-490e-af72-c7667f36a068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c4cc6f844442b9b590eb54e0a67605)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:04.149183 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a875e-cff7-490e-af72-c7667f36a068 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:04.198176 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b67a875e-cff7-490e-af72-c7667f36a068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c4cc6f844442b9b590eb54e0a67605', 'request_id': 'req-b67a875e-cff7-490e-af72-c7667f36a068'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:04.204327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b67a875e-cff7-490e-af72-c7667f36a068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c4cc6f844442b9b590eb54e0a67605', 'request_id': 'req-b67a875e-cff7-490e-af72-c7667f36a068'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:04.211683 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b67a875e-cff7-490e-af72-c7667f36a068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c4cc6f844442b9b590eb54e0a67605', 'request_id': 'req-b67a875e-cff7-490e-af72-c7667f36a068'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:04.223033 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b67a875e-cff7-490e-af72-c7667f36a068 admin admin] The token cache is being invalidate because project 12c4cc6f844442b9b590eb54e0a67605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:04.223323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b67a875e-cff7-490e-af72-c7667f36a068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:04.223977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b67a875e-cff7-490e-af72-c7667f36a068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:04.225458 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1382/2756] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:04 2022] DELETE /identity/v3/projects/12c4cc6f844442b9b590eb54e0a67605 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:04.230481 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fca81-55af-4919-b6e5-fe58ed61d5ea None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:04.230768 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fca81-55af-4919-b6e5-fe58ed61d5ea None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:04.231041 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fca81-55af-4919-b6e5-fe58ed61d5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:04.250546 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-741fca81-55af-4919-b6e5-fe58ed61d5ea None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:04.251726 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-741fca81-55af-4919-b6e5-fe58ed61d5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:04.271106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:04.314248 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1375/2757] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:04.323805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e33e1-7b95-4b89-ac4a-99befd3599be None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:04.324124 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e33e1-7b95-4b89-ac4a-99befd3599be None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:04.324401 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e33e1-7b95-4b89-ac4a-99befd3599be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:04.344435 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-cf4e33e1-7b95-4b89-ac4a-99befd3599be None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:04.345803 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-cf4e33e1-7b95-4b89-ac4a-99befd3599be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:04.353628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1383/2758] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:04.357857 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fca81-55af-4919-b6e5-fe58ed61d5ea None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:04.367752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fca81-55af-4919-b6e5-fe58ed61d5ea None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:04.372498 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d29c3-96fb-44c1-bf40-6d3505cc2097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:04.373111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d29c3-96fb-44c1-bf40-6d3505cc2097 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:04.373392 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d29c3-96fb-44c1-bf40-6d3505cc2097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:04.373664 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d29c3-96fb-44c1-bf40-6d3505cc2097 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:04.374333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d29c3-96fb-44c1-bf40-6d3505cc2097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:33:04.374614 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d29c3-96fb-44c1-bf40-6d3505cc2097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:04.376534 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d29c3-96fb-44c1-bf40-6d3505cc2097 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:04.389806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1376/2759] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:04.393895 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e33e1-7b95-4b89-ac4a-99befd3599be None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:04.403535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e33e1-7b95-4b89-ac4a-99befd3599be None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:04.408207 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40cb39-09dd-4d22-9e7c-1242f239c56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:04.408809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40cb39-09dd-4d22-9e7c-1242f239c56c admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:04.409089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40cb39-09dd-4d22-9e7c-1242f239c56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:04.409356 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40cb39-09dd-4d22-9e7c-1242f239c56c admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:04.409978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40cb39-09dd-4d22-9e7c-1242f239c56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:04.411870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40cb39-09dd-4d22-9e7c-1242f239c56c admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:04.440876 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1384/2760] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:04 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:04.444961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d29c3-96fb-44c1-bf40-6d3505cc2097 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:04.455705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d29c3-96fb-44c1-bf40-6d3505cc2097 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:04.515490 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39500e-2bbd-42c6-8fb3-3d4c64874767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:04.516127 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39500e-2bbd-42c6-8fb3-3d4c64874767 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:04.516410 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39500e-2bbd-42c6-8fb3-3d4c64874767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:04.516687 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39500e-2bbd-42c6-8fb3-3d4c64874767 admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:04.517335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39500e-2bbd-42c6-8fb3-3d4c64874767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:04.519240 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39500e-2bbd-42c6-8fb3-3d4c64874767 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:04.539587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1377/2761] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:04 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:04.544085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40cb39-09dd-4d22-9e7c-1242f239c56c admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:04.554541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40cb39-09dd-4d22-9e7c-1242f239c56c admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:04.559651 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aad133-0806-4451-a9bb-abf31e19cf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:04.560281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aad133-0806-4451-a9bb-abf31e19cf4c admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:04.560563 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aad133-0806-4451-a9bb-abf31e19cf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:04.560847 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aad133-0806-4451-a9bb-abf31e19cf4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:04.561483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aad133-0806-4451-a9bb-abf31e19cf4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:04.563066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aad133-0806-4451-a9bb-abf31e19cf4c admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:04.573493 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1385/2762] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:04.577406 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39500e-2bbd-42c6-8fb3-3d4c64874767 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:04.587884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39500e-2bbd-42c6-8fb3-3d4c64874767 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:04.592467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d8185-f55d-428d-a310-8de3d5f4dda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:04.593056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d8185-f55d-428d-a310-8de3d5f4dda8 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:04.593338 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d8185-f55d-428d-a310-8de3d5f4dda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:04.593611 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d8185-f55d-428d-a310-8de3d5f4dda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:04.594249 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d8185-f55d-428d-a310-8de3d5f4dda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:04.595826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d8185-f55d-428d-a310-8de3d5f4dda8 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:04.606288 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1378/2763] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:04.610390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aad133-0806-4451-a9bb-abf31e19cf4c admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:04.620707 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aad133-0806-4451-a9bb-abf31e19cf4c admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:04.625216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98827a6-abed-4ec9-a816-0d8ff348ed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:04.625852 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98827a6-abed-4ec9-a816-0d8ff348ed95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:04.626133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98827a6-abed-4ec9-a816-0d8ff348ed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:04.626444 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98827a6-abed-4ec9-a816-0d8ff348ed95 admin admin] PATH_INFO: `/v3/projects/81be5dbfb87445118989beec080e3fc5/users/579c4c6b6e0743a4a598cc49dd6ec9ef/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:04.641405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98827a6-abed-4ec9-a816-0d8ff348ed95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81be5dbfb87445118989beec080e3fc5, user_id=579c4c6b6e0743a4a598cc49dd6ec9ef, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:04.644098 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98827a6-abed-4ec9-a816-0d8ff348ed95 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:04.657468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1386/2764] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:04 2022] PUT /identity/v3/projects/81be5dbfb87445118989beec080e3fc5/users/579c4c6b6e0743a4a598cc49dd6ec9ef/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:04.662502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f678248-5129-41b4-af1a-250f8f86b189 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:04.662815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f678248-5129-41b4-af1a-250f8f86b189 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:04.663089 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f678248-5129-41b4-af1a-250f8f86b189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:04.682782 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-5f678248-5129-41b4-af1a-250f8f86b189 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:04.684022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5f678248-5129-41b4-af1a-250f8f86b189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:04.742755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1379/2765] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:04.753213 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98827a6-abed-4ec9-a816-0d8ff348ed95 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:04.754950 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e98827a6-abed-4ec9-a816-0d8ff348ed95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:04.767101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:04.815175 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98827a6-abed-4ec9-a816-0d8ff348ed95 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:04.818936 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0b265-ab46-4086-8869-f775a6c0cd62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:04.819538 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0b265-ab46-4086-8869-f775a6c0cd62 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:04.819816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0b265-ab46-4086-8869-f775a6c0cd62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:04.820129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0b265-ab46-4086-8869-f775a6c0cd62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:04.829857 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0b265-ab46-4086-8869-f775a6c0cd62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:04.831283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0b265-ab46-4086-8869-f775a6c0cd62 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:04.841177 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1387/2766] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:08.810807 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e7396-ceae-45c9-a8d5-90ef148f24d0 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:08.811342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e7396-ceae-45c9-a8d5-90ef148f24d0 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:08.811342 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e7396-ceae-45c9-a8d5-90ef148f24d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:08.843583 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-731e7396-ceae-45c9-a8d5-90ef148f24d0 None None] MFA Rules not processed for user `579c4c6b6e0743a4a598cc49dd6ec9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:08.844918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-731e7396-ceae-45c9-a8d5-90ef148f24d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:08.865257 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:08.918678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1380/2767] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:33:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:08.923292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0b265-ab46-4086-8869-f775a6c0cd62 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:08.933769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0b265-ab46-4086-8869-f775a6c0cd62 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:08.938390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bfe9c-300d-44c9-a4a3-d1f2b42edd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:08.939057 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bfe9c-300d-44c9-a4a3-d1f2b42edd7b admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:08.939405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bfe9c-300d-44c9-a4a3-d1f2b42edd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:08.939748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bfe9c-300d-44c9-a4a3-d1f2b42edd7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:08.940488 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bfe9c-300d-44c9-a4a3-d1f2b42edd7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:08.942454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bfe9c-300d-44c9-a4a3-d1f2b42edd7b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:08.975446 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1388/2768] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:08 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:08.980099 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e7396-ceae-45c9-a8d5-90ef148f24d0 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:08.991362 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e7396-ceae-45c9-a8d5-90ef148f24d0 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:09.053521 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f808b0-011d-4030-8e0a-8b35ee1e807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:09.054148 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f808b0-011d-4030-8e0a-8b35ee1e807e admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:09.054430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f808b0-011d-4030-8e0a-8b35ee1e807e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:09.054704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f808b0-011d-4030-8e0a-8b35ee1e807e admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:09.055609 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f808b0-011d-4030-8e0a-8b35ee1e807e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:09.057518 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f808b0-011d-4030-8e0a-8b35ee1e807e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:09.079431 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1381/2769] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:08 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:09.083380 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bfe9c-300d-44c9-a4a3-d1f2b42edd7b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:09.094674 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bfe9c-300d-44c9-a4a3-d1f2b42edd7b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:09.099665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f16d6-c585-4f24-869d-a9087119acb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:09.100318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f16d6-c585-4f24-869d-a9087119acb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:09.100602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f16d6-c585-4f24-869d-a9087119acb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:09.100901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f16d6-c585-4f24-869d-a9087119acb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:09.101580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f16d6-c585-4f24-869d-a9087119acb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:09.103820 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f16d6-c585-4f24-869d-a9087119acb2 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:09.115236 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1389/2770] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:09.119638 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f808b0-011d-4030-8e0a-8b35ee1e807e admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:09.147082 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f808b0-011d-4030-8e0a-8b35ee1e807e admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:09.155528 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6c667-36f9-4035-a25d-c34396c3180d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:09.156395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6c667-36f9-4035-a25d-c34396c3180d admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:09.156681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6c667-36f9-4035-a25d-c34396c3180d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:09.156960 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6c667-36f9-4035-a25d-c34396c3180d admin admin] PATH_INFO: `/v3/projects/479642e9312743acab2af6525268a134/users/1d14189e024a4cc9a27366f944b99185/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:09.178083 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6c667-36f9-4035-a25d-c34396c3180d admin admin] RBAC: Authorizing `identity:create_grant(project_id=479642e9312743acab2af6525268a134, user_id=1d14189e024a4cc9a27366f944b99185, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:09.181014 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6c667-36f9-4035-a25d-c34396c3180d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:09.201056 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1382/2771] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:09 2022] PUT /identity/v3/projects/479642e9312743acab2af6525268a134/users/1d14189e024a4cc9a27366f944b99185/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:09.204828 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f16d6-c585-4f24-869d-a9087119acb2 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:09.217168 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f16d6-c585-4f24-869d-a9087119acb2 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:09.285842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50af54-c9ca-4ff4-a6db-131114315912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:09.286612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50af54-c9ca-4ff4-a6db-131114315912 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:09.286965 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50af54-c9ca-4ff4-a6db-131114315912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:09.287313 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50af54-c9ca-4ff4-a6db-131114315912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:09.288079 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50af54-c9ca-4ff4-a6db-131114315912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:09.290531 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50af54-c9ca-4ff4-a6db-131114315912 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:09.301833 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1390/2772] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:09.306613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6c667-36f9-4035-a25d-c34396c3180d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:09.318358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6c667-36f9-4035-a25d-c34396c3180d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:09.325100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a5ea6-57df-4d38-80f4-a71eadd84987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:09.326249 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a5ea6-57df-4d38-80f4-a71eadd84987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:09.326482 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a5ea6-57df-4d38-80f4-a71eadd84987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:09.326761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a5ea6-57df-4d38-80f4-a71eadd84987 admin admin] PATH_INFO: `/v3/projects/479642e9312743acab2af6525268a134/users/1d14189e024a4cc9a27366f944b99185/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:09.328788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a5ea6-57df-4d38-80f4-a71eadd84987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479642e9312743acab2af6525268a134, user_id=1d14189e024a4cc9a27366f944b99185, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:09.331612 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a5ea6-57df-4d38-80f4-a71eadd84987 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:09.347408 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1383/2773] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:09 2022] PUT /identity/v3/projects/479642e9312743acab2af6525268a134/users/1d14189e024a4cc9a27366f944b99185/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:13.678642 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b32739-d0cb-4a89-af85-40bca56ed679 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:13.679523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b32739-d0cb-4a89-af85-40bca56ed679 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:13.680014 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b32739-d0cb-4a89-af85-40bca56ed679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:13.710987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-95b32739-d0cb-4a89-af85-40bca56ed679 None None] MFA Rules not processed for user `1d14189e024a4cc9a27366f944b99185`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:13.712793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-95b32739-d0cb-4a89-af85-40bca56ed679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:13.816538 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:13.819780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1391/2774] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:13.836004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a5ea6-57df-4d38-80f4-a71eadd84987 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:13.838636 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-630a5ea6-57df-4d38-80f4-a71eadd84987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:13.939071 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a5ea6-57df-4d38-80f4-a71eadd84987 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:13.945672 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ed314-f253-489f-9d75-d251f0865a63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:13.946145 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ed314-f253-489f-9d75-d251f0865a63 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:13.946432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ed314-f253-489f-9d75-d251f0865a63 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:13.946706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ed314-f253-489f-9d75-d251f0865a63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:13.957971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:14.015284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ed314-f253-489f-9d75-d251f0865a63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:14.017042 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ed314-f253-489f-9d75-d251f0865a63 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:14.027071 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1384/2775] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:14.096722 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615acb3-872c-426c-8cbd-c52d2ec58785 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:14.097147 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615acb3-872c-426c-8cbd-c52d2ec58785 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:14.097620 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615acb3-872c-426c-8cbd-c52d2ec58785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:14.117529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e615acb3-872c-426c-8cbd-c52d2ec58785 None None] MFA Rules not processed for user `579c4c6b6e0743a4a598cc49dd6ec9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:14.118878 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e615acb3-872c-426c-8cbd-c52d2ec58785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:14.126222 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1392/2776] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:33:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:24.022316 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=23 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:24.111739 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:26.958169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ed314-f253-489f-9d75-d251f0865a63 service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:26.959550 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ef5ed314-f253-489f-9d75-d251f0865a63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:27.017131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ed314-f253-489f-9d75-d251f0865a63 service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:27.020844 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c45506-60ae-4065-8fbe-b75c37c8711f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '803d0ab121784d688b58374aaa6a8e7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:27.021482 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c45506-60ae-4065-8fbe-b75c37c8711f service cinder] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:27.021764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c45506-60ae-4065-8fbe-b75c37c8711f service cinder] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:27.022036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c45506-60ae-4065-8fbe-b75c37c8711f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:27.031786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c45506-60ae-4065-8fbe-b75c37c8711f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:27.033243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c45506-60ae-4065-8fbe-b75c37c8711f service cinder] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:27.042753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1385/2777] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:37.038434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=26 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:53.471835 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647065b-8c08-45dd-9c26-3e2bd2d8f847 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:53.472415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647065b-8c08-45dd-9c26-3e2bd2d8f847 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:53.472415 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647065b-8c08-45dd-9c26-3e2bd2d8f847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:53.490786 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-5647065b-8c08-45dd-9c26-3e2bd2d8f847 None None] MFA Rules not processed for user `579c4c6b6e0743a4a598cc49dd6ec9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:53.492728 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5647065b-8c08-45dd-9c26-3e2bd2d8f847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:53.500711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1393/2778] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:33:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:03.485704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:30.105558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6369b-ddd3-44e6-aac2-793b5a159420 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:30.106096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6369b-ddd3-44e6-aac2-793b5a159420 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:30.106096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6369b-ddd3-44e6-aac2-793b5a159420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:30.125773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-24a6369b-ddd3-44e6-aac2-793b5a159420 None None] MFA Rules not processed for user `579c4c6b6e0743a4a598cc49dd6ec9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:30.126959 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-24a6369b-ddd3-44e6-aac2-793b5a159420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:30.134474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1386/2779] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:34:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:40.120613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:12.976325 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647065b-8c08-45dd-9c26-3e2bd2d8f847 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:13.048974 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647065b-8c08-45dd-9c26-3e2bd2d8f847 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:13.053721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156a0e1-7a53-4480-803e-1fcc987d32ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:13.054350 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156a0e1-7a53-4480-803e-1fcc987d32ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:13.054630 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156a0e1-7a53-4480-803e-1fcc987d32ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:13.054905 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156a0e1-7a53-4480-803e-1fcc987d32ee admin admin] PATH_INFO: `/v3/users/579c4c6b6e0743a4a598cc49dd6ec9ef` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:13.056071 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156a0e1-7a53-4480-803e-1fcc987d32ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=579c4c6b6e0743a4a598cc49dd6ec9ef)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:13.057985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156a0e1-7a53-4480-803e-1fcc987d32ee admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:13.103698 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a156a0e1-7a53-4480-803e-1fcc987d32ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579c4c6b6e0743a4a598cc49dd6ec9ef'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:13.111252 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a156a0e1-7a53-4480-803e-1fcc987d32ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579c4c6b6e0743a4a598cc49dd6ec9ef'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:13.123836 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a156a0e1-7a53-4480-803e-1fcc987d32ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579c4c6b6e0743a4a598cc49dd6ec9ef'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:13.124518 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a156a0e1-7a53-4480-803e-1fcc987d32ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579c4c6b6e0743a4a598cc49dd6ec9ef'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:13.125180 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-a156a0e1-7a53-4480-803e-1fcc987d32ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579c4c6b6e0743a4a598cc49dd6ec9ef'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:13.137563 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1394/2780] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:35:12 2022] DELETE /identity/v3/users/579c4c6b6e0743a4a598cc49dd6ec9ef => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:13.315352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6369b-ddd3-44e6-aac2-793b5a159420 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:13.328255 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6369b-ddd3-44e6-aac2-793b5a159420 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:13.392076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7cb61-6d66-460e-9c38-0fda759bcb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:13.392709 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7cb61-6d66-460e-9c38-0fda759bcb09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:13.392991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7cb61-6d66-460e-9c38-0fda759bcb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:13.393260 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7cb61-6d66-460e-9c38-0fda759bcb09 admin admin] PATH_INFO: `/v3/projects/81be5dbfb87445118989beec080e3fc5` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:13.394500 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7cb61-6d66-460e-9c38-0fda759bcb09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81be5dbfb87445118989beec080e3fc5)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:13.396511 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7cb61-6d66-460e-9c38-0fda759bcb09 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:13.443494 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d0c7cb61-6d66-460e-9c38-0fda759bcb09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81be5dbfb87445118989beec080e3fc5', 'request_id': 'req-d0c7cb61-6d66-460e-9c38-0fda759bcb09'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:13.449540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d0c7cb61-6d66-460e-9c38-0fda759bcb09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81be5dbfb87445118989beec080e3fc5', 'request_id': 'req-d0c7cb61-6d66-460e-9c38-0fda759bcb09'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:13.457032 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d0c7cb61-6d66-460e-9c38-0fda759bcb09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81be5dbfb87445118989beec080e3fc5', 'request_id': 'req-d0c7cb61-6d66-460e-9c38-0fda759bcb09'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:13.467874 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d0c7cb61-6d66-460e-9c38-0fda759bcb09 admin admin] The token cache is being invalidate because project 81be5dbfb87445118989beec080e3fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:35:13.468186 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d0c7cb61-6d66-460e-9c38-0fda759bcb09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:13.468804 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-d0c7cb61-6d66-460e-9c38-0fda759bcb09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:13.470270 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1387/2781] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:35:13 2022] DELETE /identity/v3/projects/81be5dbfb87445118989beec080e3fc5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:13.474930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156a0e1-7a53-4480-803e-1fcc987d32ee admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:13.476362 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a156a0e1-7a53-4480-803e-1fcc987d32ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:13.489201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156a0e1-7a53-4480-803e-1fcc987d32ee admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:13.544660 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5154e-1e62-411c-9382-fc8767cd6533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:13.545287 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5154e-1e62-411c-9382-fc8767cd6533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:13.545565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5154e-1e62-411c-9382-fc8767cd6533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:13.545842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5154e-1e62-411c-9382-fc8767cd6533 admin admin] PATH_INFO: `/v3/users/1d14189e024a4cc9a27366f944b99185` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:13.546967 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5154e-1e62-411c-9382-fc8767cd6533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d14189e024a4cc9a27366f944b99185)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:13.548920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5154e-1e62-411c-9382-fc8767cd6533 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:13.571501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:13.598668 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5ca5154e-1e62-411c-9382-fc8767cd6533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d14189e024a4cc9a27366f944b99185'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:13.606273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5ca5154e-1e62-411c-9382-fc8767cd6533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d14189e024a4cc9a27366f944b99185'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:13.618653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5ca5154e-1e62-411c-9382-fc8767cd6533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d14189e024a4cc9a27366f944b99185'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:13.619225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5ca5154e-1e62-411c-9382-fc8767cd6533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d14189e024a4cc9a27366f944b99185'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:13.619825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-5ca5154e-1e62-411c-9382-fc8767cd6533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d14189e024a4cc9a27366f944b99185'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:13.632859 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1395/2782] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:35:13 2022] DELETE /identity/v3/users/1d14189e024a4cc9a27366f944b99185 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:35:14.141189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7cb61-6d66-460e-9c38-0fda759bcb09 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:14.142647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d0c7cb61-6d66-460e-9c38-0fda759bcb09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:14.156629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7cb61-6d66-460e-9c38-0fda759bcb09 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:14.212852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a514d-4a8e-4c0f-b784-81d682ee4999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:14.213487 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a514d-4a8e-4c0f-b784-81d682ee4999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.213762 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a514d-4a8e-4c0f-b784-81d682ee4999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.214030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a514d-4a8e-4c0f-b784-81d682ee4999 admin admin] PATH_INFO: `/v3/projects/479642e9312743acab2af6525268a134` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.215114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a514d-4a8e-4c0f-b784-81d682ee4999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=479642e9312743acab2af6525268a134)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:14.217036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a514d-4a8e-4c0f-b784-81d682ee4999 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:14.251096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:14.265119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c55a514d-4a8e-4c0f-b784-81d682ee4999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479642e9312743acab2af6525268a134', 'request_id': 'req-c55a514d-4a8e-4c0f-b784-81d682ee4999'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:14.271389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c55a514d-4a8e-4c0f-b784-81d682ee4999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479642e9312743acab2af6525268a134', 'request_id': 'req-c55a514d-4a8e-4c0f-b784-81d682ee4999'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:14.278806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c55a514d-4a8e-4c0f-b784-81d682ee4999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479642e9312743acab2af6525268a134', 'request_id': 'req-c55a514d-4a8e-4c0f-b784-81d682ee4999'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:14.289836 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c55a514d-4a8e-4c0f-b784-81d682ee4999 admin admin] The token cache is being invalidate because project 479642e9312743acab2af6525268a134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:35:14.290120 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c55a514d-4a8e-4c0f-b784-81d682ee4999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:14.290770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-c55a514d-4a8e-4c0f-b784-81d682ee4999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:14.292474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1388/2783] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:35:14 2022] DELETE /identity/v3/projects/479642e9312743acab2af6525268a134 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:14.297321 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41bd2d-8d1b-4f7d-9737-7f93e67a3473 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.297792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41bd2d-8d1b-4f7d-9737-7f93e67a3473 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.297888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41bd2d-8d1b-4f7d-9737-7f93e67a3473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.317716 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3c41bd2d-8d1b-4f7d-9737-7f93e67a3473 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:14.318919 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3c41bd2d-8d1b-4f7d-9737-7f93e67a3473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:14.377829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1396/2784] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:14.386735 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61398d-8a22-4c22-83cd-2f33d3544b6f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.387251 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61398d-8a22-4c22-83cd-2f33d3544b6f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.387348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61398d-8a22-4c22-83cd-2f33d3544b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.408185 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-fc61398d-8a22-4c22-83cd-2f33d3544b6f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:14.409419 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-fc61398d-8a22-4c22-83cd-2f33d3544b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:14.418352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1389/2785] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:14.422616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41bd2d-8d1b-4f7d-9737-7f93e67a3473 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:14.432439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41bd2d-8d1b-4f7d-9737-7f93e67a3473 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:14.437014 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6947a-1648-4a5f-9469-2dfed72c62f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:14.437610 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6947a-1648-4a5f-9469-2dfed72c62f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.437890 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6947a-1648-4a5f-9469-2dfed72c62f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.438164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6947a-1648-4a5f-9469-2dfed72c62f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.438808 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6947a-1648-4a5f-9469-2dfed72c62f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:35:14.439105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6947a-1648-4a5f-9469-2dfed72c62f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:14.440741 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6947a-1648-4a5f-9469-2dfed72c62f4 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:14.452973 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1397/2786] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:35:14.458021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61398d-8a22-4c22-83cd-2f33d3544b6f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:14.467921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61398d-8a22-4c22-83cd-2f33d3544b6f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:14.474327 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b981235-7fb5-47ee-b24a-d8c1ee41d14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:14.475139 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b981235-7fb5-47ee-b24a-d8c1ee41d14b admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.475526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b981235-7fb5-47ee-b24a-d8c1ee41d14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.475886 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b981235-7fb5-47ee-b24a-d8c1ee41d14b admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.476750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b981235-7fb5-47ee-b24a-d8c1ee41d14b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:14.478615 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b981235-7fb5-47ee-b24a-d8c1ee41d14b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:14.508019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1390/2787] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:35:14 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:14.512255 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6947a-1648-4a5f-9469-2dfed72c62f4 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:14.522825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6947a-1648-4a5f-9469-2dfed72c62f4 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:14.578649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d0f08-4961-4b59-bdca-f0b5231b3d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:14.579245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d0f08-4961-4b59-bdca-f0b5231b3d86 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.579523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d0f08-4961-4b59-bdca-f0b5231b3d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.579794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d0f08-4961-4b59-bdca-f0b5231b3d86 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.580449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d0f08-4961-4b59-bdca-f0b5231b3d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:14.582971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d0f08-4961-4b59-bdca-f0b5231b3d86 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:14.603924 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1398/2788] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:35:14 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:14.608166 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b981235-7fb5-47ee-b24a-d8c1ee41d14b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:14.619224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b981235-7fb5-47ee-b24a-d8c1ee41d14b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:14.623896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8899e-e805-47f1-b121-67b84192a19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:14.624509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8899e-e805-47f1-b121-67b84192a19b admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.624790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8899e-e805-47f1-b121-67b84192a19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.625055 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8899e-e805-47f1-b121-67b84192a19b admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.625681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8899e-e805-47f1-b121-67b84192a19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:14.627253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8899e-e805-47f1-b121-67b84192a19b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:14.640752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1391/2789] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:14.641726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d0f08-4961-4b59-bdca-f0b5231b3d86 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:14.652343 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d0f08-4961-4b59-bdca-f0b5231b3d86 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:14.656974 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784171c-7f1e-4fe9-8a04-187173902af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:14.657567 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784171c-7f1e-4fe9-8a04-187173902af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.657845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784171c-7f1e-4fe9-8a04-187173902af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.658117 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784171c-7f1e-4fe9-8a04-187173902af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.658878 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784171c-7f1e-4fe9-8a04-187173902af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:14.660725 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784171c-7f1e-4fe9-8a04-187173902af6 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:14.671366 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1399/2790] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:35:14.676470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8899e-e805-47f1-b121-67b84192a19b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:14.686405 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8899e-e805-47f1-b121-67b84192a19b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:14.691696 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c3d3b-7230-4de7-b11f-fa8399c04c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:14.692403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c3d3b-7230-4de7-b11f-fa8399c04c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.692680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c3d3b-7230-4de7-b11f-fa8399c04c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.692977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c3d3b-7230-4de7-b11f-fa8399c04c73 admin admin] PATH_INFO: `/v3/projects/af9ac4ac27f64f4786573750e2964c46/users/4c702a1a26984b0f857c085967d956ae/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.707673 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c3d3b-7230-4de7-b11f-fa8399c04c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9ac4ac27f64f4786573750e2964c46, user_id=4c702a1a26984b0f857c085967d956ae, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:14.710357 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c3d3b-7230-4de7-b11f-fa8399c04c73 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:14.723650 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1392/2791] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:35:14 2022] PUT /identity/v3/projects/af9ac4ac27f64f4786573750e2964c46/users/4c702a1a26984b0f857c085967d956ae/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:14.728773 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ca820-fd23-4dae-b362-9b5e45a643ef None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.729061 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ca820-fd23-4dae-b362-9b5e45a643ef None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.729333 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ca820-fd23-4dae-b362-9b5e45a643ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.737211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:14.751724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3c0ca820-fd23-4dae-b362-9b5e45a643ef None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:14.752982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3c0ca820-fd23-4dae-b362-9b5e45a643ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:14.813558 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1400/2792] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:14.823820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c3d3b-7230-4de7-b11f-fa8399c04c73 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:14.825549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-184c3d3b-7230-4de7-b11f-fa8399c04c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:14.882692 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c3d3b-7230-4de7-b11f-fa8399c04c73 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:14.886303 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca77b6c-2f4a-43df-b822-9a1d71d8a5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:14.886906 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77b6c-2f4a-43df-b822-9a1d71d8a5af service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.887189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77b6c-2f4a-43df-b822-9a1d71d8a5af service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.887460 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77b6c-2f4a-43df-b822-9a1d71d8a5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.897019 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca77b6c-2f4a-43df-b822-9a1d71d8a5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:14.898367 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca77b6c-2f4a-43df-b822-9a1d71d8a5af service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:14.907924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1393/2793] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:18.654575 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dad62-fe98-4189-89df-e0cec030af4b None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:18.655449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dad62-fe98-4189-89df-e0cec030af4b None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:18.655731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dad62-fe98-4189-89df-e0cec030af4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:18.684350 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-624dad62-fe98-4189-89df-e0cec030af4b None None] MFA Rules not processed for user `4c702a1a26984b0f857c085967d956ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:18.685598 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-624dad62-fe98-4189-89df-e0cec030af4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:18.754596 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1401/2794] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:35:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:18.759181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca77b6c-2f4a-43df-b822-9a1d71d8a5af service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:18.769080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca77b6c-2f4a-43df-b822-9a1d71d8a5af service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:18.774017 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a38046-d958-4c96-b348-6d5ff15b63eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:18.774611 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a38046-d958-4c96-b348-6d5ff15b63eb admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:18.774898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a38046-d958-4c96-b348-6d5ff15b63eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:18.775161 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a38046-d958-4c96-b348-6d5ff15b63eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:18.775779 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a38046-d958-4c96-b348-6d5ff15b63eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:18.777720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a38046-d958-4c96-b348-6d5ff15b63eb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:18.808394 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1394/2795] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:35:18 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:18.809553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dad62-fe98-4189-89df-e0cec030af4b None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:18.824110 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dad62-fe98-4189-89df-e0cec030af4b None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:18.887075 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce8c20-717a-455f-a80b-72aed72782fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:18.887688 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce8c20-717a-455f-a80b-72aed72782fe admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:18.888009 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce8c20-717a-455f-a80b-72aed72782fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:18.888288 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce8c20-717a-455f-a80b-72aed72782fe admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:18.888926 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce8c20-717a-455f-a80b-72aed72782fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:18.890867 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce8c20-717a-455f-a80b-72aed72782fe admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:18.913966 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1402/2796] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:35:18 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:35:18.918212 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a38046-d958-4c96-b348-6d5ff15b63eb admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:18.930007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a38046-d958-4c96-b348-6d5ff15b63eb admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:18.934966 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532b0ac-2204-4908-b09d-2d26e478bcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:18.935645 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532b0ac-2204-4908-b09d-2d26e478bcbf admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:18.935976 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532b0ac-2204-4908-b09d-2d26e478bcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:18.936273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532b0ac-2204-4908-b09d-2d26e478bcbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:18.936923 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532b0ac-2204-4908-b09d-2d26e478bcbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:18.938543 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532b0ac-2204-4908-b09d-2d26e478bcbf admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:18.949826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1395/2797] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:18.954042 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce8c20-717a-455f-a80b-72aed72782fe admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:18.965217 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce8c20-717a-455f-a80b-72aed72782fe admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:18.970197 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54db4b1-9634-4be1-902f-0965ef178f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:18.970985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54db4b1-9634-4be1-902f-0965ef178f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:18.971129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54db4b1-9634-4be1-902f-0965ef178f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:18.971405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54db4b1-9634-4be1-902f-0965ef178f98 admin admin] PATH_INFO: `/v3/projects/160e460e2bec4c74b91e2dce7d2d112a/users/1b224c99e8b94c778a329de6d4b1aa5f/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:19.005253 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54db4b1-9634-4be1-902f-0965ef178f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=160e460e2bec4c74b91e2dce7d2d112a, user_id=1b224c99e8b94c778a329de6d4b1aa5f, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:19.010773 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54db4b1-9634-4be1-902f-0965ef178f98 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:19.019765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:19.025325 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1403/2798] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:35:18 2022] PUT /identity/v3/projects/160e460e2bec4c74b91e2dce7d2d112a/users/1b224c99e8b94c778a329de6d4b1aa5f/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:35:19.029312 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532b0ac-2204-4908-b09d-2d26e478bcbf admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:19.044948 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532b0ac-2204-4908-b09d-2d26e478bcbf admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:19.072273 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:19.110532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bee06-2a0f-499c-a47b-84930f5af359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:19.111184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bee06-2a0f-499c-a47b-84930f5af359 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:19.111472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bee06-2a0f-499c-a47b-84930f5af359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:19.111749 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bee06-2a0f-499c-a47b-84930f5af359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:19.112445 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bee06-2a0f-499c-a47b-84930f5af359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:19.115219 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bee06-2a0f-499c-a47b-84930f5af359 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:19.126469 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1396/2799] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:19.131322 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54db4b1-9634-4be1-902f-0965ef178f98 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:19.142267 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54db4b1-9634-4be1-902f-0965ef178f98 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:19.147281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c4612-845c-419b-86fe-904f3b03b7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:19.147989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c4612-845c-419b-86fe-904f3b03b7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:19.148271 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c4612-845c-419b-86fe-904f3b03b7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:19.148548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c4612-845c-419b-86fe-904f3b03b7b5 admin admin] PATH_INFO: `/v3/projects/160e460e2bec4c74b91e2dce7d2d112a/users/1b224c99e8b94c778a329de6d4b1aa5f/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:19.150522 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c4612-845c-419b-86fe-904f3b03b7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=160e460e2bec4c74b91e2dce7d2d112a, user_id=1b224c99e8b94c778a329de6d4b1aa5f, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:19.153482 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c4612-845c-419b-86fe-904f3b03b7b5 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:19.164856 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1404/2800] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:35:19 2022] PUT /identity/v3/projects/160e460e2bec4c74b91e2dce7d2d112a/users/1b224c99e8b94c778a329de6d4b1aa5f/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:23.520694 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461eeab-e2fd-42f9-b1c2-1d8e76fad10e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:23.521143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461eeab-e2fd-42f9-b1c2-1d8e76fad10e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:23.521292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461eeab-e2fd-42f9-b1c2-1d8e76fad10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:23.553748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b461eeab-e2fd-42f9-b1c2-1d8e76fad10e None None] MFA Rules not processed for user `1b224c99e8b94c778a329de6d4b1aa5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:23.554995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b461eeab-e2fd-42f9-b1c2-1d8e76fad10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:23.640678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1397/2801] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:35:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:23.650052 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c4612-845c-419b-86fe-904f3b03b7b5 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:23.654151 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8a2c4612-845c-419b-86fe-904f3b03b7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:23.762666 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c4612-845c-419b-86fe-904f3b03b7b5 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:23.767733 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae718ab-a0fd-4550-bdeb-6230449843ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345c25e7dd2341bcb4c53d0a5aa36b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:23.768491 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae718ab-a0fd-4550-bdeb-6230449843ba service glance] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:23.769610 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae718ab-a0fd-4550-bdeb-6230449843ba service glance] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:23.769999 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae718ab-a0fd-4550-bdeb-6230449843ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:23.841095 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae718ab-a0fd-4550-bdeb-6230449843ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:23.842541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae718ab-a0fd-4550-bdeb-6230449843ba service glance] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:23.854046 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1405/2802] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:24.018085 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0a3f-fca0-43cd-a14c-5df10aef8bde None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:24.018501 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0a3f-fca0-43cd-a14c-5df10aef8bde None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:24.019127 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0a3f-fca0-43cd-a14c-5df10aef8bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:24.101786 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-72fb0a3f-fca0-43cd-a14c-5df10aef8bde None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:24.103319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-72fb0a3f-fca0-43cd-a14c-5df10aef8bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:24.203501 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1398/2803] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 01:35:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:24.255871 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae718ab-a0fd-4550-bdeb-6230449843ba service glance] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:24.257611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-fae718ab-a0fd-4550-bdeb-6230449843ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:24.358552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:24.361697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae718ab-a0fd-4550-bdeb-6230449843ba service glance] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:24.368563 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe6621-e686-4526-9fb6-5dceaa78227a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:24.369196 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe6621-e686-4526-9fb6-5dceaa78227a service swift] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:24.369474 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe6621-e686-4526-9fb6-5dceaa78227a service swift] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:24.369754 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe6621-e686-4526-9fb6-5dceaa78227a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:24.379282 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe6621-e686-4526-9fb6-5dceaa78227a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:24.380954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe6621-e686-4526-9fb6-5dceaa78227a service swift] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:24.390434 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1406/2804] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 01:35:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:33.142509 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd5a3c-bb90-4222-83c5-8ce39cee805b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:33.143098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd5a3c-bb90-4222-83c5-8ce39cee805b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:33.143205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd5a3c-bb90-4222-83c5-8ce39cee805b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:33.161855 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3bcd5a3c-bb90-4222-83c5-8ce39cee805b None None] MFA Rules not processed for user `4c702a1a26984b0f857c085967d956ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:33.163050 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3bcd5a3c-bb90-4222-83c5-8ce39cee805b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:33.170125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1399/2805] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:35:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:33.212424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe6621-e686-4526-9fb6-5dceaa78227a service swift] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:33.222238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe6621-e686-4526-9fb6-5dceaa78227a service swift] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:33.225977 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72109025-2c69-4641-b8ed-c641053953ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345c25e7dd2341bcb4c53d0a5aa36b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:33.226596 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72109025-2c69-4641-b8ed-c641053953ff service glance] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:33.226880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72109025-2c69-4641-b8ed-c641053953ff service glance] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:33.227154 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72109025-2c69-4641-b8ed-c641053953ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:33.228929 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-72109025-2c69-4641-b8ed-c641053953ff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:33.312807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72109025-2c69-4641-b8ed-c641053953ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:33.314249 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72109025-2c69-4641-b8ed-c641053953ff service glance] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:33.334811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1407/2806] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:33.572052 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd5a3c-bb90-4222-83c5-8ce39cee805b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:33.581335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=100 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:33.630080 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd5a3c-bb90-4222-83c5-8ce39cee805b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:33.633804 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbea02-1366-4469-96e4-66d5be74b92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:33.634422 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbea02-1366-4469-96e4-66d5be74b92e service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:33.634706 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbea02-1366-4469-96e4-66d5be74b92e service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:33.634979 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbea02-1366-4469-96e4-66d5be74b92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:33.640680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-65cbea02-1366-4469-96e4-66d5be74b92e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:33.647293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbea02-1366-4469-96e4-66d5be74b92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:33.648773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbea02-1366-4469-96e4-66d5be74b92e service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:33.657274 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1400/2807] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:35.279448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc8375-ecd2-4a15-b3bf-28a70c5a9257 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:35.279968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc8375-ecd2-4a15-b3bf-28a70c5a9257 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:35.280275 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc8375-ecd2-4a15-b3bf-28a70c5a9257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:35.301154 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-13cc8375-ecd2-4a15-b3bf-28a70c5a9257 None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:35.302389 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-13cc8375-ecd2-4a15-b3bf-28a70c5a9257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:35.309644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1408/2808] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 01:35:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:35.322992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbea02-1366-4469-96e4-66d5be74b92e service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:35.336182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbea02-1366-4469-96e4-66d5be74b92e service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:35.341205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77109d2e-bd97-43f0-9478-3ce4edadc848 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:35.341942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77109d2e-bd97-43f0-9478-3ce4edadc848 service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:35.342225 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77109d2e-bd97-43f0-9478-3ce4edadc848 service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:35.342498 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77109d2e-bd97-43f0-9478-3ce4edadc848 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:35.351947 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77109d2e-bd97-43f0-9478-3ce4edadc848 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:35.353532 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77109d2e-bd97-43f0-9478-3ce4edadc848 service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:35.363380 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1401/2809] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 01:35:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:43.311816 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc8375-ecd2-4a15-b3bf-28a70c5a9257 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:43.313536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-13cc8375-ecd2-4a15-b3bf-28a70c5a9257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:43.332074 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc8375-ecd2-4a15-b3bf-28a70c5a9257 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:43.338185 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b0158-713a-42e9-b851-ca9d53270327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:43.338802 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b0158-713a-42e9-b851-ca9d53270327 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:43.339085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b0158-713a-42e9-b851-ca9d53270327 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:43.339355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b0158-713a-42e9-b851-ca9d53270327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:43.341121 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b86b0158-713a-42e9-b851-ca9d53270327 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:43.354181 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b0158-713a-42e9-b851-ca9d53270327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:43.355776 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b0158-713a-42e9-b851-ca9d53270327 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:43.367354 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1409/2810] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:44.696770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77109d2e-bd97-43f0-9478-3ce4edadc848 service swift] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:44.706985 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77109d2e-bd97-43f0-9478-3ce4edadc848 service swift] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:44.710912 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbb4cc-ebd6-44ec-a947-0559f9022510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:44.711587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbb4cc-ebd6-44ec-a947-0559f9022510 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:44.711962 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbb4cc-ebd6-44ec-a947-0559f9022510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:44.712242 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbb4cc-ebd6-44ec-a947-0559f9022510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:44.714341 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-26bbb4cc-ebd6-44ec-a947-0559f9022510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:44.729540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbb4cc-ebd6-44ec-a947-0559f9022510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:44.730986 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbb4cc-ebd6-44ec-a947-0559f9022510 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:44.742913 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1402/2811] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:53.363378 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=56 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:54.738700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=35 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:06.619985 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b0158-713a-42e9-b851-ca9d53270327 service nova] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:06.629981 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b0158-713a-42e9-b851-ca9d53270327 service nova] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:06.633552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c73c9-f950-4485-b775-efca0c2830e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:06.634142 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c73c9-f950-4485-b775-efca0c2830e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:06.634416 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c73c9-f950-4485-b775-efca0c2830e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:06.634686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c73c9-f950-4485-b775-efca0c2830e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:06.645195 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c73c9-f950-4485-b775-efca0c2830e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:06.646621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c73c9-f950-4485-b775-efca0c2830e9 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:06.656355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1410/2812] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:36:08.313499 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbb4cc-ebd6-44ec-a947-0559f9022510 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:08.323892 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbb4cc-ebd6-44ec-a947-0559f9022510 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:08.327675 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672c9b4-7505-46ad-b94b-7c8235cc239c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:08.328321 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672c9b4-7505-46ad-b94b-7c8235cc239c service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:08.328598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672c9b4-7505-46ad-b94b-7c8235cc239c service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:08.328866 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672c9b4-7505-46ad-b94b-7c8235cc239c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:08.331230 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b672c9b4-7505-46ad-b94b-7c8235cc239c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:08.341734 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672c9b4-7505-46ad-b94b-7c8235cc239c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:08.342769 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672c9b4-7505-46ad-b94b-7c8235cc239c service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:08.355061 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1403/2813] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:36:16.652208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=6 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:18.347960 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:18.566974 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c73c9-f950-4485-b775-efca0c2830e9 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:18.568423 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-387c73c9-f950-4485-b775-efca0c2830e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:18.635520 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c73c9-f950-4485-b775-efca0c2830e9 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:18.640687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39002f2-0b80-413a-b043-a3ff9c342d90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:18.641322 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39002f2-0b80-413a-b043-a3ff9c342d90 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:18.641599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39002f2-0b80-413a-b043-a3ff9c342d90 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:18.641866 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39002f2-0b80-413a-b043-a3ff9c342d90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:18.643607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-f39002f2-0b80-413a-b043-a3ff9c342d90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:18.655827 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39002f2-0b80-413a-b043-a3ff9c342d90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:18.657414 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39002f2-0b80-413a-b043-a3ff9c342d90 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:18.667129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1411/2814] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:37:28.662982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=32 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:19.184782 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6841e-8b56-46ed-84c4-1684215244c4 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:19.185302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6841e-8b56-46ed-84c4-1684215244c4 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:19.185406 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6841e-8b56-46ed-84c4-1684215244c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:19.215319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-87c6841e-8b56-46ed-84c4-1684215244c4 None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:39:19.216552 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-87c6841e-8b56-46ed-84c4-1684215244c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:19.223591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1404/2815] 10.222.0.20 () {58 vars in 967 bytes} [Sun Aug 7 01:39:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:39:19.264944 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39002f2-0b80-413a-b043-a3ff9c342d90 service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:19.276794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39002f2-0b80-413a-b043-a3ff9c342d90 service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:19.281713 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c4141-358f-4d92-afe7-9fd8a663cc02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:19.282299 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c4141-358f-4d92-afe7-9fd8a663cc02 service swift] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:19.282576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c4141-358f-4d92-afe7-9fd8a663cc02 service swift] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:19.282847 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c4141-358f-4d92-afe7-9fd8a663cc02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:19.291700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c4141-358f-4d92-afe7-9fd8a663cc02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:19.293577 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c4141-358f-4d92-afe7-9fd8a663cc02 service swift] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:19.301694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1412/2816] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 01:39:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:39:19.827376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e0e9b-5d11-40d1-aece-54c9ed6cd9a2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:19.827660 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e0e9b-5d11-40d1-aece-54c9ed6cd9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:19.827951 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e0e9b-5d11-40d1-aece-54c9ed6cd9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:19.846755 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e15e0e9b-5d11-40d1-aece-54c9ed6cd9a2 None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:39:19.847969 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e15e0e9b-5d11-40d1-aece-54c9ed6cd9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:19.855538 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1405/2817] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 01:39:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:39:19.867546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c4141-358f-4d92-afe7-9fd8a663cc02 service swift] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:19.878901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c4141-358f-4d92-afe7-9fd8a663cc02 service swift] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:19.883954 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcb1b3-0e20-4c56-b130-97730f4e7023 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:19.884553 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcb1b3-0e20-4c56-b130-97730f4e7023 service swift] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:19.884935 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcb1b3-0e20-4c56-b130-97730f4e7023 service swift] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:19.885211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcb1b3-0e20-4c56-b130-97730f4e7023 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:19.893593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcb1b3-0e20-4c56-b130-97730f4e7023 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:19.895116 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcb1b3-0e20-4c56-b130-97730f4e7023 service swift] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:19.903131 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1413/2818] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 01:39:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:39:28.052663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d2e0e-9cd2-4eff-b0df-fd7d50a9fead None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:28.053188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d2e0e-9cd2-4eff-b0df-fd7d50a9fead None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:28.053285 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d2e0e-9cd2-4eff-b0df-fd7d50a9fead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:28.072548 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e73d2e0e-9cd2-4eff-b0df-fd7d50a9fead None None] MFA Rules not processed for user `4c702a1a26984b0f857c085967d956ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:39:28.073741 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e73d2e0e-9cd2-4eff-b0df-fd7d50a9fead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:28.080484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1406/2819] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:39:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:39:29.668870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcb1b3-0e20-4c56-b130-97730f4e7023 service swift] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:29.681173 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcb1b3-0e20-4c56-b130-97730f4e7023 service swift] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:29.686166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b65e0-95cb-4adb-98b8-d8d19f691bb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:29.686763 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b65e0-95cb-4adb-98b8-d8d19f691bb6 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:29.687065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b65e0-95cb-4adb-98b8-d8d19f691bb6 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:29.687333 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b65e0-95cb-4adb-98b8-d8d19f691bb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:29.689134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8e0b65e0-95cb-4adb-98b8-d8d19f691bb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:29.702592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b65e0-95cb-4adb-98b8-d8d19f691bb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:29.704225 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b65e0-95cb-4adb-98b8-d8d19f691bb6 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:29.716314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1414/2820] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:39:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:39:34.057468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6918-a341-4967-a0ed-ebf44e6a96c6 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:34.057988 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6918-a341-4967-a0ed-ebf44e6a96c6 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:34.058098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6918-a341-4967-a0ed-ebf44e6a96c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:34.078852 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7e5d6918-a341-4967-a0ed-ebf44e6a96c6 None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:39:34.080166 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7e5d6918-a341-4967-a0ed-ebf44e6a96c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:34.089083 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1407/2821] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 01:39:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:39:34.102083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b65e0-95cb-4adb-98b8-d8d19f691bb6 service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:34.114765 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b65e0-95cb-4adb-98b8-d8d19f691bb6 service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:34.121321 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b3afd-21ea-4bd1-ad85-55a950ee71bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:34.122230 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b3afd-21ea-4bd1-ad85-55a950ee71bf service swift] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:34.122679 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b3afd-21ea-4bd1-ad85-55a950ee71bf service swift] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:34.123106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b3afd-21ea-4bd1-ad85-55a950ee71bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:34.132565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b3afd-21ea-4bd1-ad85-55a950ee71bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:34.134989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b3afd-21ea-4bd1-ad85-55a950ee71bf service swift] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:34.143865 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1415/2822] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 01:39:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:39:44.074097 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=16 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:44.140881 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=24 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:48.297752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d6918-a341-4967-a0ed-ebf44e6a96c6 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:48.312258 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d6918-a341-4967-a0ed-ebf44e6a96c6 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:48.317729 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6595f-f157-4050-bfdb-d1cd0e561ebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:48.318345 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6595f-f157-4050-bfdb-d1cd0e561ebe service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:48.318631 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6595f-f157-4050-bfdb-d1cd0e561ebe service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:48.318902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6595f-f157-4050-bfdb-d1cd0e561ebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:48.320705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-43f6595f-f157-4050-bfdb-d1cd0e561ebe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:48.333551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6595f-f157-4050-bfdb-d1cd0e561ebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:48.335152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6595f-f157-4050-bfdb-d1cd0e561ebe service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:48.346446 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1408/2823] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:39:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:39:58.341752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:23.604371 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b3afd-21ea-4bd1-ad85-55a950ee71bf service swift] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:23.613804 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b3afd-21ea-4bd1-ad85-55a950ee71bf service swift] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:23.618320 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dfad0-3bbd-4f74-8fa8-899789b017cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:23.618952 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dfad0-3bbd-4f74-8fa8-899789b017cc service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:23.619227 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dfad0-3bbd-4f74-8fa8-899789b017cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:23.619497 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dfad0-3bbd-4f74-8fa8-899789b017cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:23.628393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dfad0-3bbd-4f74-8fa8-899789b017cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:23.629814 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dfad0-3bbd-4f74-8fa8-899789b017cc service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:23.641963 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1416/2824] 10.222.0.20 () {60 vars in 1396 bytes} [Sun Aug 7 01:40:23 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3262 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:40:32.230778 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6595f-f157-4050-bfdb-d1cd0e561ebe service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:32.240063 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6595f-f157-4050-bfdb-d1cd0e561ebe service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:32.244187 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b918b-4f6f-4562-b0f0-98b362927a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:32.244764 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b918b-4f6f-4562-b0f0-98b362927a67 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:32.245044 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b918b-4f6f-4562-b0f0-98b362927a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:32.245310 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b918b-4f6f-4562-b0f0-98b362927a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:32.255252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b918b-4f6f-4562-b0f0-98b362927a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:32.257278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b918b-4f6f-4562-b0f0-98b362927a67 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:32.268361 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1409/2825] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:40:33.635845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=6 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:42.263360 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:13.813957 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dfad0-3bbd-4f74-8fa8-899789b017cc service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:13.831662 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dfad0-3bbd-4f74-8fa8-899789b017cc service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:13.840155 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb437fb0-98b7-46d9-a8f3-1c98c7e57a89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:13.841087 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb437fb0-98b7-46d9-a8f3-1c98c7e57a89 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:13.841592 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb437fb0-98b7-46d9-a8f3-1c98c7e57a89 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:13.842131 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb437fb0-98b7-46d9-a8f3-1c98c7e57a89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:13.868641 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb437fb0-98b7-46d9-a8f3-1c98c7e57a89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:13.870671 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb437fb0-98b7-46d9-a8f3-1c98c7e57a89 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:13.883296 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1417/2826] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:13.954432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b918b-4f6f-4562-b0f0-98b362927a67 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:13.965864 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b918b-4f6f-4562-b0f0-98b362927a67 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:13.975128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4f61f-6128-441f-931f-27b9498a59aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:13.975768 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4f61f-6128-441f-931f-27b9498a59aa service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:13.977870 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4f61f-6128-441f-931f-27b9498a59aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:13.978172 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4f61f-6128-441f-931f-27b9498a59aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:13.997845 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4f61f-6128-441f-931f-27b9498a59aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:14.000131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4f61f-6128-441f-931f-27b9498a59aa service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:14.012234 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1410/2827] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:23.878668 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=6 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:24.007287 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:25.446796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb437fb0-98b7-46d9-a8f3-1c98c7e57a89 service nova] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:25.456371 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb437fb0-98b7-46d9-a8f3-1c98c7e57a89 service nova] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:25.460082 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0481-daa2-4b02-81ff-8340f4f53002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:25.460678 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0481-daa2-4b02-81ff-8340f4f53002 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:25.460958 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0481-daa2-4b02-81ff-8340f4f53002 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:25.461234 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced0481-daa2-4b02-81ff-8340f4f53002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:25.471321 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced0481-daa2-4b02-81ff-8340f4f53002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:25.472823 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced0481-daa2-4b02-81ff-8340f4f53002 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:25.483462 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1418/2828] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:27.835811 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdc2c5-0aea-4d10-a83e-dd53796ec8b7 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:27.836325 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdc2c5-0aea-4d10-a83e-dd53796ec8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:27.836431 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdc2c5-0aea-4d10-a83e-dd53796ec8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:27.855372 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-e0fdc2c5-0aea-4d10-a83e-dd53796ec8b7 None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:27.856586 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-e0fdc2c5-0aea-4d10-a83e-dd53796ec8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:27.864428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1411/2829] 10.222.0.20 () {58 vars in 967 bytes} [Sun Aug 7 01:41:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:27.903348 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0481-daa2-4b02-81ff-8340f4f53002 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:27.915674 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced0481-daa2-4b02-81ff-8340f4f53002 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:27.921015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564aef1-9f17-4182-963d-3957711b490e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:27.921635 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564aef1-9f17-4182-963d-3957711b490e service swift] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:27.921911 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564aef1-9f17-4182-963d-3957711b490e service swift] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:27.922184 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564aef1-9f17-4182-963d-3957711b490e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:27.930724 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564aef1-9f17-4182-963d-3957711b490e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:27.932339 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564aef1-9f17-4182-963d-3957711b490e service swift] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:27.940344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1419/2830] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 01:41:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:41:28.302133 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdc2c5-0aea-4d10-a83e-dd53796ec8b7 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:28.311597 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdc2c5-0aea-4d10-a83e-dd53796ec8b7 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:28.315089 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975f89b-9466-4070-91ce-608403a96673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:28.315683 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975f89b-9466-4070-91ce-608403a96673 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:28.316002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975f89b-9466-4070-91ce-608403a96673 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:28.316300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975f89b-9466-4070-91ce-608403a96673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:28.376284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975f89b-9466-4070-91ce-608403a96673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:28.377721 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975f89b-9466-4070-91ce-608403a96673 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:28.387177 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1412/2831] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:31.354787 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564aef1-9f17-4182-963d-3957711b490e service swift] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:31.356397 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2564aef1-9f17-4182-963d-3957711b490e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:31.371378 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564aef1-9f17-4182-963d-3957711b490e service swift] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:31.377056 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12c61b-54b9-47ba-9036-449cdb3e3d47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:31.377661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12c61b-54b9-47ba-9036-449cdb3e3d47 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:31.377969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12c61b-54b9-47ba-9036-449cdb3e3d47 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:31.378239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12c61b-54b9-47ba-9036-449cdb3e3d47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:31.380783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7e12c61b-54b9-47ba-9036-449cdb3e3d47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:31.392549 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12c61b-54b9-47ba-9036-449cdb3e3d47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:31.394133 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12c61b-54b9-47ba-9036-449cdb3e3d47 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:31.404748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1420/2832] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:41:34.470622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975f89b-9466-4070-91ce-608403a96673 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:34.483068 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975f89b-9466-4070-91ce-608403a96673 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:34.488378 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8852f2-17c0-4298-91ea-8c66044424b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:34.489292 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8852f2-17c0-4298-91ea-8c66044424b3 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:34.489769 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8852f2-17c0-4298-91ea-8c66044424b3 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:34.490208 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8852f2-17c0-4298-91ea-8c66044424b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:34.492379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6c8852f2-17c0-4298-91ea-8c66044424b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:34.505500 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8852f2-17c0-4298-91ea-8c66044424b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:34.507114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8852f2-17c0-4298-91ea-8c66044424b3 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:34.518355 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1413/2833] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:34.553956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12c61b-54b9-47ba-9036-449cdb3e3d47 service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:34.566544 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12c61b-54b9-47ba-9036-449cdb3e3d47 service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:34.571437 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40021e0b-92b3-47f1-851f-0d7222e37477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:34.572214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021e0b-92b3-47f1-851f-0d7222e37477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:34.572571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021e0b-92b3-47f1-851f-0d7222e37477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:34.572921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40021e0b-92b3-47f1-851f-0d7222e37477 admin admin] PATH_INFO: `/v3/users/4c702a1a26984b0f857c085967d956ae` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:34.574823 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40021e0b-92b3-47f1-851f-0d7222e37477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c702a1a26984b0f857c085967d956ae)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:34.577634 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40021e0b-92b3-47f1-851f-0d7222e37477 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:34.632201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-40021e0b-92b3-47f1-851f-0d7222e37477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c702a1a26984b0f857c085967d956ae'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.641529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-40021e0b-92b3-47f1-851f-0d7222e37477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c702a1a26984b0f857c085967d956ae'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.655049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-40021e0b-92b3-47f1-851f-0d7222e37477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c702a1a26984b0f857c085967d956ae'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.655727 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-40021e0b-92b3-47f1-851f-0d7222e37477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c702a1a26984b0f857c085967d956ae'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.656369 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-40021e0b-92b3-47f1-851f-0d7222e37477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c702a1a26984b0f857c085967d956ae'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.669508 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1421/2834] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:34 2022] DELETE /identity/v3/users/4c702a1a26984b0f857c085967d956ae => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:34.850004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8852f2-17c0-4298-91ea-8c66044424b3 service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:34.864448 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8852f2-17c0-4298-91ea-8c66044424b3 service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:34.931675 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd176ad-431a-4545-9a83-fed8dd8ada4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:34.932344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd176ad-431a-4545-9a83-fed8dd8ada4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:34.932628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd176ad-431a-4545-9a83-fed8dd8ada4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:34.932902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd176ad-431a-4545-9a83-fed8dd8ada4a admin admin] PATH_INFO: `/v3/projects/af9ac4ac27f64f4786573750e2964c46` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:34.934021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd176ad-431a-4545-9a83-fed8dd8ada4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=af9ac4ac27f64f4786573750e2964c46)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:34.935937 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd176ad-431a-4545-9a83-fed8dd8ada4a admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:34.983158 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bfd176ad-431a-4545-9a83-fed8dd8ada4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9ac4ac27f64f4786573750e2964c46', 'request_id': 'req-bfd176ad-431a-4545-9a83-fed8dd8ada4a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.989422 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bfd176ad-431a-4545-9a83-fed8dd8ada4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9ac4ac27f64f4786573750e2964c46', 'request_id': 'req-bfd176ad-431a-4545-9a83-fed8dd8ada4a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.996711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bfd176ad-431a-4545-9a83-fed8dd8ada4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9ac4ac27f64f4786573750e2964c46', 'request_id': 'req-bfd176ad-431a-4545-9a83-fed8dd8ada4a'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.007536 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bfd176ad-431a-4545-9a83-fed8dd8ada4a admin admin] The token cache is being invalidate because project af9ac4ac27f64f4786573750e2964c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:35.007819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bfd176ad-431a-4545-9a83-fed8dd8ada4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.008458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-bfd176ad-431a-4545-9a83-fed8dd8ada4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.009918 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1414/2835] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:34 2022] DELETE /identity/v3/projects/af9ac4ac27f64f4786573750e2964c46 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:35.014589 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40021e0b-92b3-47f1-851f-0d7222e37477 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:35.015440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-40021e0b-92b3-47f1-851f-0d7222e37477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:35.030305 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40021e0b-92b3-47f1-851f-0d7222e37477 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:35.089293 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daa38e-db6f-4782-92a6-5f50226bea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:35.089961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daa38e-db6f-4782-92a6-5f50226bea10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.090241 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daa38e-db6f-4782-92a6-5f50226bea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.090514 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daa38e-db6f-4782-92a6-5f50226bea10 admin admin] PATH_INFO: `/v3/users/1b224c99e8b94c778a329de6d4b1aa5f` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.091704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daa38e-db6f-4782-92a6-5f50226bea10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b224c99e8b94c778a329de6d4b1aa5f)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:35.093675 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daa38e-db6f-4782-92a6-5f50226bea10 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:35.132866 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:35.144263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b8daa38e-db6f-4782-92a6-5f50226bea10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b224c99e8b94c778a329de6d4b1aa5f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.152601 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b8daa38e-db6f-4782-92a6-5f50226bea10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b224c99e8b94c778a329de6d4b1aa5f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.166254 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b8daa38e-db6f-4782-92a6-5f50226bea10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b224c99e8b94c778a329de6d4b1aa5f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.167506 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b8daa38e-db6f-4782-92a6-5f50226bea10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b224c99e8b94c778a329de6d4b1aa5f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.168300 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-b8daa38e-db6f-4782-92a6-5f50226bea10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b224c99e8b94c778a329de6d4b1aa5f'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.185990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1422/2836] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:35 2022] DELETE /identity/v3/users/1b224c99e8b94c778a329de6d4b1aa5f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:35.370013 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd176ad-431a-4545-9a83-fed8dd8ada4a admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:35.371811 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bfd176ad-431a-4545-9a83-fed8dd8ada4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:35.381677 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:35.385591 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd176ad-431a-4545-9a83-fed8dd8ada4a admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:35.454227 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a07326-b49e-4540-aeec-de4ce1d79f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:35.454867 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a07326-b49e-4540-aeec-de4ce1d79f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.455148 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a07326-b49e-4540-aeec-de4ce1d79f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.455418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a07326-b49e-4540-aeec-de4ce1d79f2f admin admin] PATH_INFO: `/v3/projects/160e460e2bec4c74b91e2dce7d2d112a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.456592 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a07326-b49e-4540-aeec-de4ce1d79f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=160e460e2bec4c74b91e2dce7d2d112a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:35.459049 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a07326-b49e-4540-aeec-de4ce1d79f2f admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:35.509244 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-87a07326-b49e-4540-aeec-de4ce1d79f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '160e460e2bec4c74b91e2dce7d2d112a', 'request_id': 'req-87a07326-b49e-4540-aeec-de4ce1d79f2f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.515990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-87a07326-b49e-4540-aeec-de4ce1d79f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '160e460e2bec4c74b91e2dce7d2d112a', 'request_id': 'req-87a07326-b49e-4540-aeec-de4ce1d79f2f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.525398 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-87a07326-b49e-4540-aeec-de4ce1d79f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '160e460e2bec4c74b91e2dce7d2d112a', 'request_id': 'req-87a07326-b49e-4540-aeec-de4ce1d79f2f'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.538143 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-87a07326-b49e-4540-aeec-de4ce1d79f2f admin admin] The token cache is being invalidate because project 160e460e2bec4c74b91e2dce7d2d112a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:35.538478 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-87a07326-b49e-4540-aeec-de4ce1d79f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.539116 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-87a07326-b49e-4540-aeec-de4ce1d79f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.540735 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1415/2837] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:35 2022] DELETE /identity/v3/projects/160e460e2bec4c74b91e2dce7d2d112a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:35.546504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9cc7a-940d-44b7-8a78-04744458cbdf None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.546791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9cc7a-940d-44b7-8a78-04744458cbdf None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.547073 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9cc7a-940d-44b7-8a78-04744458cbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.589089 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-59c9cc7a-940d-44b7-8a78-04744458cbdf None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:35.590448 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-59c9cc7a-940d-44b7-8a78-04744458cbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:35.677113 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1423/2838] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:41:35.685703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4ae7b-f339-4b92-9467-ef6cdae1e98d None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.686106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4ae7b-f339-4b92-9467-ef6cdae1e98d None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.686443 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4ae7b-f339-4b92-9467-ef6cdae1e98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.707198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-44b4ae7b-f339-4b92-9467-ef6cdae1e98d None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:35.708697 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-44b4ae7b-f339-4b92-9467-ef6cdae1e98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:35.717094 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1416/2839] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:35.721580 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9cc7a-940d-44b7-8a78-04744458cbdf None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:35.732393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9cc7a-940d-44b7-8a78-04744458cbdf None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:35.740165 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef076b-9588-4fc6-809d-1943a96ae68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:35.741153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef076b-9588-4fc6-809d-1943a96ae68f admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.741672 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef076b-9588-4fc6-809d-1943a96ae68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.742172 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef076b-9588-4fc6-809d-1943a96ae68f admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.743459 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef076b-9588-4fc6-809d-1943a96ae68f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:35.744083 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef076b-9588-4fc6-809d-1943a96ae68f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:35.746860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef076b-9588-4fc6-809d-1943a96ae68f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:35.759156 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1424/2840] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:35.763534 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4ae7b-f339-4b92-9467-ef6cdae1e98d None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:35.773549 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4ae7b-f339-4b92-9467-ef6cdae1e98d None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:35.778364 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a5409-5626-4b2c-8ea9-1adfd2985b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:35.778961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a5409-5626-4b2c-8ea9-1adfd2985b03 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.779235 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a5409-5626-4b2c-8ea9-1adfd2985b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.779504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a5409-5626-4b2c-8ea9-1adfd2985b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.780156 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a5409-5626-4b2c-8ea9-1adfd2985b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:35.782051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a5409-5626-4b2c-8ea9-1adfd2985b03 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:35.809830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1417/2841] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:35 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:35.814014 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef076b-9588-4fc6-809d-1943a96ae68f admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:35.824270 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef076b-9588-4fc6-809d-1943a96ae68f admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:35.880235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3eb9e4-7943-45cc-a599-d929f5fa78ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:35.880843 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3eb9e4-7943-45cc-a599-d929f5fa78ed admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.881123 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3eb9e4-7943-45cc-a599-d929f5fa78ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.881396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3eb9e4-7943-45cc-a599-d929f5fa78ed admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.882016 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3eb9e4-7943-45cc-a599-d929f5fa78ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:35.883974 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3eb9e4-7943-45cc-a599-d929f5fa78ed admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:35.907849 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1425/2842] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:35 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:35.909007 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a5409-5626-4b2c-8ea9-1adfd2985b03 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:35.920204 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a5409-5626-4b2c-8ea9-1adfd2985b03 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:35.924903 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c9ad8-e988-42e6-88bc-d76d5dafaba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:35.925649 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c9ad8-e988-42e6-88bc-d76d5dafaba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.926046 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c9ad8-e988-42e6-88bc-d76d5dafaba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.926319 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c9ad8-e988-42e6-88bc-d76d5dafaba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.926976 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c9ad8-e988-42e6-88bc-d76d5dafaba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:35.928909 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c9ad8-e988-42e6-88bc-d76d5dafaba5 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:35.939296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1418/2843] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:35.943214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3eb9e4-7943-45cc-a599-d929f5fa78ed admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:35.953249 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3eb9e4-7943-45cc-a599-d929f5fa78ed admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:35.958396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af77bb4-4e1d-41c1-b4dd-b31d45c6a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:35.958990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af77bb4-4e1d-41c1-b4dd-b31d45c6a079 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.959272 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af77bb4-4e1d-41c1-b4dd-b31d45c6a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.959542 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af77bb4-4e1d-41c1-b4dd-b31d45c6a079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.960229 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af77bb4-4e1d-41c1-b4dd-b31d45c6a079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:35.961820 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af77bb4-4e1d-41c1-b4dd-b31d45c6a079 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:35.973674 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1426/2844] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:35.978369 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c9ad8-e988-42e6-88bc-d76d5dafaba5 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:35.989074 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c9ad8-e988-42e6-88bc-d76d5dafaba5 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:35.993821 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690a889-4fd3-40d1-8647-eba1a81856a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:35.994420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690a889-4fd3-40d1-8647-eba1a81856a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.994703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690a889-4fd3-40d1-8647-eba1a81856a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.994976 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690a889-4fd3-40d1-8647-eba1a81856a5 admin admin] PATH_INFO: `/v3/projects/6b8ee39104b442e0a0fcf870ff2ddafb/users/c1bce05674104160bb16200952c46bea/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.009485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690a889-4fd3-40d1-8647-eba1a81856a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8ee39104b442e0a0fcf870ff2ddafb, user_id=c1bce05674104160bb16200952c46bea, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:36.012194 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690a889-4fd3-40d1-8647-eba1a81856a5 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:36.025485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1419/2845] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:35 2022] PUT /identity/v3/projects/6b8ee39104b442e0a0fcf870ff2ddafb/users/c1bce05674104160bb16200952c46bea/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:36.035882 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b039f24-e948-4147-9a7b-654611650075 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.036194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b039f24-e948-4147-9a7b-654611650075 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.036487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b039f24-e948-4147-9a7b-654611650075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.055551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:36.065426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3b039f24-e948-4147-9a7b-654611650075 None None] MFA Rules not processed for user `c1bce05674104160bb16200952c46bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:36.067605 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3b039f24-e948-4147-9a7b-654611650075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:36.131094 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1427/2846] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:41:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:36.135408 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690a889-4fd3-40d1-8647-eba1a81856a5 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:36.169356 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:36.201537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690a889-4fd3-40d1-8647-eba1a81856a5 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:36.206205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbeb3aa-cb0f-41c4-9fa9-2edef59b97bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:36.207074 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbeb3aa-cb0f-41c4-9fa9-2edef59b97bc admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.207361 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbeb3aa-cb0f-41c4-9fa9-2edef59b97bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.207638 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbeb3aa-cb0f-41c4-9fa9-2edef59b97bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.208348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbeb3aa-cb0f-41c4-9fa9-2edef59b97bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:36.210236 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbeb3aa-cb0f-41c4-9fa9-2edef59b97bc admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:36.240769 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1420/2847] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:36 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:36.244862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b039f24-e948-4147-9a7b-654611650075 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:36.255730 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b039f24-e948-4147-9a7b-654611650075 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:36.312273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b024618-396b-4650-8f83-a4f388c67ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:36.312882 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b024618-396b-4650-8f83-a4f388c67ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.313163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b024618-396b-4650-8f83-a4f388c67ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.313439 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b024618-396b-4650-8f83-a4f388c67ed3 admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.314072 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b024618-396b-4650-8f83-a4f388c67ed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:36.316533 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b024618-396b-4650-8f83-a4f388c67ed3 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:36.338424 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1428/2848] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:36 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:36.342476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbeb3aa-cb0f-41c4-9fa9-2edef59b97bc admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:36.352912 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbeb3aa-cb0f-41c4-9fa9-2edef59b97bc admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:36.357420 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52891ad2-ceb6-4b1d-8606-c71189010fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:36.358016 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52891ad2-ceb6-4b1d-8606-c71189010fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.358289 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52891ad2-ceb6-4b1d-8606-c71189010fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.358555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52891ad2-ceb6-4b1d-8606-c71189010fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.359188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52891ad2-ceb6-4b1d-8606-c71189010fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:36.360789 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52891ad2-ceb6-4b1d-8606-c71189010fe9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:36.371203 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1421/2849] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:36.375268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b024618-396b-4650-8f83-a4f388c67ed3 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:36.385845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b024618-396b-4650-8f83-a4f388c67ed3 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:36.390519 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062d9ad-5593-4555-b7bd-df76500adb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:36.391266 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062d9ad-5593-4555-b7bd-df76500adb7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.391554 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062d9ad-5593-4555-b7bd-df76500adb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.391832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062d9ad-5593-4555-b7bd-df76500adb7f admin admin] PATH_INFO: `/v3/projects/5b1de23d8c264fef8e5c7c73d2cf7ef8/users/f666f1a82d2343849f13995f108360fe/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.407960 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062d9ad-5593-4555-b7bd-df76500adb7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1de23d8c264fef8e5c7c73d2cf7ef8, user_id=f666f1a82d2343849f13995f108360fe, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:36.410766 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062d9ad-5593-4555-b7bd-df76500adb7f admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:36.423927 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1429/2850] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:36 2022] PUT /identity/v3/projects/5b1de23d8c264fef8e5c7c73d2cf7ef8/users/f666f1a82d2343849f13995f108360fe/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:36.428071 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52891ad2-ceb6-4b1d-8606-c71189010fe9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:36.438344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52891ad2-ceb6-4b1d-8606-c71189010fe9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:36.497940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e8f8c-b833-4081-ab6b-973d72219c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:36.498469 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e8f8c-b833-4081-ab6b-973d72219c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.498753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e8f8c-b833-4081-ab6b-973d72219c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.499027 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e8f8c-b833-4081-ab6b-973d72219c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.499665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e8f8c-b833-4081-ab6b-973d72219c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:36.501294 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e8f8c-b833-4081-ab6b-973d72219c61 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:36.511973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1422/2851] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:36.516125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062d9ad-5593-4555-b7bd-df76500adb7f admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:36.526576 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062d9ad-5593-4555-b7bd-df76500adb7f admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:36.531250 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f7153-24cc-428b-a871-8683f24c5a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:36.531897 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f7153-24cc-428b-a871-8683f24c5a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.532242 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f7153-24cc-428b-a871-8683f24c5a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.532591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f7153-24cc-428b-a871-8683f24c5a0c admin admin] PATH_INFO: `/v3/projects/5b1de23d8c264fef8e5c7c73d2cf7ef8/users/f666f1a82d2343849f13995f108360fe/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.534675 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f7153-24cc-428b-a871-8683f24c5a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1de23d8c264fef8e5c7c73d2cf7ef8, user_id=f666f1a82d2343849f13995f108360fe, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:36.537597 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f7153-24cc-428b-a871-8683f24c5a0c admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:36.547976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1430/2852] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:36 2022] PUT /identity/v3/projects/5b1de23d8c264fef8e5c7c73d2cf7ef8/users/f666f1a82d2343849f13995f108360fe/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:36.558217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ec0e0-4b2d-4ba0-a48f-80dd07224481 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.558508 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ec0e0-4b2d-4ba0-a48f-80dd07224481 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.558782 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ec0e0-4b2d-4ba0-a48f-80dd07224481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.586572 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-745ec0e0-4b2d-4ba0-a48f-80dd07224481 None None] MFA Rules not processed for user `f666f1a82d2343849f13995f108360fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:36.587782 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-745ec0e0-4b2d-4ba0-a48f-80dd07224481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:36.655776 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1423/2853] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:41:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:36.669827 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f7153-24cc-428b-a871-8683f24c5a0c admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:36.671552 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-fb5f7153-24cc-428b-a871-8683f24c5a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:36.723944 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:36.746900 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f7153-24cc-428b-a871-8683f24c5a0c admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:36.752455 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29931d72-7749-479b-91ce-9798918d85cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:36.752993 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29931d72-7749-479b-91ce-9798918d85cb service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.753268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29931d72-7749-479b-91ce-9798918d85cb service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.754065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29931d72-7749-479b-91ce-9798918d85cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.808842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29931d72-7749-479b-91ce-9798918d85cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:36.810432 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29931d72-7749-479b-91ce-9798918d85cb service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:36.819933 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1431/2854] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:39.764331 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ec0e0-4b2d-4ba0-a48f-80dd07224481 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:39.765769 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-745ec0e0-4b2d-4ba0-a48f-80dd07224481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:39.799463 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:39.828432 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ec0e0-4b2d-4ba0-a48f-80dd07224481 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:39.833713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb105be-a628-4882-8d3a-139dd9755fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:39.834327 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb105be-a628-4882-8d3a-139dd9755fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:39.834605 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb105be-a628-4882-8d3a-139dd9755fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:39.835016 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb105be-a628-4882-8d3a-139dd9755fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:39.844164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb105be-a628-4882-8d3a-139dd9755fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:39.845606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb105be-a628-4882-8d3a-139dd9755fc9 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:39.855768 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1424/2855] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:42.842901 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aae5b-18d0-4219-92e2-f4f9662b96d2 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:42.843447 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aae5b-18d0-4219-92e2-f4f9662b96d2 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:42.843447 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aae5b-18d0-4219-92e2-f4f9662b96d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:42.866235 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-847aae5b-18d0-4219-92e2-f4f9662b96d2 None None] MFA Rules not processed for user `c1bce05674104160bb16200952c46bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:42.867720 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-847aae5b-18d0-4219-92e2-f4f9662b96d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:42.884132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1432/2856] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:41:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:43.244352 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb105be-a628-4882-8d3a-139dd9755fc9 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:43.246335 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ceb105be-a628-4882-8d3a-139dd9755fc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:43.258925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb105be-a628-4882-8d3a-139dd9755fc9 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:43.262811 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d7b63-48e2-4eca-8d97-a5f66db0ed19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:43.263428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d7b63-48e2-4eca-8d97-a5f66db0ed19 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:43.263703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d7b63-48e2-4eca-8d97-a5f66db0ed19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:43.264002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d7b63-48e2-4eca-8d97-a5f66db0ed19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:43.265748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f44d7b63-48e2-4eca-8d97-a5f66db0ed19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:43.276812 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d7b63-48e2-4eca-8d97-a5f66db0ed19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:43.278306 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d7b63-48e2-4eca-8d97-a5f66db0ed19 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:43.292102 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1425/2857] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:52.860169 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=36 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:53.283333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=20 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:20.466805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847aae5b-18d0-4219-92e2-f4f9662b96d2 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:20.468248 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-847aae5b-18d0-4219-92e2-f4f9662b96d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:20.607318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847aae5b-18d0-4219-92e2-f4f9662b96d2 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:20.612493 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402ad72-55c2-4bae-829b-a992b220d271 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:20.613092 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ad72-55c2-4bae-829b-a992b220d271 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:20.613367 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ad72-55c2-4bae-829b-a992b220d271 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:20.613636 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ad72-55c2-4bae-829b-a992b220d271 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:20.615311 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5402ad72-55c2-4bae-829b-a992b220d271 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:20.626347 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402ad72-55c2-4bae-829b-a992b220d271 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:20.628518 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402ad72-55c2-4bae-829b-a992b220d271 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:20.638298 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1433/2858] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:30.634099 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=63 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:34.949900 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d7b63-48e2-4eca-8d97-a5f66db0ed19 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:34.951441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f44d7b63-48e2-4eca-8d97-a5f66db0ed19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.002970 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d7b63-48e2-4eca-8d97-a5f66db0ed19 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:35.008526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15742827-f31e-4cef-ad8f-e1fa6cb1c8ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:35.009134 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15742827-f31e-4cef-ad8f-e1fa6cb1c8ae service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.009413 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15742827-f31e-4cef-ad8f-e1fa6cb1c8ae service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.009680 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15742827-f31e-4cef-ad8f-e1fa6cb1c8ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.011392 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-15742827-f31e-4cef-ad8f-e1fa6cb1c8ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.028799 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15742827-f31e-4cef-ad8f-e1fa6cb1c8ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:35.031079 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15742827-f31e-4cef-ad8f-e1fa6cb1c8ae service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:35.047152 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1426/2859] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:45.040225 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=19 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:47.583665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136bc34-8327-45df-8f60-e74607ada671 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:47.584193 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136bc34-8327-45df-8f60-e74607ada671 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:47.584286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136bc34-8327-45df-8f60-e74607ada671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:47.620915 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-7136bc34-8327-45df-8f60-e74607ada671 None None] MFA Rules not processed for user `c1bce05674104160bb16200952c46bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:47.622295 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7136bc34-8327-45df-8f60-e74607ada671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:47.645403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1434/2860] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:42:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:57.604273 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:27.444287 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3603f-5273-4e74-ae8b-afe26acd90ca None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:27.444770 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3603f-5273-4e74-ae8b-afe26acd90ca None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:27.444965 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3603f-5273-4e74-ae8b-afe26acd90ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:27.466839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-b0b3603f-5273-4e74-ae8b-afe26acd90ca None None] MFA Rules not processed for user `c1bce05674104160bb16200952c46bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:27.468235 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b0b3603f-5273-4e74-ae8b-afe26acd90ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:27.476002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1427/2861] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:44:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:44:27.893731 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136bc34-8327-45df-8f60-e74607ada671 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:27.918166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136bc34-8327-45df-8f60-e74607ada671 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:27.925902 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31f8f0-4775-4176-8ad8-11f1e9004f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:27.928066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31f8f0-4775-4176-8ad8-11f1e9004f6b service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:27.928479 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31f8f0-4775-4176-8ad8-11f1e9004f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:27.928962 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31f8f0-4775-4176-8ad8-11f1e9004f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:27.931119 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-ae31f8f0-4775-4176-8ad8-11f1e9004f6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:27.960753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31f8f0-4775-4176-8ad8-11f1e9004f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:27.962819 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31f8f0-4775-4176-8ad8-11f1e9004f6b service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:27.976238 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1435/2862] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:30.395385 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3603f-5273-4e74-ae8b-afe26acd90ca None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:30.396955 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-b0b3603f-5273-4e74-ae8b-afe26acd90ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:30.413125 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3603f-5273-4e74-ae8b-afe26acd90ca None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:30.419923 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba1144-2951-40fa-ac94-9b7883c1bdb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:30.420558 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba1144-2951-40fa-ac94-9b7883c1bdb8 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:30.420836 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba1144-2951-40fa-ac94-9b7883c1bdb8 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:30.421106 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba1144-2951-40fa-ac94-9b7883c1bdb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:30.422888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-f3ba1144-2951-40fa-ac94-9b7883c1bdb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:30.435354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba1144-2951-40fa-ac94-9b7883c1bdb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:30.436959 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba1144-2951-40fa-ac94-9b7883c1bdb8 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:30.448077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1428/2863] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:44:37.969807 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=15 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:40.443827 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=9 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:19.046652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e6bae-cde0-4e00-97b0-8e9659938da9 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:19.047280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e6bae-cde0-4e00-97b0-8e9659938da9 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:19.047280 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e6bae-cde0-4e00-97b0-8e9659938da9 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:19.049014 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1436/2864] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:45:19.054807 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6f26e-0a5b-47dc-acf8-80d860262a72 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:19.055276 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6f26e-0a5b-47dc-acf8-80d860262a72 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:19.055381 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6f26e-0a5b-47dc-acf8-80d860262a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:19.095544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-25f6f26e-0a5b-47dc-acf8-80d860262a72 None None] MFA Rules not processed for user `e393d9c50bbb4f69a48ae635d13b1197`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:19.096987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-25f6f26e-0a5b-47dc-acf8-80d860262a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:19.104110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1429/2865] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:45:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:19.116161 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e6bae-cde0-4e00-97b0-8e9659938da9 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:19.127862 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e6bae-cde0-4e00-97b0-8e9659938da9 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:19.131496 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a34805-9ff6-4811-bb8e-839663dae342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:19.132188 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a34805-9ff6-4811-bb8e-839663dae342 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:19.132534 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a34805-9ff6-4811-bb8e-839663dae342 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:19.132870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a34805-9ff6-4811-bb8e-839663dae342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:19.140306 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a34805-9ff6-4811-bb8e-839663dae342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:19.141806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a34805-9ff6-4811-bb8e-839663dae342 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:19.149524 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1437/2866] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:19.253409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884797bb-abd8-4095-a1f1-975f3c2c17fd None None] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:19.253696 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884797bb-abd8-4095-a1f1-975f3c2c17fd None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:19.253972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884797bb-abd8-4095-a1f1-975f3c2c17fd None None] PATH_INFO: `/` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:19.255320 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1430/2867] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:45:19.260050 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a64da-e1ba-439c-b8cf-ccf26fe35416 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:19.260338 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a64da-e1ba-439c-b8cf-ccf26fe35416 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:19.260717 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a64da-e1ba-439c-b8cf-ccf26fe35416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:19.297536 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-2e3a64da-e1ba-439c-b8cf-ccf26fe35416 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:19.298730 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-2e3a64da-e1ba-439c-b8cf-ccf26fe35416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:19.308065 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1438/2868] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:45:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:19.328067 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884797bb-abd8-4095-a1f1-975f3c2c17fd None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:19.342221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884797bb-abd8-4095-a1f1-975f3c2c17fd None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:19.347099 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdae6c1-6a20-421a-b70b-02a543dab957 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:19.347688 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdae6c1-6a20-421a-b70b-02a543dab957 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:19.348000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdae6c1-6a20-421a-b70b-02a543dab957 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:19.348275 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdae6c1-6a20-421a-b70b-02a543dab957 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:19.357440 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdae6c1-6a20-421a-b70b-02a543dab957 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:19.358998 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdae6c1-6a20-421a-b70b-02a543dab957 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:19.368567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1431/2869] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:19.538933 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a64da-e1ba-439c-b8cf-ccf26fe35416 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:19.548871 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a64da-e1ba-439c-b8cf-ccf26fe35416 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:19.552976 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae01b91-e6af-4f00-8094-4280ef7cc1c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:19.553607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae01b91-e6af-4f00-8094-4280ef7cc1c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:19.553888 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae01b91-e6af-4f00-8094-4280ef7cc1c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:19.554163 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae01b91-e6af-4f00-8094-4280ef7cc1c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:19.556546 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-bae01b91-e6af-4f00-8094-4280ef7cc1c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:19.572214 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae01b91-e6af-4f00-8094-4280ef7cc1c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:19.574247 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae01b91-e6af-4f00-8094-4280ef7cc1c1 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:19.585261 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1439/2870] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:29.364671 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=15 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:29.580484 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=21 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:31.988100 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdae6c1-6a20-421a-b70b-02a543dab957 service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:31.998301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdae6c1-6a20-421a-b70b-02a543dab957 service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:32.001893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668ebc7-cc1e-4189-b8b2-eafe9c7c4eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:32.002484 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668ebc7-cc1e-4189-b8b2-eafe9c7c4eea service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:32.002761 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668ebc7-cc1e-4189-b8b2-eafe9c7c4eea service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:32.003028 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668ebc7-cc1e-4189-b8b2-eafe9c7c4eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:32.004762 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3668ebc7-cc1e-4189-b8b2-eafe9c7c4eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:32.024843 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668ebc7-cc1e-4189-b8b2-eafe9c7c4eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:32.026506 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668ebc7-cc1e-4189-b8b2-eafe9c7c4eea service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:32.038361 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1432/2871] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:41.919022 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae01b91-e6af-4f00-8094-4280ef7cc1c1 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:41.952611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae01b91-e6af-4f00-8094-4280ef7cc1c1 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:41.959746 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4375a-f7cc-47ee-9de7-80b03d62780a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:41.960416 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4375a-f7cc-47ee-9de7-80b03d62780a service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:41.960697 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4375a-f7cc-47ee-9de7-80b03d62780a service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:41.960971 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4375a-f7cc-47ee-9de7-80b03d62780a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:41.963643 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9ef4375a-f7cc-47ee-9de7-80b03d62780a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:42.009539 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4375a-f7cc-47ee-9de7-80b03d62780a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:42.011673 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4375a-f7cc-47ee-9de7-80b03d62780a service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:42.025617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1440/2872] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:42.032961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=9 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:52.020253 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=18 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:14.827053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668ebc7-cc1e-4189-b8b2-eafe9c7c4eea service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:14.836630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668ebc7-cc1e-4189-b8b2-eafe9c7c4eea service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:14.840436 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7c310-919e-4dec-9957-2fff95eb1c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:14.841030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7c310-919e-4dec-9957-2fff95eb1c52 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:14.841330 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7c310-919e-4dec-9957-2fff95eb1c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:14.841602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7c310-919e-4dec-9957-2fff95eb1c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:14.843296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-54e7c310-919e-4dec-9957-2fff95eb1c52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:14.853476 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7c310-919e-4dec-9957-2fff95eb1c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:14.854887 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7c310-919e-4dec-9957-2fff95eb1c52 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:14.862833 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1433/2873] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:46:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:46:15.697719 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4375a-f7cc-47ee-9de7-80b03d62780a service nova] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:15.712622 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4375a-f7cc-47ee-9de7-80b03d62780a service nova] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:15.719440 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df4933-6b12-46cb-9dee-05603c0deb17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:15.720342 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df4933-6b12-46cb-9dee-05603c0deb17 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:15.720899 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df4933-6b12-46cb-9dee-05603c0deb17 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:15.721314 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df4933-6b12-46cb-9dee-05603c0deb17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:15.723967 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-59df4933-6b12-46cb-9dee-05603c0deb17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:15.739301 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df4933-6b12-46cb-9dee-05603c0deb17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:15.740945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df4933-6b12-46cb-9dee-05603c0deb17 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:15.756832 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1441/2874] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:46:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:46:24.859358 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:25.624159 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac390b9a-86c4-4c81-b8b9-c8eabe080bc2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:25.624924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac390b9a-86c4-4c81-b8b9-c8eabe080bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:25.624924 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac390b9a-86c4-4c81-b8b9-c8eabe080bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:25.655068 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ac390b9a-86c4-4c81-b8b9-c8eabe080bc2 None None] MFA Rules not processed for user `c1bce05674104160bb16200952c46bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:25.656340 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ac390b9a-86c4-4c81-b8b9-c8eabe080bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:25.673169 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1434/2875] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:46:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:25.752751 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=6 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:26.346621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df4933-6b12-46cb-9dee-05603c0deb17 service nova] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:26.356223 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df4933-6b12-46cb-9dee-05603c0deb17 service nova] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:26.360146 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8306e1-9665-4443-b0b1-3293846f4a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:26.360736 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8306e1-9665-4443-b0b1-3293846f4a25 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:26.361013 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8306e1-9665-4443-b0b1-3293846f4a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:26.361283 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8306e1-9665-4443-b0b1-3293846f4a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:26.363058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7c8306e1-9665-4443-b0b1-3293846f4a25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:26.381514 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8306e1-9665-4443-b0b1-3293846f4a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:26.383012 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8306e1-9665-4443-b0b1-3293846f4a25 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:26.397236 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1442/2876] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:46:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:46:35.648928 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:36.391547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=6 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:36.948957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac390b9a-86c4-4c81-b8b9-c8eabe080bc2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:36.964285 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac390b9a-86c4-4c81-b8b9-c8eabe080bc2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:36.969742 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17412090-f7e6-434f-bc5d-cb72ddf1dfb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:36.970348 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17412090-f7e6-434f-bc5d-cb72ddf1dfb1 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:36.970632 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17412090-f7e6-434f-bc5d-cb72ddf1dfb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:36.970907 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17412090-f7e6-434f-bc5d-cb72ddf1dfb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:36.979691 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17412090-f7e6-434f-bc5d-cb72ddf1dfb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:36.981347 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17412090-f7e6-434f-bc5d-cb72ddf1dfb1 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:36.990492 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1435/2877] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:46:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:46:46.986473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:24.552173 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8306e1-9665-4443-b0b1-3293846f4a25 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:24.564599 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8306e1-9665-4443-b0b1-3293846f4a25 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:24.571164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62a421-9249-4047-80bf-6cf6302b4f15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:24.571781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62a421-9249-4047-80bf-6cf6302b4f15 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:24.572112 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62a421-9249-4047-80bf-6cf6302b4f15 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:24.572405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62a421-9249-4047-80bf-6cf6302b4f15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:24.581723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62a421-9249-4047-80bf-6cf6302b4f15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:24.583313 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62a421-9249-4047-80bf-6cf6302b4f15 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:24.593714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1443/2878] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:47:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:47:34.589256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=6 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:04.475889 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17412090-f7e6-434f-bc5d-cb72ddf1dfb1 service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:04.487024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17412090-f7e6-434f-bc5d-cb72ddf1dfb1 service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:04.492334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60417454-a5a1-42f9-b039-a349ba8bf560 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:04.493031 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60417454-a5a1-42f9-b039-a349ba8bf560 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:04.493376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60417454-a5a1-42f9-b039-a349ba8bf560 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:04.493709 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60417454-a5a1-42f9-b039-a349ba8bf560 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:04.495478 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-60417454-a5a1-42f9-b039-a349ba8bf560 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:04.507717 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60417454-a5a1-42f9-b039-a349ba8bf560 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:04.509309 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60417454-a5a1-42f9-b039-a349ba8bf560 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:04.520472 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1436/2879] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:07.355607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62a421-9249-4047-80bf-6cf6302b4f15 service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:07.365257 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62a421-9249-4047-80bf-6cf6302b4f15 service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:07.368914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fe367-9841-4d8f-807d-ba177d4fed6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:07.369513 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fe367-9841-4d8f-807d-ba177d4fed6c service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:07.369794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fe367-9841-4d8f-807d-ba177d4fed6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:07.370073 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fe367-9841-4d8f-807d-ba177d4fed6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:07.379306 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fe367-9841-4d8f-807d-ba177d4fed6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:07.381266 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fe367-9841-4d8f-807d-ba177d4fed6c service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:07.391019 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1444/2880] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:10.606538 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476ff52-dcb5-4e12-807f-4ee74f8855a2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:10.607022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476ff52-dcb5-4e12-807f-4ee74f8855a2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:10.607129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476ff52-dcb5-4e12-807f-4ee74f8855a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:10.629500 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7476ff52-dcb5-4e12-807f-4ee74f8855a2 None None] MFA Rules not processed for user `c1bce05674104160bb16200952c46bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:10.631165 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7476ff52-dcb5-4e12-807f-4ee74f8855a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:10.642618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1437/2881] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:48:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:11.009603 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fe367-9841-4d8f-807d-ba177d4fed6c service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:11.018685 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fe367-9841-4d8f-807d-ba177d4fed6c service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:11.022616 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151892d7-534d-4b35-841e-5ea6883cd4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:11.023140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151892d7-534d-4b35-841e-5ea6883cd4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:11.023590 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151892d7-534d-4b35-841e-5ea6883cd4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:11.023918 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151892d7-534d-4b35-841e-5ea6883cd4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:11.031594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151892d7-534d-4b35-841e-5ea6883cd4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:11.033062 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151892d7-534d-4b35-841e-5ea6883cd4f2 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:11.042333 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1445/2882] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:20.622309 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=9 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:21.038771 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=12 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:04.300269 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476ff52-dcb5-4e12-807f-4ee74f8855a2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:04.318018 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476ff52-dcb5-4e12-807f-4ee74f8855a2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:04.326119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244569b4-4c5c-41f4-9efd-4461dc19e812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:04.327016 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244569b4-4c5c-41f4-9efd-4461dc19e812 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:04.327504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244569b4-4c5c-41f4-9efd-4461dc19e812 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:04.327992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244569b4-4c5c-41f4-9efd-4461dc19e812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:04.339957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244569b4-4c5c-41f4-9efd-4461dc19e812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:04.341444 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244569b4-4c5c-41f4-9efd-4461dc19e812 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:04.355216 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1438/2883] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:10.997180 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151892d7-534d-4b35-841e-5ea6883cd4f2 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:11.012748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151892d7-534d-4b35-841e-5ea6883cd4f2 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:11.017805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dbc47-7725-4a4e-9f87-327a3dab5b67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:11.018409 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dbc47-7725-4a4e-9f87-327a3dab5b67 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:11.018716 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dbc47-7725-4a4e-9f87-327a3dab5b67 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:11.018990 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dbc47-7725-4a4e-9f87-327a3dab5b67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:11.020829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-327dbc47-7725-4a4e-9f87-327a3dab5b67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:11.034194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dbc47-7725-4a4e-9f87-327a3dab5b67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:11.036535 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dbc47-7725-4a4e-9f87-327a3dab5b67 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:11.047861 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1446/2884] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:11.291036 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244569b4-4c5c-41f4-9efd-4461dc19e812 service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:11.374094 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244569b4-4c5c-41f4-9efd-4461dc19e812 service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:11.378723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3d588-b1d8-47a1-b688-7919e627e3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:11.379353 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3d588-b1d8-47a1-b688-7919e627e3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:11.379670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3d588-b1d8-47a1-b688-7919e627e3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:11.379981 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3d588-b1d8-47a1-b688-7919e627e3e9 admin admin] PATH_INFO: `/v3/users/c1bce05674104160bb16200952c46bea` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:11.381110 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3d588-b1d8-47a1-b688-7919e627e3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1bce05674104160bb16200952c46bea)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:11.383024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3d588-b1d8-47a1-b688-7919e627e3e9 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:11.430794 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a4d3d588-b1d8-47a1-b688-7919e627e3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1bce05674104160bb16200952c46bea'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:11.437993 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a4d3d588-b1d8-47a1-b688-7919e627e3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1bce05674104160bb16200952c46bea'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:11.450575 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a4d3d588-b1d8-47a1-b688-7919e627e3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1bce05674104160bb16200952c46bea'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:11.457429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a4d3d588-b1d8-47a1-b688-7919e627e3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1bce05674104160bb16200952c46bea'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:11.458539 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-a4d3d588-b1d8-47a1-b688-7919e627e3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1bce05674104160bb16200952c46bea'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:11.464293 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1439/2885] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:11 2022] DELETE /identity/v3/users/c1bce05674104160bb16200952c46bea => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:11.468958 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd0b45-83eb-4870-8251-c5ade49498cb None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:11.469246 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd0b45-83eb-4870-8251-c5ade49498cb None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:11.469551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd0b45-83eb-4870-8251-c5ade49498cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:11.514777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-d6bd0b45-83eb-4870-8251-c5ade49498cb None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:11.516054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d6bd0b45-83eb-4870-8251-c5ade49498cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:11.580818 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1447/2886] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:11.591243 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3d588-b1d8-47a1-b688-7919e627e3e9 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:11.592679 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a4d3d588-b1d8-47a1-b688-7919e627e3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:11.648626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:11.652451 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3d588-b1d8-47a1-b688-7919e627e3e9 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:11.656771 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcab58-ca42-4b7d-aa09-a9771c337ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:11.657906 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcab58-ca42-4b7d-aa09-a9771c337ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:11.658191 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcab58-ca42-4b7d-aa09-a9771c337ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:11.658542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcab58-ca42-4b7d-aa09-a9771c337ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:11.668388 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcab58-ca42-4b7d-aa09-a9771c337ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:11.670091 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcab58-ca42-4b7d-aa09-a9771c337ae1 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:11.681119 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1440/2887] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:49:11.859799 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd0b45-83eb-4870-8251-c5ade49498cb None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:11.861268 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d6bd0b45-83eb-4870-8251-c5ade49498cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:11.875354 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd0b45-83eb-4870-8251-c5ade49498cb None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:11.880693 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64368ccf-61a8-456e-934d-b9ba85ab8030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:11.881908 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64368ccf-61a8-456e-934d-b9ba85ab8030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:11.882364 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64368ccf-61a8-456e-934d-b9ba85ab8030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:11.882642 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64368ccf-61a8-456e-934d-b9ba85ab8030 admin admin] PATH_INFO: `/v3/projects/6b8ee39104b442e0a0fcf870ff2ddafb` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:11.883877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64368ccf-61a8-456e-934d-b9ba85ab8030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8ee39104b442e0a0fcf870ff2ddafb)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:11.885686 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64368ccf-61a8-456e-934d-b9ba85ab8030 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:11.933170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-64368ccf-61a8-456e-934d-b9ba85ab8030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8ee39104b442e0a0fcf870ff2ddafb', 'request_id': 'req-64368ccf-61a8-456e-934d-b9ba85ab8030'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:11.939207 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-64368ccf-61a8-456e-934d-b9ba85ab8030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8ee39104b442e0a0fcf870ff2ddafb', 'request_id': 'req-64368ccf-61a8-456e-934d-b9ba85ab8030'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:11.946328 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-64368ccf-61a8-456e-934d-b9ba85ab8030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8ee39104b442e0a0fcf870ff2ddafb', 'request_id': 'req-64368ccf-61a8-456e-934d-b9ba85ab8030'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:11.956787 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-64368ccf-61a8-456e-934d-b9ba85ab8030 admin admin] The token cache is being invalidate because project 6b8ee39104b442e0a0fcf870ff2ddafb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:11.957071 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-64368ccf-61a8-456e-934d-b9ba85ab8030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:11.957824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-64368ccf-61a8-456e-934d-b9ba85ab8030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:11.959390 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1448/2888] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:11 2022] DELETE /identity/v3/projects/6b8ee39104b442e0a0fcf870ff2ddafb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:11.963503 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcab58-ca42-4b7d-aa09-a9771c337ae1 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:11.973707 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcab58-ca42-4b7d-aa09-a9771c337ae1 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:12.029181 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62af97-f3f3-43f3-9b04-a64d96ba2bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:12.029752 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62af97-f3f3-43f3-9b04-a64d96ba2bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.030024 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62af97-f3f3-43f3-9b04-a64d96ba2bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.030296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62af97-f3f3-43f3-9b04-a64d96ba2bf6 admin admin] PATH_INFO: `/v3/users/f666f1a82d2343849f13995f108360fe` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.031410 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62af97-f3f3-43f3-9b04-a64d96ba2bf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f666f1a82d2343849f13995f108360fe)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:12.033391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62af97-f3f3-43f3-9b04-a64d96ba2bf6 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:12.080482 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ef62af97-f3f3-43f3-9b04-a64d96ba2bf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f666f1a82d2343849f13995f108360fe'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:12.089207 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ef62af97-f3f3-43f3-9b04-a64d96ba2bf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f666f1a82d2343849f13995f108360fe'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:12.102022 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ef62af97-f3f3-43f3-9b04-a64d96ba2bf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f666f1a82d2343849f13995f108360fe'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:12.108902 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ef62af97-f3f3-43f3-9b04-a64d96ba2bf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f666f1a82d2343849f13995f108360fe'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:12.109540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-ef62af97-f3f3-43f3-9b04-a64d96ba2bf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f666f1a82d2343849f13995f108360fe'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:12.115373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1441/2889] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:11 2022] DELETE /identity/v3/users/f666f1a82d2343849f13995f108360fe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:12.380845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64368ccf-61a8-456e-934d-b9ba85ab8030 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:12.382425 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-64368ccf-61a8-456e-934d-b9ba85ab8030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:12.399132 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64368ccf-61a8-456e-934d-b9ba85ab8030 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:12.448141 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:12.458608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8af270-d834-4169-afb5-5d52c72d8fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:12.459239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8af270-d834-4169-afb5-5d52c72d8fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.459520 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8af270-d834-4169-afb5-5d52c72d8fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.459781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8af270-d834-4169-afb5-5d52c72d8fb4 admin admin] PATH_INFO: `/v3/projects/5b1de23d8c264fef8e5c7c73d2cf7ef8` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.460933 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8af270-d834-4169-afb5-5d52c72d8fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b1de23d8c264fef8e5c7c73d2cf7ef8)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:12.462824 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8af270-d834-4169-afb5-5d52c72d8fb4 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:12.507104 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-3f8af270-d834-4169-afb5-5d52c72d8fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b1de23d8c264fef8e5c7c73d2cf7ef8', 'request_id': 'req-3f8af270-d834-4169-afb5-5d52c72d8fb4'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:12.513075 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-3f8af270-d834-4169-afb5-5d52c72d8fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b1de23d8c264fef8e5c7c73d2cf7ef8', 'request_id': 'req-3f8af270-d834-4169-afb5-5d52c72d8fb4'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:12.521324 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-3f8af270-d834-4169-afb5-5d52c72d8fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b1de23d8c264fef8e5c7c73d2cf7ef8', 'request_id': 'req-3f8af270-d834-4169-afb5-5d52c72d8fb4'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:12.531804 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-3f8af270-d834-4169-afb5-5d52c72d8fb4 admin admin] The token cache is being invalidate because project 5b1de23d8c264fef8e5c7c73d2cf7ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:12.532121 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-3f8af270-d834-4169-afb5-5d52c72d8fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:12.532841 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-3f8af270-d834-4169-afb5-5d52c72d8fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:12.534303 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1449/2890] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:12 2022] DELETE /identity/v3/projects/5b1de23d8c264fef8e5c7c73d2cf7ef8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:49:12.539607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb719c8-2006-4925-8f40-0a8cde085eda None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.540116 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb719c8-2006-4925-8f40-0a8cde085eda None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.540238 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb719c8-2006-4925-8f40-0a8cde085eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.581108 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-bfb719c8-2006-4925-8f40-0a8cde085eda None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:12.582322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-bfb719c8-2006-4925-8f40-0a8cde085eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:12.631681 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:12.646428 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1442/2891] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:12.654714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5814bc-6cad-4c0b-8d23-10b1d63d9bb6 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.655001 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5814bc-6cad-4c0b-8d23-10b1d63d9bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.655277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5814bc-6cad-4c0b-8d23-10b1d63d9bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.675286 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-8e5814bc-6cad-4c0b-8d23-10b1d63d9bb6 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:12.677243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8e5814bc-6cad-4c0b-8d23-10b1d63d9bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:12.685134 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1450/2892] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:12.689314 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb719c8-2006-4925-8f40-0a8cde085eda None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:12.699626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb719c8-2006-4925-8f40-0a8cde085eda None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:12.704376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1975be-206e-4909-b689-d4c455ee9074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:12.704974 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1975be-206e-4909-b689-d4c455ee9074 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.705249 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1975be-206e-4909-b689-d4c455ee9074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.705516 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1975be-206e-4909-b689-d4c455ee9074 admin admin] PATH_INFO: `/v3/domains` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.706156 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1975be-206e-4909-b689-d4c455ee9074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80515) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:49:12.706454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1975be-206e-4909-b689-d4c455ee9074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:12.708105 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1975be-206e-4909-b689-d4c455ee9074 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:12.719454 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1443/2893] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:49:12.724495 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5814bc-6cad-4c0b-8d23-10b1d63d9bb6 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:12.733979 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5814bc-6cad-4c0b-8d23-10b1d63d9bb6 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:12.739652 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435ea3e-e992-4b70-a90c-ef724cf18b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:12.740277 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435ea3e-e992-4b70-a90c-ef724cf18b8a admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.740550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435ea3e-e992-4b70-a90c-ef724cf18b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.740817 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435ea3e-e992-4b70-a90c-ef724cf18b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.741426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435ea3e-e992-4b70-a90c-ef724cf18b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:12.743303 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435ea3e-e992-4b70-a90c-ef724cf18b8a admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:12.779793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1451/2894] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:49:12 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:12.784136 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1975be-206e-4909-b689-d4c455ee9074 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:12.795326 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1975be-206e-4909-b689-d4c455ee9074 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:12.851991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25472978-3f6a-4e15-8ad7-1f4d2642464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:12.852536 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25472978-3f6a-4e15-8ad7-1f4d2642464d admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.852817 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25472978-3f6a-4e15-8ad7-1f4d2642464d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.853095 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25472978-3f6a-4e15-8ad7-1f4d2642464d admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.853721 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25472978-3f6a-4e15-8ad7-1f4d2642464d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:12.855624 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25472978-3f6a-4e15-8ad7-1f4d2642464d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:12.876127 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1444/2895] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:49:12 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:12.880645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435ea3e-e992-4b70-a90c-ef724cf18b8a admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:12.890846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435ea3e-e992-4b70-a90c-ef724cf18b8a admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:12.896027 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647404d6-4fe0-4d31-83a4-b08afb07681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:12.896804 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647404d6-4fe0-4d31-83a4-b08afb07681a admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.897079 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647404d6-4fe0-4d31-83a4-b08afb07681a admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.897349 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647404d6-4fe0-4d31-83a4-b08afb07681a admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.897992 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647404d6-4fe0-4d31-83a4-b08afb07681a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:12.899581 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647404d6-4fe0-4d31-83a4-b08afb07681a admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:12.909669 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1452/2896] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:12.914261 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25472978-3f6a-4e15-8ad7-1f4d2642464d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:12.924565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25472978-3f6a-4e15-8ad7-1f4d2642464d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:12.929522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa770ca8-13e0-469e-8e1a-d1239c7cb142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:12.930109 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa770ca8-13e0-469e-8e1a-d1239c7cb142 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.930383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa770ca8-13e0-469e-8e1a-d1239c7cb142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.930649 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa770ca8-13e0-469e-8e1a-d1239c7cb142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.931278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa770ca8-13e0-469e-8e1a-d1239c7cb142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:12.933062 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa770ca8-13e0-469e-8e1a-d1239c7cb142 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:12.944128 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1445/2897] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:12.948199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647404d6-4fe0-4d31-83a4-b08afb07681a admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:12.958796 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647404d6-4fe0-4d31-83a4-b08afb07681a admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:12.963405 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc575dd-3301-4bfa-87cb-2e157faf5878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:12.964084 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc575dd-3301-4bfa-87cb-2e157faf5878 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.964393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc575dd-3301-4bfa-87cb-2e157faf5878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.964670 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc575dd-3301-4bfa-87cb-2e157faf5878 admin admin] PATH_INFO: `/v3/projects/f36b8a8a70554f8a89322e0c5e38e8ba/users/5f7f2655ca5e470296783c1273de75f9/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.979748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc575dd-3301-4bfa-87cb-2e157faf5878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f36b8a8a70554f8a89322e0c5e38e8ba, user_id=5f7f2655ca5e470296783c1273de75f9, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:12.982506 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc575dd-3301-4bfa-87cb-2e157faf5878 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:12.996164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1453/2898] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:12 2022] PUT /identity/v3/projects/f36b8a8a70554f8a89322e0c5e38e8ba/users/5f7f2655ca5e470296783c1273de75f9/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:13.001182 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587b704-df41-4e04-b58c-961d5c606783 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:13.001467 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587b704-df41-4e04-b58c-961d5c606783 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:13.001737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587b704-df41-4e04-b58c-961d5c606783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:13.021317 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-0587b704-df41-4e04-b58c-961d5c606783 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:13.022510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-0587b704-df41-4e04-b58c-961d5c606783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:13.081284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1446/2899] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:13.091665 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc575dd-3301-4bfa-87cb-2e157faf5878 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:13.093394 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9dc575dd-3301-4bfa-87cb-2e157faf5878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:13.151063 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc575dd-3301-4bfa-87cb-2e157faf5878 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:13.154687 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18997341-c4c1-4cef-b432-8ea768bf4bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:13.155290 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18997341-c4c1-4cef-b432-8ea768bf4bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:13.155571 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18997341-c4c1-4cef-b432-8ea768bf4bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:13.155845 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18997341-c4c1-4cef-b432-8ea768bf4bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:13.165169 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18997341-c4c1-4cef-b432-8ea768bf4bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:13.166586 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18997341-c4c1-4cef-b432-8ea768bf4bf3 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:13.176256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1454/2900] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:17.241043 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b673272-4ba2-40b8-8b90-e493bf97cbba None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:17.241606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b673272-4ba2-40b8-8b90-e493bf97cbba None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:17.241606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b673272-4ba2-40b8-8b90-e493bf97cbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:17.277077 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7b673272-4ba2-40b8-8b90-e493bf97cbba None None] MFA Rules not processed for user `5f7f2655ca5e470296783c1273de75f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:17.278294 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7b673272-4ba2-40b8-8b90-e493bf97cbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:17.329684 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:17.356849 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1447/2901] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:49:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:17.361428 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18997341-c4c1-4cef-b432-8ea768bf4bf3 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:17.372657 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18997341-c4c1-4cef-b432-8ea768bf4bf3 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:17.378215 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743c73e-2c9f-46a5-b673-2082d3011827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:17.378833 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743c73e-2c9f-46a5-b673-2082d3011827 admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:17.379112 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743c73e-2c9f-46a5-b673-2082d3011827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:17.379960 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743c73e-2c9f-46a5-b673-2082d3011827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:17.380611 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743c73e-2c9f-46a5-b673-2082d3011827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:17.383478 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743c73e-2c9f-46a5-b673-2082d3011827 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:17.395840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:17.414556 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1455/2902] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:49:17 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:17.418729 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b673272-4ba2-40b8-8b90-e493bf97cbba None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:17.431065 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b673272-4ba2-40b8-8b90-e493bf97cbba None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:17.492941 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058dba95-915f-45c9-910f-c5b30f624fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:17.493577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dba95-915f-45c9-910f-c5b30f624fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:17.493858 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dba95-915f-45c9-910f-c5b30f624fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:17.494130 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dba95-915f-45c9-910f-c5b30f624fcb admin admin] PATH_INFO: `/v3/users` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:17.494771 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058dba95-915f-45c9-910f-c5b30f624fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:17.496780 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058dba95-915f-45c9-910f-c5b30f624fcb admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:17.517973 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1448/2903] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:49:17 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:17.522492 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743c73e-2c9f-46a5-b673-2082d3011827 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:17.533136 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743c73e-2c9f-46a5-b673-2082d3011827 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:17.537729 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ea077-5146-4fad-808a-854310a610e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:17.538323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ea077-5146-4fad-808a-854310a610e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:17.538606 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ea077-5146-4fad-808a-854310a610e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:17.538880 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ea077-5146-4fad-808a-854310a610e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:17.539522 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ea077-5146-4fad-808a-854310a610e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:17.541153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ea077-5146-4fad-808a-854310a610e9 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:17.551921 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1456/2904] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:17.556302 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058dba95-915f-45c9-910f-c5b30f624fcb admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:17.566289 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058dba95-915f-45c9-910f-c5b30f624fcb admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:17.572190 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0574a-f3c8-40b7-9f07-6ae50012609b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:17.572859 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0574a-f3c8-40b7-9f07-6ae50012609b admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:17.573184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0574a-f3c8-40b7-9f07-6ae50012609b admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:17.573416 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0574a-f3c8-40b7-9f07-6ae50012609b admin admin] PATH_INFO: `/v3/projects/e7361ac4413545008da6e367a268b79a/users/4ef5b549c5e2452883fb75f571a2207a/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:17.588700 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0574a-f3c8-40b7-9f07-6ae50012609b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7361ac4413545008da6e367a268b79a, user_id=4ef5b549c5e2452883fb75f571a2207a, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:17.591337 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0574a-f3c8-40b7-9f07-6ae50012609b admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:17.604093 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1449/2905] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:17 2022] PUT /identity/v3/projects/e7361ac4413545008da6e367a268b79a/users/4ef5b549c5e2452883fb75f571a2207a/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:17.608027 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ea077-5146-4fad-808a-854310a610e9 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:17.618402 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ea077-5146-4fad-808a-854310a610e9 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:17.674961 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c353c-f75b-4e15-a653-28023a63cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:17.675563 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c353c-f75b-4e15-a653-28023a63cc52 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:17.675840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c353c-f75b-4e15-a653-28023a63cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:17.676656 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c353c-f75b-4e15-a653-28023a63cc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:17.677456 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c353c-f75b-4e15-a653-28023a63cc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:17.679056 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c353c-f75b-4e15-a653-28023a63cc52 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:17.688889 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1457/2906] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:17.696820 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0574a-f3c8-40b7-9f07-6ae50012609b admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:17.708449 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0574a-f3c8-40b7-9f07-6ae50012609b admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:17.712982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31559432-4f81-442a-bdb5-5d8c8070e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:17.713629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31559432-4f81-442a-bdb5-5d8c8070e8f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:17.713909 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31559432-4f81-442a-bdb5-5d8c8070e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:17.714180 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31559432-4f81-442a-bdb5-5d8c8070e8f2 admin admin] PATH_INFO: `/v3/projects/e7361ac4413545008da6e367a268b79a/users/4ef5b549c5e2452883fb75f571a2207a/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:17.716229 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31559432-4f81-442a-bdb5-5d8c8070e8f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7361ac4413545008da6e367a268b79a, user_id=4ef5b549c5e2452883fb75f571a2207a, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:17.718874 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31559432-4f81-442a-bdb5-5d8c8070e8f2 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:17.730324 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1450/2907] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:17 2022] PUT /identity/v3/projects/e7361ac4413545008da6e367a268b79a/users/4ef5b549c5e2452883fb75f571a2207a/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:22.172805 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421a54b-9d2f-4cc0-a172-73d542986f49 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:22.173425 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421a54b-9d2f-4cc0-a172-73d542986f49 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:22.173425 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421a54b-9d2f-4cc0-a172-73d542986f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:22.212951 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-3421a54b-9d2f-4cc0-a172-73d542986f49 None None] MFA Rules not processed for user `4ef5b549c5e2452883fb75f571a2207a`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:22.214174 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-3421a54b-9d2f-4cc0-a172-73d542986f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:22.298300 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1458/2908] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:49:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:22.316898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31559432-4f81-442a-bdb5-5d8c8070e8f2 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:22.319205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-31559432-4f81-442a-bdb5-5d8c8070e8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:22.422802 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31559432-4f81-442a-bdb5-5d8c8070e8f2 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:22.429622 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13d76e-b513-40be-a596-2a59950afefb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:22.429875 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13d76e-b513-40be-a596-2a59950afefb service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:22.430127 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13d76e-b513-40be-a596-2a59950afefb service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:22.430403 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13d76e-b513-40be-a596-2a59950afefb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:22.477219 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:22.494137 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13d76e-b513-40be-a596-2a59950afefb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:22.495727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13d76e-b513-40be-a596-2a59950afefb service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:22.505792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1451/2909] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:49:23.496715 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ec63a-e1dd-49ec-98a0-9f21f5fded46 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:23.497218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ec63a-e1dd-49ec-98a0-9f21f5fded46 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:23.497318 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ec63a-e1dd-49ec-98a0-9f21f5fded46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:23.516096 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-271ec63a-e1dd-49ec-98a0-9f21f5fded46 None None] MFA Rules not processed for user `5f7f2655ca5e470296783c1273de75f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:23.517317 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-271ec63a-e1dd-49ec-98a0-9f21f5fded46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:23.524547 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1459/2910] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:49:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:49:32.501470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=9 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:33.510853 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:39.680078 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13d76e-b513-40be-a596-2a59950afefb service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:39.737365 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13d76e-b513-40be-a596-2a59950afefb service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:39.741288 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ea1ee-98a7-45f8-9a0a-d11d7583303b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:39.741883 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ea1ee-98a7-45f8-9a0a-d11d7583303b service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:39.742159 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ea1ee-98a7-45f8-9a0a-d11d7583303b service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:39.742429 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ea1ee-98a7-45f8-9a0a-d11d7583303b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:39.751269 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ea1ee-98a7-45f8-9a0a-d11d7583303b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:39.752703 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ea1ee-98a7-45f8-9a0a-d11d7583303b service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:39.762275 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1452/2911] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:49.758068 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=26 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:37.811438 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ec63a-e1dd-49ec-98a0-9f21f5fded46 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:37.812964 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-271ec63a-e1dd-49ec-98a0-9f21f5fded46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:37.901145 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ec63a-e1dd-49ec-98a0-9f21f5fded46 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:37.905723 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb9c2e-6444-4887-9c45-8dc99dbf283c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345c25e7dd2341bcb4c53d0a5aa36b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:37.906567 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb9c2e-6444-4887-9c45-8dc99dbf283c service glance] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:37.907101 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb9c2e-6444-4887-9c45-8dc99dbf283c service glance] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:37.908323 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb9c2e-6444-4887-9c45-8dc99dbf283c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:37.910297 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4efb9c2e-6444-4887-9c45-8dc99dbf283c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:37.926436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb9c2e-6444-4887-9c45-8dc99dbf283c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:37.928074 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb9c2e-6444-4887-9c45-8dc99dbf283c service glance] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:37.940129 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1460/2912] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:38.107672 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ea1ee-98a7-45f8-9a0a-d11d7583303b service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:38.116606 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ea1ee-98a7-45f8-9a0a-d11d7583303b service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:38.120241 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55a8b4-6002-499c-8537-f2a6621869d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:38.120839 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55a8b4-6002-499c-8537-f2a6621869d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:38.121115 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55a8b4-6002-499c-8537-f2a6621869d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:38.121384 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55a8b4-6002-499c-8537-f2a6621869d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:38.123140 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3e55a8b4-6002-499c-8537-f2a6621869d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:38.136802 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55a8b4-6002-499c-8537-f2a6621869d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:38.138217 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55a8b4-6002-499c-8537-f2a6621869d5 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:38.149934 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1453/2913] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:38.266486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb9c2e-6444-4887-9c45-8dc99dbf283c service glance] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:38.276912 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb9c2e-6444-4887-9c45-8dc99dbf283c service glance] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:38.280486 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0079bc-c62a-4936-8b21-c565a8c1d3cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:38.281079 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0079bc-c62a-4936-8b21-c565a8c1d3cf service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:38.281358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0079bc-c62a-4936-8b21-c565a8c1d3cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:38.281627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0079bc-c62a-4936-8b21-c565a8c1d3cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:38.283689 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4e0079bc-c62a-4936-8b21-c565a8c1d3cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:38.293292 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0079bc-c62a-4936-8b21-c565a8c1d3cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:38.294704 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0079bc-c62a-4936-8b21-c565a8c1d3cf service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:38.305049 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1461/2914] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:48.144968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:48.301493 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=41 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:51.384969 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd704e5e-5615-4412-908c-b59b0053a49a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:51.385438 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd704e5e-5615-4412-908c-b59b0053a49a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:51.385540 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd704e5e-5615-4412-908c-b59b0053a49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:51.445101 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-dd704e5e-5615-4412-908c-b59b0053a49a None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:51.446309 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-dd704e5e-5615-4412-908c-b59b0053a49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:51.512830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1454/2915] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 01:51:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:51.564867 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0079bc-c62a-4936-8b21-c565a8c1d3cf service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:51.566322 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4e0079bc-c62a-4936-8b21-c565a8c1d3cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:51.662787 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd704e5e-5615-4412-908c-b59b0053a49a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:51.665281 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0079bc-c62a-4936-8b21-c565a8c1d3cf service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:51.670384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef9447-4682-402b-b5c6-203634912e78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:51.671490 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9447-4682-402b-b5c6-203634912e78 service swift] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:51.671761 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9447-4682-402b-b5c6-203634912e78 service swift] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:51.672074 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9447-4682-402b-b5c6-203634912e78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:51.678346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd704e5e-5615-4412-908c-b59b0053a49a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:51.684288 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef9447-4682-402b-b5c6-203634912e78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:51.684654 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec8e6f-338c-4ccc-9548-4271e44d2f37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:51.685284 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec8e6f-338c-4ccc-9548-4271e44d2f37 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:51.685567 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec8e6f-338c-4ccc-9548-4271e44d2f37 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:51.685842 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec8e6f-338c-4ccc-9548-4271e44d2f37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:51.686072 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef9447-4682-402b-b5c6-203634912e78 service swift] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:51.687617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-82ec8e6f-338c-4ccc-9548-4271e44d2f37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:51.696327 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1462/2916] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 01:51:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:51:51.705565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec8e6f-338c-4ccc-9548-4271e44d2f37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:51.707164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec8e6f-338c-4ccc-9548-4271e44d2f37 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:51.719535 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1455/2917] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:52:01.693192 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=41 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:01.714149 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=50 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:04.431568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0c582-583d-42dc-807c-53232fbf6d35 None None] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:04.432166 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0c582-583d-42dc-807c-53232fbf6d35 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:04.432331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0c582-583d-42dc-807c-53232fbf6d35 None None] PATH_INFO: `/` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:04.433821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1463/2918] 10.222.0.20 () {54 vars in 921 bytes} [Sun Aug 7 01:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:52:04.440270 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f43f8-93c8-45d8-a1a8-027af266cd78 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:04.440818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f43f8-93c8-45d8-a1a8-027af266cd78 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:04.440818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f43f8-93c8-45d8-a1a8-027af266cd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:04.493896 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ac5f43f8-93c8-45d8-a1a8-027af266cd78 None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:52:04.495221 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ac5f43f8-93c8-45d8-a1a8-027af266cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:04.505405 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1456/2919] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:52:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:52:04.520081 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0c582-583d-42dc-807c-53232fbf6d35 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:52:04.531322 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0c582-583d-42dc-807c-53232fbf6d35 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:52:04.535032 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613b322-648e-4a3c-a865-67ce7cdd4124 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345c25e7dd2341bcb4c53d0a5aa36b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:52:04.535645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613b322-648e-4a3c-a865-67ce7cdd4124 service glance] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:04.536011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613b322-648e-4a3c-a865-67ce7cdd4124 service glance] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:04.536294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613b322-648e-4a3c-a865-67ce7cdd4124 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:04.547031 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613b322-648e-4a3c-a865-67ce7cdd4124 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:52:04.549113 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613b322-648e-4a3c-a865-67ce7cdd4124 service glance] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:52:04.564003 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1464/2920] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:52:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:52:04.632576 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f43f8-93c8-45d8-a1a8-027af266cd78 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:52:04.633961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ac5f43f8-93c8-45d8-a1a8-027af266cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:04.646069 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f43f8-93c8-45d8-a1a8-027af266cd78 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:52:04.649662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ed5e7-3105-4ded-b6e4-aaca05870c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:52:04.650267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ed5e7-3105-4ded-b6e4-aaca05870c63 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:04.650544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ed5e7-3105-4ded-b6e4-aaca05870c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:04.650815 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ed5e7-3105-4ded-b6e4-aaca05870c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:04.652573 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-938ed5e7-3105-4ded-b6e4-aaca05870c63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:04.662995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ed5e7-3105-4ded-b6e4-aaca05870c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:52:04.664473 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ed5e7-3105-4ded-b6e4-aaca05870c63 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:52:04.673280 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1457/2921] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:52:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:52:04.746170 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613b322-648e-4a3c-a865-67ce7cdd4124 service glance] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:52:04.756732 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613b322-648e-4a3c-a865-67ce7cdd4124 service glance] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:52:04.760197 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53295e2c-e924-4720-bb1d-a4c3582bef38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:52:04.760779 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53295e2c-e924-4720-bb1d-a4c3582bef38 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:04.761054 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53295e2c-e924-4720-bb1d-a4c3582bef38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:04.761353 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53295e2c-e924-4720-bb1d-a4c3582bef38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:04.763050 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-53295e2c-e924-4720-bb1d-a4c3582bef38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:04.777036 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53295e2c-e924-4720-bb1d-a4c3582bef38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:52:04.778436 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53295e2c-e924-4720-bb1d-a4c3582bef38 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:52:04.789628 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1465/2922] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:52:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:52:04.850116 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ed5e7-3105-4ded-b6e4-aaca05870c63 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:52:04.851520 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-938ed5e7-3105-4ded-b6e4-aaca05870c63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:04.921714 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ed5e7-3105-4ded-b6e4-aaca05870c63 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:52:04.926806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc464eb-504b-4ac4-9531-7864abf55b15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:52:04.927409 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc464eb-504b-4ac4-9531-7864abf55b15 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:04.927698 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc464eb-504b-4ac4-9531-7864abf55b15 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:04.928005 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc464eb-504b-4ac4-9531-7864abf55b15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:04.929745 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1fc464eb-504b-4ac4-9531-7864abf55b15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:04.941880 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc464eb-504b-4ac4-9531-7864abf55b15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:52:04.943460 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc464eb-504b-4ac4-9531-7864abf55b15 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:52:04.953405 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1458/2923] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:52:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:52:06.877218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86762360-7c31-438f-b3c8-6fae5ceb36d5 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:06.877747 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86762360-7c31-438f-b3c8-6fae5ceb36d5 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:06.877848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86762360-7c31-438f-b3c8-6fae5ceb36d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:06.897211 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-86762360-7c31-438f-b3c8-6fae5ceb36d5 None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:52:06.898538 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-86762360-7c31-438f-b3c8-6fae5ceb36d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:06.906426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1466/2924] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 01:52:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:52:06.918838 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc464eb-504b-4ac4-9531-7864abf55b15 service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:52:06.931377 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc464eb-504b-4ac4-9531-7864abf55b15 service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:52:06.936809 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93a720-1a3b-4bcc-a269-3bf012e622cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:52:06.937691 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93a720-1a3b-4bcc-a269-3bf012e622cc service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:06.938421 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93a720-1a3b-4bcc-a269-3bf012e622cc service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:06.938920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93a720-1a3b-4bcc-a269-3bf012e622cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:06.947662 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93a720-1a3b-4bcc-a269-3bf012e622cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:52:06.949281 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93a720-1a3b-4bcc-a269-3bf012e622cc service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:52:06.957475 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1459/2925] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 01:52:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:52:16.892962 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=15 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:16.954252 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=57 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:21.756764 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901c038-2d0b-4014-9a8b-597d705091a8 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:21.757333 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901c038-2d0b-4014-9a8b-597d705091a8 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:21.757333 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901c038-2d0b-4014-9a8b-597d705091a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:21.776777 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-9901c038-2d0b-4014-9a8b-597d705091a8 None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:52:21.777774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-9901c038-2d0b-4014-9a8b-597d705091a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:21.785721 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1467/2926] 10.222.0.20 () {58 vars in 967 bytes} [Sun Aug 7 01:52:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:52:21.798290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93a720-1a3b-4bcc-a269-3bf012e622cc service swift] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:52:21.828959 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93a720-1a3b-4bcc-a269-3bf012e622cc service swift] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:52:21.833997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c13ff6-30da-4c63-8d5f-6fc0721d7a72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:52:21.834590 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c13ff6-30da-4c63-8d5f-6fc0721d7a72 service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:21.834870 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c13ff6-30da-4c63-8d5f-6fc0721d7a72 service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:21.835142 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c13ff6-30da-4c63-8d5f-6fc0721d7a72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:21.843131 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c13ff6-30da-4c63-8d5f-6fc0721d7a72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:52:21.844769 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c13ff6-30da-4c63-8d5f-6fc0721d7a72 service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:52:21.852768 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1460/2927] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 01:52:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:52:31.495476 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901c038-2d0b-4014-9a8b-597d705091a8 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:52:31.517468 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901c038-2d0b-4014-9a8b-597d705091a8 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:52:31.522386 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb664ee-a3b1-4760-bb23-01108e8ed2fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:52:31.522982 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb664ee-a3b1-4760-bb23-01108e8ed2fe service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:31.523261 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb664ee-a3b1-4760-bb23-01108e8ed2fe service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:31.523531 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb664ee-a3b1-4760-bb23-01108e8ed2fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:31.525303 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-fdb664ee-a3b1-4760-bb23-01108e8ed2fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:31.549438 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb664ee-a3b1-4760-bb23-01108e8ed2fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:52:31.551005 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb664ee-a3b1-4760-bb23-01108e8ed2fe service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:52:31.560811 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1468/2928] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:52:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:52:31.849522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=15 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:41.556711 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=18 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:37.341346 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c13ff6-30da-4c63-8d5f-6fc0721d7a72 service swift] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:37.343546 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-a5c13ff6-30da-4c63-8d5f-6fc0721d7a72 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:37.396318 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c13ff6-30da-4c63-8d5f-6fc0721d7a72 service swift] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:37.402157 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfe5aa-d810-492f-b1fa-f90864eb9ec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:37.402787 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfe5aa-d810-492f-b1fa-f90864eb9ec1 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:37.403094 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfe5aa-d810-492f-b1fa-f90864eb9ec1 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:37.403373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfe5aa-d810-492f-b1fa-f90864eb9ec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:37.405989 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-38dfe5aa-d810-492f-b1fa-f90864eb9ec1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:37.421328 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfe5aa-d810-492f-b1fa-f90864eb9ec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:37.423263 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfe5aa-d810-492f-b1fa-f90864eb9ec1 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:37.435502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1461/2929] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:53:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:53:42.189509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1e278-2dd1-43c4-b6f3-fd151d216ee6 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:42.190047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1e278-2dd1-43c4-b6f3-fd151d216ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:42.190047 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1e278-2dd1-43c4-b6f3-fd151d216ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:42.210401 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-fbe1e278-2dd1-43c4-b6f3-fd151d216ee6 None None] MFA Rules not processed for user `5f7f2655ca5e470296783c1273de75f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:53:42.211589 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-fbe1e278-2dd1-43c4-b6f3-fd151d216ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:42.219114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1469/2930] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:53:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:53:47.430968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=19 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:52.205279 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:57.747020 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bb759-69b6-4105-8217-9e69a724fe0b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:57.747652 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bb759-69b6-4105-8217-9e69a724fe0b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:57.747837 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bb759-69b6-4105-8217-9e69a724fe0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:57.766972 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-2b0bb759-69b6-4105-8217-9e69a724fe0b None None] MFA Rules not processed for user `e393d9c50bbb4f69a48ae635d13b1197`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:53:57.768210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-2b0bb759-69b6-4105-8217-9e69a724fe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:57.774659 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1462/2931] 10.222.0.20 () {58 vars in 1062 bytes} [Sun Aug 7 01:53:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:53:57.781066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1e278-2dd1-43c4-b6f3-fd151d216ee6 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:57.790396 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1e278-2dd1-43c4-b6f3-fd151d216ee6 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:57.794168 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272f9df-4d03-49dd-9d05-1c5f4c9de152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:57.795326 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272f9df-4d03-49dd-9d05-1c5f4c9de152 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:57.795607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272f9df-4d03-49dd-9d05-1c5f4c9de152 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:57.795879 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272f9df-4d03-49dd-9d05-1c5f4c9de152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:57.797941 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8272f9df-4d03-49dd-9d05-1c5f4c9de152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:57.807475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272f9df-4d03-49dd-9d05-1c5f4c9de152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:57.808938 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272f9df-4d03-49dd-9d05-1c5f4c9de152 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:57.816776 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1470/2932] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:53:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:54:00.264480 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa5d7e-c713-46cb-bf0d-a0c077445dc2 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:00.264971 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa5d7e-c713-46cb-bf0d-a0c077445dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:00.265082 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa5d7e-c713-46cb-bf0d-a0c077445dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:00.284537 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-6daa5d7e-c713-46cb-bf0d-a0c077445dc2 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:00.285740 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-6daa5d7e-c713-46cb-bf0d-a0c077445dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:00.294164 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1463/2933] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:54:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:00.306825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272f9df-4d03-49dd-9d05-1c5f4c9de152 service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:00.308269 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-8272f9df-4d03-49dd-9d05-1c5f4c9de152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:00.323608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272f9df-4d03-49dd-9d05-1c5f4c9de152 service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:00.328785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b02110-e05c-42df-a6bb-f545c144a657 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:00.330450 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b02110-e05c-42df-a6bb-f545c144a657 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:00.330450 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b02110-e05c-42df-a6bb-f545c144a657 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:00.330450 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b02110-e05c-42df-a6bb-f545c144a657 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:00.340245 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b02110-e05c-42df-a6bb-f545c144a657 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:00.341831 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b02110-e05c-42df-a6bb-f545c144a657 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:00.351893 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1471/2934] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:54:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:54:10.279730 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:10.347532 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=12 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:20.770575 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa5d7e-c713-46cb-bf0d-a0c077445dc2 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:20.799308 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa5d7e-c713-46cb-bf0d-a0c077445dc2 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:20.804841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adf884-0add-454d-aa78-6e2d30654447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:20.805442 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf884-0add-454d-aa78-6e2d30654447 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:20.805795 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf884-0add-454d-aa78-6e2d30654447 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:20.806129 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf884-0add-454d-aa78-6e2d30654447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:20.815174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adf884-0add-454d-aa78-6e2d30654447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:20.817392 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adf884-0add-454d-aa78-6e2d30654447 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:20.828271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1464/2935] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:56:30.823439 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=13 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:36.769328 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548b26d-241e-4778-a091-30b8f9a58510 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:36.769826 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548b26d-241e-4778-a091-30b8f9a58510 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:36.770040 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548b26d-241e-4778-a091-30b8f9a58510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:36.808712 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-a548b26d-241e-4778-a091-30b8f9a58510 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:56:36.809945 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a548b26d-241e-4778-a091-30b8f9a58510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:36.818593 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1472/2936] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 01:56:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:56:36.832267 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adf884-0add-454d-aa78-6e2d30654447 service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:36.844202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adf884-0add-454d-aa78-6e2d30654447 service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:36.849188 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2400a0-d5ba-4111-aa75-3794aae67d74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:36.849791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2400a0-d5ba-4111-aa75-3794aae67d74 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:36.850103 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2400a0-d5ba-4111-aa75-3794aae67d74 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:36.850375 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2400a0-d5ba-4111-aa75-3794aae67d74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:36.859646 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2400a0-d5ba-4111-aa75-3794aae67d74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:36.861501 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2400a0-d5ba-4111-aa75-3794aae67d74 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:36.872568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1465/2937] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:56:37.830455 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548b26d-241e-4778-a091-30b8f9a58510 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:37.850565 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548b26d-241e-4778-a091-30b8f9a58510 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:37.854388 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14cc4c-0e57-4258-b4b7-47336ed5069e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:37.854989 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14cc4c-0e57-4258-b4b7-47336ed5069e service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:37.855264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14cc4c-0e57-4258-b4b7-47336ed5069e service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:37.855531 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14cc4c-0e57-4258-b4b7-47336ed5069e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:37.866460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14cc4c-0e57-4258-b4b7-47336ed5069e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:37.867889 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14cc4c-0e57-4258-b4b7-47336ed5069e service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:37.879514 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1473/2938] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:56:39.071092 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2400a0-d5ba-4111-aa75-3794aae67d74 service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:39.081619 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2400a0-d5ba-4111-aa75-3794aae67d74 service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:39.085508 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b6532-33e9-4495-86cb-1ec9854a019a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:39.086114 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b6532-33e9-4495-86cb-1ec9854a019a service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:39.086417 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b6532-33e9-4495-86cb-1ec9854a019a service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:39.087135 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b6532-33e9-4495-86cb-1ec9854a019a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:39.100174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b6532-33e9-4495-86cb-1ec9854a019a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:39.101788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b6532-33e9-4495-86cb-1ec9854a019a service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:39.114882 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1466/2939] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:56:42.482307 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14cc4c-0e57-4258-b4b7-47336ed5069e service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:42.490800 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14cc4c-0e57-4258-b4b7-47336ed5069e service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:42.494517 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fb7b8-8e95-4465-a618-266d4b07c12e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:42.495114 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fb7b8-8e95-4465-a618-266d4b07c12e service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:42.495387 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fb7b8-8e95-4465-a618-266d4b07c12e service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:42.495653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fb7b8-8e95-4465-a618-266d4b07c12e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:42.503387 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fb7b8-8e95-4465-a618-266d4b07c12e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:42.504840 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fb7b8-8e95-4465-a618-266d4b07c12e service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:42.513449 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1474/2940] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:56:49.109434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=12 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:52.509294 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=25 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:52.948107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b6532-33e9-4495-86cb-1ec9854a019a service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:52.961013 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b6532-33e9-4495-86cb-1ec9854a019a service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:52.967663 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581a06f-cf2f-4016-a050-86e56cdba4e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:52.968441 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581a06f-cf2f-4016-a050-86e56cdba4e9 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:52.968723 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581a06f-cf2f-4016-a050-86e56cdba4e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:52.968997 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581a06f-cf2f-4016-a050-86e56cdba4e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:52.978845 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581a06f-cf2f-4016-a050-86e56cdba4e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:52.980551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581a06f-cf2f-4016-a050-86e56cdba4e9 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:52.992684 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1467/2941] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:57:02.987198 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:36.530019 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fb7b8-8e95-4465-a618-266d4b07c12e service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:36.542085 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fb7b8-8e95-4465-a618-266d4b07c12e service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:36.547125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd38669-eb13-422b-af39-a662dbe6ad66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:36.547710 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd38669-eb13-422b-af39-a662dbe6ad66 service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:36.548020 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd38669-eb13-422b-af39-a662dbe6ad66 service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:36.548289 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd38669-eb13-422b-af39-a662dbe6ad66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:36.557256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd38669-eb13-422b-af39-a662dbe6ad66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:36.558882 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd38669-eb13-422b-af39-a662dbe6ad66 service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:36.568956 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1475/2942] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:57:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:57:46.564709 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=6 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:20.778830 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342d465-d1f0-438d-b173-594087846330 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:20.779336 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342d465-d1f0-438d-b173-594087846330 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:20.779466 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342d465-d1f0-438d-b173-594087846330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:20.834154 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1342d465-d1f0-438d-b173-594087846330 None None] MFA Rules not processed for user `e393d9c50bbb4f69a48ae635d13b1197`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:58:20.835350 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1342d465-d1f0-438d-b173-594087846330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:20.841832 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1468/2943] 10.222.0.20 () {58 vars in 1062 bytes} [Sun Aug 7 01:58:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:58:20.848523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd38669-eb13-422b-af39-a662dbe6ad66 service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:20.857980 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd38669-eb13-422b-af39-a662dbe6ad66 service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:20.861769 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea55dd-3ce8-4d91-9969-9d1753b0623f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:20.862432 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea55dd-3ce8-4d91-9969-9d1753b0623f service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:20.862780 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea55dd-3ce8-4d91-9969-9d1753b0623f service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:20.863147 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea55dd-3ce8-4d91-9969-9d1753b0623f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:20.925025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea55dd-3ce8-4d91-9969-9d1753b0623f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:20.926380 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea55dd-3ce8-4d91-9969-9d1753b0623f service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:20.936941 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1476/2944] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:58:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:58:23.881666 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342d465-d1f0-438d-b173-594087846330 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:23.900395 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342d465-d1f0-438d-b173-594087846330 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:23.907689 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fbe46-74a1-4a58-a7cd-839785a50387 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:23.908353 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fbe46-74a1-4a58-a7cd-839785a50387 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:23.908643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fbe46-74a1-4a58-a7cd-839785a50387 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:23.908898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fbe46-74a1-4a58-a7cd-839785a50387 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:23.910792 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-840fbe46-74a1-4a58-a7cd-839785a50387 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:23.924992 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fbe46-74a1-4a58-a7cd-839785a50387 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:23.927366 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fbe46-74a1-4a58-a7cd-839785a50387 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:23.941658 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1469/2945] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:58:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:58:27.162930 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea55dd-3ce8-4d91-9969-9d1753b0623f service neutron] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:27.174004 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea55dd-3ce8-4d91-9969-9d1753b0623f service neutron] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:27.179077 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da0661-d1a8-45fe-a4b6-c5ce57569b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:27.179793 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0661-d1a8-45fe-a4b6-c5ce57569b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:27.180160 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0661-d1a8-45fe-a4b6-c5ce57569b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:27.180499 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0661-d1a8-45fe-a4b6-c5ce57569b4b admin admin] PATH_INFO: `/v3/users/5f7f2655ca5e470296783c1273de75f9` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:27.181896 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da0661-d1a8-45fe-a4b6-c5ce57569b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f7f2655ca5e470296783c1273de75f9)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:27.183748 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da0661-d1a8-45fe-a4b6-c5ce57569b4b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:27.231423 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-55da0661-d1a8-45fe-a4b6-c5ce57569b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7f2655ca5e470296783c1273de75f9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:27.239251 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-55da0661-d1a8-45fe-a4b6-c5ce57569b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7f2655ca5e470296783c1273de75f9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:27.251485 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-55da0661-d1a8-45fe-a4b6-c5ce57569b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7f2655ca5e470296783c1273de75f9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:27.252153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-55da0661-d1a8-45fe-a4b6-c5ce57569b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7f2655ca5e470296783c1273de75f9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:27.252760 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-55da0661-d1a8-45fe-a4b6-c5ce57569b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7f2655ca5e470296783c1273de75f9'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:27.265154 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1477/2946] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:58:27 2022] DELETE /identity/v3/users/5f7f2655ca5e470296783c1273de75f9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:58:27.436884 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fbe46-74a1-4a58-a7cd-839785a50387 service placement] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:27.449247 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fbe46-74a1-4a58-a7cd-839785a50387 service placement] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:27.506694 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64134ca6-3cdf-4225-8172-2e9955d2da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:27.507325 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64134ca6-3cdf-4225-8172-2e9955d2da5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:27.507601 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64134ca6-3cdf-4225-8172-2e9955d2da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:27.507909 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64134ca6-3cdf-4225-8172-2e9955d2da5d admin admin] PATH_INFO: `/v3/projects/f36b8a8a70554f8a89322e0c5e38e8ba` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:27.509026 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64134ca6-3cdf-4225-8172-2e9955d2da5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f36b8a8a70554f8a89322e0c5e38e8ba)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:27.510999 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64134ca6-3cdf-4225-8172-2e9955d2da5d admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:27.557254 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64134ca6-3cdf-4225-8172-2e9955d2da5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f36b8a8a70554f8a89322e0c5e38e8ba', 'request_id': 'req-64134ca6-3cdf-4225-8172-2e9955d2da5d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:27.564021 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64134ca6-3cdf-4225-8172-2e9955d2da5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f36b8a8a70554f8a89322e0c5e38e8ba', 'request_id': 'req-64134ca6-3cdf-4225-8172-2e9955d2da5d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:27.571150 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64134ca6-3cdf-4225-8172-2e9955d2da5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f36b8a8a70554f8a89322e0c5e38e8ba', 'request_id': 'req-64134ca6-3cdf-4225-8172-2e9955d2da5d'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:27.581215 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64134ca6-3cdf-4225-8172-2e9955d2da5d admin admin] The token cache is being invalidate because project f36b8a8a70554f8a89322e0c5e38e8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:58:27.581498 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64134ca6-3cdf-4225-8172-2e9955d2da5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:27.582120 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-64134ca6-3cdf-4225-8172-2e9955d2da5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:27.583588 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1470/2947] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:58:27 2022] DELETE /identity/v3/projects/f36b8a8a70554f8a89322e0c5e38e8ba => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:58:27.587650 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da0661-d1a8-45fe-a4b6-c5ce57569b4b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:27.589151 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-55da0661-d1a8-45fe-a4b6-c5ce57569b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:27.602162 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da0661-d1a8-45fe-a4b6-c5ce57569b4b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:27.664794 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab40b4d-f800-43e9-a928-18ad68014d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:27.665418 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab40b4d-f800-43e9-a928-18ad68014d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:27.665695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab40b4d-f800-43e9-a928-18ad68014d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:27.665960 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab40b4d-f800-43e9-a928-18ad68014d80 admin admin] PATH_INFO: `/v3/users/4ef5b549c5e2452883fb75f571a2207a` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:27.667069 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab40b4d-f800-43e9-a928-18ad68014d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef5b549c5e2452883fb75f571a2207a)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:27.669041 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab40b4d-f800-43e9-a928-18ad68014d80 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:27.675602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:27.715627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7ab40b4d-f800-43e9-a928-18ad68014d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef5b549c5e2452883fb75f571a2207a'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:27.723809 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7ab40b4d-f800-43e9-a928-18ad68014d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef5b549c5e2452883fb75f571a2207a'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:27.735475 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7ab40b4d-f800-43e9-a928-18ad68014d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef5b549c5e2452883fb75f571a2207a'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:27.736127 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7ab40b4d-f800-43e9-a928-18ad68014d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef5b549c5e2452883fb75f571a2207a'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:27.736726 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7ab40b4d-f800-43e9-a928-18ad68014d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef5b549c5e2452883fb75f571a2207a'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:27.749034 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1478/2948] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 01:58:27 2022] DELETE /identity/v3/users/4ef5b549c5e2452883fb75f571a2207a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:58:27.937508 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64134ca6-3cdf-4225-8172-2e9955d2da5d admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:27.938957 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-64134ca6-3cdf-4225-8172-2e9955d2da5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:27.952961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64134ca6-3cdf-4225-8172-2e9955d2da5d admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:27.999704 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:28.014531 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649e2c9-2fb1-4d45-8238-00c9fdc22469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:28.015275 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e2c9-2fb1-4d45-8238-00c9fdc22469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:28.015627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e2c9-2fb1-4d45-8238-00c9fdc22469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:28.016002 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649e2c9-2fb1-4d45-8238-00c9fdc22469 admin admin] PATH_INFO: `/v3/projects/e7361ac4413545008da6e367a268b79a` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:28.017298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649e2c9-2fb1-4d45-8238-00c9fdc22469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7361ac4413545008da6e367a268b79a)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:28.019333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649e2c9-2fb1-4d45-8238-00c9fdc22469 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:28.070665 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e649e2c9-2fb1-4d45-8238-00c9fdc22469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7361ac4413545008da6e367a268b79a', 'request_id': 'req-e649e2c9-2fb1-4d45-8238-00c9fdc22469'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:28.077075 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e649e2c9-2fb1-4d45-8238-00c9fdc22469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7361ac4413545008da6e367a268b79a', 'request_id': 'req-e649e2c9-2fb1-4d45-8238-00c9fdc22469'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:28.085250 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e649e2c9-2fb1-4d45-8238-00c9fdc22469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7361ac4413545008da6e367a268b79a', 'request_id': 'req-e649e2c9-2fb1-4d45-8238-00c9fdc22469'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:28.096501 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e649e2c9-2fb1-4d45-8238-00c9fdc22469 admin admin] The token cache is being invalidate because project e7361ac4413545008da6e367a268b79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80515) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:58:28.096791 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e649e2c9-2fb1-4d45-8238-00c9fdc22469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:28.098460 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-e649e2c9-2fb1-4d45-8238-00c9fdc22469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:58:28.099977 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1471/2949] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 01:58:27 2022] DELETE /identity/v3/projects/e7361ac4413545008da6e367a268b79a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:58:28.105015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e49a24-4597-4cde-9ae7-91bdf686427f None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:28.105303 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e49a24-4597-4cde-9ae7-91bdf686427f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:28.105607 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e49a24-4597-4cde-9ae7-91bdf686427f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:28.126506 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-51e49a24-4597-4cde-9ae7-91bdf686427f None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:58:28.127653 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-51e49a24-4597-4cde-9ae7-91bdf686427f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:28.186387 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1479/2950] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:58:28.194339 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ef71-f7f9-472f-8184-1782b5d3130a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:28.194626 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ef71-f7f9-472f-8184-1782b5d3130a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:28.194897 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ef71-f7f9-472f-8184-1782b5d3130a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:28.214295 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-1599ef71-f7f9-472f-8184-1782b5d3130a None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:58:28.215482 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-1599ef71-f7f9-472f-8184-1782b5d3130a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:28.223548 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1472/2951] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:58:28.227806 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e49a24-4597-4cde-9ae7-91bdf686427f None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:28.238351 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e49a24-4597-4cde-9ae7-91bdf686427f None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:28.242848 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78018b2f-465a-45bd-87d7-17f8316842e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:28.243438 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78018b2f-465a-45bd-87d7-17f8316842e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:28.243716 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78018b2f-465a-45bd-87d7-17f8316842e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:28.244025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78018b2f-465a-45bd-87d7-17f8316842e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:28.244668 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78018b2f-465a-45bd-87d7-17f8316842e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:58:28.244968 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78018b2f-465a-45bd-87d7-17f8316842e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:28.246585 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78018b2f-465a-45bd-87d7-17f8316842e1 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:28.258502 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1480/2952] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Aug 7 01:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:58:28.262699 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599ef71-f7f9-472f-8184-1782b5d3130a None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:28.272202 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599ef71-f7f9-472f-8184-1782b5d3130a None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:28.276720 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff4d97-2467-4247-860e-f34088dbe2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:28.277307 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff4d97-2467-4247-860e-f34088dbe2dd admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:28.277582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff4d97-2467-4247-860e-f34088dbe2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:28.277990 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff4d97-2467-4247-860e-f34088dbe2dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:28.278620 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff4d97-2467-4247-860e-f34088dbe2dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:28.280753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff4d97-2467-4247-860e-f34088dbe2dd admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:28.307893 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1473/2953] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:58:28 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:58:28.312650 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78018b2f-465a-45bd-87d7-17f8316842e1 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:28.322487 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78018b2f-465a-45bd-87d7-17f8316842e1 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:28.378004 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455df20-b8b2-4890-ad5a-cea4a8c3218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:28.378529 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455df20-b8b2-4890-ad5a-cea4a8c3218c admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:28.378803 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455df20-b8b2-4890-ad5a-cea4a8c3218c admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:28.379070 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455df20-b8b2-4890-ad5a-cea4a8c3218c admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:28.379688 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455df20-b8b2-4890-ad5a-cea4a8c3218c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:28.381612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455df20-b8b2-4890-ad5a-cea4a8c3218c admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:28.402829 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1481/2954] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:58:28 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:58:28.407434 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff4d97-2467-4247-860e-f34088dbe2dd admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:28.417921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff4d97-2467-4247-860e-f34088dbe2dd admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:28.423076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2c2a0-b741-4c41-b8e6-36fdb3e906e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:28.423670 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2c2a0-b741-4c41-b8e6-36fdb3e906e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:28.423974 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2c2a0-b741-4c41-b8e6-36fdb3e906e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:28.424253 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2c2a0-b741-4c41-b8e6-36fdb3e906e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:28.425138 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2c2a0-b741-4c41-b8e6-36fdb3e906e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:28.426705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2c2a0-b741-4c41-b8e6-36fdb3e906e4 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:28.436738 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1474/2955] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:58:28.440594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455df20-b8b2-4890-ad5a-cea4a8c3218c admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:28.445645 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:28.451875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455df20-b8b2-4890-ad5a-cea4a8c3218c admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:28.457617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f42b15-7d9f-4cc5-a70e-49865bfc3e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:28.458218 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f42b15-7d9f-4cc5-a70e-49865bfc3e63 admin admin] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:28.458501 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f42b15-7d9f-4cc5-a70e-49865bfc3e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:28.458774 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f42b15-7d9f-4cc5-a70e-49865bfc3e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:28.459460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f42b15-7d9f-4cc5-a70e-49865bfc3e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:28.461076 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f42b15-7d9f-4cc5-a70e-49865bfc3e63 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:28.472378 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1482/2956] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:58:28.476587 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2c2a0-b741-4c41-b8e6-36fdb3e906e4 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:28.487296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2c2a0-b741-4c41-b8e6-36fdb3e906e4 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:28.491978 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40bf68-ddf0-45bf-81c7-e9dcb9504b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:28.492618 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40bf68-ddf0-45bf-81c7-e9dcb9504b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:28.492898 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40bf68-ddf0-45bf-81c7-e9dcb9504b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:28.493171 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40bf68-ddf0-45bf-81c7-e9dcb9504b45 admin admin] PATH_INFO: `/v3/projects/4266153534904996a4a8e2e3b43aa6cf/users/1ac077804c5d4d009db7aaad4b704ac4/roles/93e4ae64906f4b0ea861a4ac4571f1d7` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:28.507931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40bf68-ddf0-45bf-81c7-e9dcb9504b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4266153534904996a4a8e2e3b43aa6cf, user_id=1ac077804c5d4d009db7aaad4b704ac4, role_id=93e4ae64906f4b0ea861a4ac4571f1d7)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:28.510602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40bf68-ddf0-45bf-81c7-e9dcb9504b45 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:28.523389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1475/2957] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:58:28 2022] PUT /identity/v3/projects/4266153534904996a4a8e2e3b43aa6cf/users/1ac077804c5d4d009db7aaad4b704ac4/roles/93e4ae64906f4b0ea861a4ac4571f1d7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:58:28.528588 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01015c3e-1c4b-461b-892f-cfeebe7f98f5 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:28.528875 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01015c3e-1c4b-461b-892f-cfeebe7f98f5 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:28.529676 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01015c3e-1c4b-461b-892f-cfeebe7f98f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:28.548566 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-01015c3e-1c4b-461b-892f-cfeebe7f98f5 None None] MFA Rules not processed for user `9aada59ce5bc4a1481277a87a82e45b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:58:28.550013 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-01015c3e-1c4b-461b-892f-cfeebe7f98f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:28.608208 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1483/2958] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:58:28.618118 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40bf68-ddf0-45bf-81c7-e9dcb9504b45 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:28.619818 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-5d40bf68-ddf0-45bf-81c7-e9dcb9504b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:28.677921 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40bf68-ddf0-45bf-81c7-e9dcb9504b45 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:28.681504 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4f82c-ec50-4fff-a64b-ef874937c9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:28.682096 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4f82c-ec50-4fff-a64b-ef874937c9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:28.682373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4f82c-ec50-4fff-a64b-ef874937c9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:28.682640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4f82c-ec50-4fff-a64b-ef874937c9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:28.692220 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4f82c-ec50-4fff-a64b-ef874937c9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:28.693636 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4f82c-ec50-4fff-a64b-ef874937c9b1 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:28.703996 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1476/2959] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:58:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:58:32.725842 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ff600-e58e-48be-b1a3-491605c648a7 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:32.726372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ff600-e58e-48be-b1a3-491605c648a7 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:32.726372 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ff600-e58e-48be-b1a3-491605c648a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:32.758551 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-1f4ff600-e58e-48be-b1a3-491605c648a7 None None] MFA Rules not processed for user `1ac077804c5d4d009db7aaad4b704ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:58:32.759778 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1f4ff600-e58e-48be-b1a3-491605c648a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:32.833217 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1484/2960] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:58:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:58:32.837788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4f82c-ec50-4fff-a64b-ef874937c9b1 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:32.848168 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4f82c-ec50-4fff-a64b-ef874937c9b1 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:32.852942 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6ba73-ed8f-49a1-8141-2e84dbbfcd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:32.853607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6ba73-ed8f-49a1-8141-2e84dbbfcd41 admin admin] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:32.853888 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6ba73-ed8f-49a1-8141-2e84dbbfcd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:32.854161 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6ba73-ed8f-49a1-8141-2e84dbbfcd41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:32.854819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6ba73-ed8f-49a1-8141-2e84dbbfcd41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:32.856777 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6ba73-ed8f-49a1-8141-2e84dbbfcd41 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:32.872084 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:32.886317 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1477/2961] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Aug 7 01:58:32 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:58:32.890662 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ff600-e58e-48be-b1a3-491605c648a7 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:32.902097 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ff600-e58e-48be-b1a3-491605c648a7 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:32.969147 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d8658-db5e-4ace-b519-1e146d23ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:32.969691 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d8658-db5e-4ace-b519-1e146d23ebcc admin admin] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:32.969972 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d8658-db5e-4ace-b519-1e146d23ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:32.970246 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d8658-db5e-4ace-b519-1e146d23ebcc admin admin] PATH_INFO: `/v3/users` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:32.970892 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d8658-db5e-4ace-b519-1e146d23ebcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:32.972860 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d8658-db5e-4ace-b519-1e146d23ebcc admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:32.994067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1485/2962] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Aug 7 01:58:32 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:58:32.998305 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6ba73-ed8f-49a1-8141-2e84dbbfcd41 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:33.008834 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6ba73-ed8f-49a1-8141-2e84dbbfcd41 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:33.013542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18900a91-d8c5-422f-a315-ac288b3ed960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:33.014334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18900a91-d8c5-422f-a315-ac288b3ed960 admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:33.014620 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18900a91-d8c5-422f-a315-ac288b3ed960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:33.014897 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18900a91-d8c5-422f-a315-ac288b3ed960 admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:33.015543 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18900a91-d8c5-422f-a315-ac288b3ed960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:33.017174 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18900a91-d8c5-422f-a315-ac288b3ed960 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:33.027865 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1478/2963] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:58:33.032646 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d8658-db5e-4ace-b519-1e146d23ebcc admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:33.042702 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d8658-db5e-4ace-b519-1e146d23ebcc admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:33.047979 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15947103-5fb0-4aba-97a9-edf419052bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:33.048621 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15947103-5fb0-4aba-97a9-edf419052bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:33.048920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15947103-5fb0-4aba-97a9-edf419052bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:33.049221 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15947103-5fb0-4aba-97a9-edf419052bd8 admin admin] PATH_INFO: `/v3/projects/25fa6866175f4d8c9dd038308ca3a0ca/users/d8f2e777fffb4fd99908da056864c45b/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:33.058109 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:33.065264 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15947103-5fb0-4aba-97a9-edf419052bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25fa6866175f4d8c9dd038308ca3a0ca, user_id=d8f2e777fffb4fd99908da056864c45b, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:33.068460 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15947103-5fb0-4aba-97a9-edf419052bd8 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:33.081450 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1486/2964] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:58:33 2022] PUT /identity/v3/projects/25fa6866175f4d8c9dd038308ca3a0ca/users/d8f2e777fffb4fd99908da056864c45b/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:58:33.085304 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18900a91-d8c5-422f-a315-ac288b3ed960 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:33.095955 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18900a91-d8c5-422f-a315-ac288b3ed960 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:33.153819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fd928-1267-45a7-bd80-baa7aa8e056e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:33.155052 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fd928-1267-45a7-bd80-baa7aa8e056e admin admin] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:33.155333 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fd928-1267-45a7-bd80-baa7aa8e056e admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:33.155607 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fd928-1267-45a7-bd80-baa7aa8e056e admin admin] PATH_INFO: `/v3/roles` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:33.156278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272fd928-1267-45a7-bd80-baa7aa8e056e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:33.157871 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272fd928-1267-45a7-bd80-baa7aa8e056e admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:33.167613 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1479/2965] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Aug 7 01:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:58:33.172785 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15947103-5fb0-4aba-97a9-edf419052bd8 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:33.183454 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15947103-5fb0-4aba-97a9-edf419052bd8 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:33.188202 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355b8e4-93ff-47a2-bc61-211a3a63c979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:33.188844 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355b8e4-93ff-47a2-bc61-211a3a63c979 admin admin] REQUEST_METHOD: `PUT` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:33.189116 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355b8e4-93ff-47a2-bc61-211a3a63c979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:33.189386 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355b8e4-93ff-47a2-bc61-211a3a63c979 admin admin] PATH_INFO: `/v3/projects/25fa6866175f4d8c9dd038308ca3a0ca/users/d8f2e777fffb4fd99908da056864c45b/roles/638e1fc82db44124ae615c46408110a7` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:33.191287 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355b8e4-93ff-47a2-bc61-211a3a63c979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25fa6866175f4d8c9dd038308ca3a0ca, user_id=d8f2e777fffb4fd99908da056864c45b, role_id=638e1fc82db44124ae615c46408110a7)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:33.193923 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355b8e4-93ff-47a2-bc61-211a3a63c979 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:33.204654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1487/2966] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Aug 7 01:58:33 2022] PUT /identity/v3/projects/25fa6866175f4d8c9dd038308ca3a0ca/users/d8f2e777fffb4fd99908da056864c45b/roles/638e1fc82db44124ae615c46408110a7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:58:37.527291 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9185d1-23ff-4ace-a986-41cd8d81c44a None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:37.527754 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9185d1-23ff-4ace-a986-41cd8d81c44a None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:37.527863 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9185d1-23ff-4ace-a986-41cd8d81c44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:37.563396 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-df9185d1-23ff-4ace-a986-41cd8d81c44a None None] MFA Rules not processed for user `d8f2e777fffb4fd99908da056864c45b`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:58:37.564675 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-df9185d1-23ff-4ace-a986-41cd8d81c44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:37.668098 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1480/2967] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:58:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:58:37.681975 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355b8e4-93ff-47a2-bc61-211a3a63c979 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:37.686515 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-5355b8e4-93ff-47a2-bc61-211a3a63c979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:37.790696 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355b8e4-93ff-47a2-bc61-211a3a63c979 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:37.799243 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887efd4-c8bd-495d-816e-da2a765b3d7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:37.800201 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887efd4-c8bd-495d-816e-da2a765b3d7e service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:37.800481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887efd4-c8bd-495d-816e-da2a765b3d7e service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:37.800751 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887efd4-c8bd-495d-816e-da2a765b3d7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:37.875164 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887efd4-c8bd-495d-816e-da2a765b3d7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:37.876941 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887efd4-c8bd-495d-816e-da2a765b3d7e service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:37.887758 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1488/2968] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:58:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:58:39.379526 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6e2c-2e12-423a-a445-ffdfb35a1587 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:39.380000 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6e2c-2e12-423a-a445-ffdfb35a1587 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:39.380104 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6e2c-2e12-423a-a445-ffdfb35a1587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:39.399577 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-7fdb6e2c-2e12-423a-a445-ffdfb35a1587 None None] MFA Rules not processed for user `1ac077804c5d4d009db7aaad4b704ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:58:39.400819 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7fdb6e2c-2e12-423a-a445-ffdfb35a1587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:39.408891 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1481/2969] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 01:58:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:58:42.677995 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887efd4-c8bd-495d-816e-da2a765b3d7e service nova] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:42.679865 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-d887efd4-c8bd-495d-816e-da2a765b3d7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:42.708783 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887efd4-c8bd-495d-816e-da2a765b3d7e service nova] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:42.714790 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78139b-cbdd-4b21-9d5d-42f25c4b3943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:42.715400 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78139b-cbdd-4b21-9d5d-42f25c4b3943 service nova] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:42.715676 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78139b-cbdd-4b21-9d5d-42f25c4b3943 service nova] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:42.715969 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78139b-cbdd-4b21-9d5d-42f25c4b3943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:42.718451 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-4d78139b-cbdd-4b21-9d5d-42f25c4b3943 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:42.731058 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78139b-cbdd-4b21-9d5d-42f25c4b3943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:42.733328 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78139b-cbdd-4b21-9d5d-42f25c4b3943 service nova] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:42.744483 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1489/2970] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:58:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:58:49.394783 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:INSERT=1,keystone:SELECT=73 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:49.839987 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb6e2c-2e12-423a-a445-ffdfb35a1587 None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:49.841421 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7fdb6e2c-2e12-423a-a445-ffdfb35a1587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:49.897705 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb6e2c-2e12-423a-a445-ffdfb35a1587 None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:49.901224 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7433e70-2bb5-4a24-b9ec-4aae2d95791b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:49.901825 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7433e70-2bb5-4a24-b9ec-4aae2d95791b service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:49.902107 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7433e70-2bb5-4a24-b9ec-4aae2d95791b service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:49.902376 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7433e70-2bb5-4a24-b9ec-4aae2d95791b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:49.911952 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7433e70-2bb5-4a24-b9ec-4aae2d95791b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:49.913373 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7433e70-2bb5-4a24-b9ec-4aae2d95791b service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:49.922678 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1482/2971] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:58:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:58:52.739825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=77,keystone:INSERT=2 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:59.918630 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=26 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:38.481965 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317cabc-2945-4661-b8b5-a7869cc47a8c None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:38.482568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317cabc-2945-4661-b8b5-a7869cc47a8c None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:38.482568 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317cabc-2945-4661-b8b5-a7869cc47a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:38.502404 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-1317cabc-2945-4661-b8b5-a7869cc47a8c None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:59:38.503591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1317cabc-2945-4661-b8b5-a7869cc47a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:38.566421 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1490/2972] 10.222.0.33 () {58 vars in 1015 bytes} [Sun Aug 7 01:59:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:59:38.582719 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7433e70-2bb5-4a24-b9ec-4aae2d95791b service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:59:38.584187 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d7433e70-2bb5-4a24-b9ec-4aae2d95791b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:38.599074 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7433e70-2bb5-4a24-b9ec-4aae2d95791b service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:59:38.604669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87649e29-9f8a-4119-a948-f26f7c625027 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:59:38.605271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87649e29-9f8a-4119-a948-f26f7c625027 service placement] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:38.605551 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87649e29-9f8a-4119-a948-f26f7c625027 service placement] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:38.605824 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87649e29-9f8a-4119-a948-f26f7c625027 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:38.615001 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87649e29-9f8a-4119-a948-f26f7c625027 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:59:38.617189 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87649e29-9f8a-4119-a948-f26f7c625027 service placement] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:59:38.627760 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1483/2973] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 01:59:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:59:48.558023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=29 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:48.623490 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=6 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:00:48.798194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c2987-71fa-4fca-8d0c-dcdddd4e46ce None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:00:48.798800 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c2987-71fa-4fca-8d0c-dcdddd4e46ce None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:00:48.798800 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c2987-71fa-4fca-8d0c-dcdddd4e46ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:00:48.818505 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-a11c2987-71fa-4fca-8d0c-dcdddd4e46ce None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:00:48.819714 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-a11c2987-71fa-4fca-8d0c-dcdddd4e46ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:00:48.829612 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1491/2974] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Aug 7 02:00:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 02:00:53.191223 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d1e7-d653-4038-acd1-881328cee81b None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:00:53.191699 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d1e7-d653-4038-acd1-881328cee81b None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:00:53.191806 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d1e7-d653-4038-acd1-881328cee81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:00:53.211834 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-4140d1e7-d653-4038-acd1-881328cee81b None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:00:53.213647 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-4140d1e7-d653-4038-acd1-881328cee81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:00:53.268629 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1484/2975] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 02:00:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:00:53.316153 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0d4be-8dfc-4331-9d92-11e6798d4211 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:00:53.316578 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0d4be-8dfc-4331-9d92-11e6798d4211 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:00:53.316705 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0d4be-8dfc-4331-9d92-11e6798d4211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:00:53.356084 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-44f0d4be-8dfc-4331-9d92-11e6798d4211 None None] MFA Rules not processed for user `04ad38e3598f4b15b74398dbdb9e69b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:00:53.357301 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-44f0d4be-8dfc-4331-9d92-11e6798d4211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:00:53.420037 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1492/2976] 10.222.0.20 () {58 vars in 1040 bytes} [Sun Aug 7 02:00:53 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:00:53.426623 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d1e7-d653-4038-acd1-881328cee81b None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:00:53.439788 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d1e7-d653-4038-acd1-881328cee81b None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:00:53.444750 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59da948-721a-40bb-aa0c-cb53a3f87930 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:00:53.445354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59da948-721a-40bb-aa0c-cb53a3f87930 service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:00:53.445638 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59da948-721a-40bb-aa0c-cb53a3f87930 service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:00:53.445914 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59da948-721a-40bb-aa0c-cb53a3f87930 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:00:53.454483 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59da948-721a-40bb-aa0c-cb53a3f87930 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:00:53.456076 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59da948-721a-40bb-aa0c-cb53a3f87930 service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:00:53.464711 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1485/2977] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 02:00:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:01:02.525391 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dc26a-1d86-425b-abfb-8901dffc598d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:02.525874 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dc26a-1d86-425b-abfb-8901dffc598d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:02.526112 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dc26a-1d86-425b-abfb-8901dffc598d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:02.545358 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-223dc26a-1d86-425b-abfb-8901dffc598d None None] MFA Rules not processed for user `1ac077804c5d4d009db7aaad4b704ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:01:02.546550 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-223dc26a-1d86-425b-abfb-8901dffc598d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:02.553548 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1493/2978] 10.222.0.20 () {58 vars in 958 bytes} [Sun Aug 7 02:01:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:01:02.588542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fd617-b563-42a4-b1ab-55d3d789e82f None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:02.588542 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fd617-b563-42a4-b1ab-55d3d789e82f None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:02.589228 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fd617-b563-42a4-b1ab-55d3d789e82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:02.608841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-ae7fd617-b563-42a4-b1ab-55d3d789e82f None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:01:02.610023 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-ae7fd617-b563-42a4-b1ab-55d3d789e82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:02.619104 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1486/2979] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 02:01:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:01:02.630021 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1baef-423b-4087-b69d-b5ba220e8218 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:02.630331 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1baef-423b-4087-b69d-b5ba220e8218 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:02.630608 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1baef-423b-4087-b69d-b5ba220e8218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:02.668904 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-82e1baef-423b-4087-b69d-b5ba220e8218 None None] MFA Rules not processed for user `345c25e7dd2341bcb4c53d0a5aa36b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:01:02.670050 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-82e1baef-423b-4087-b69d-b5ba220e8218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:02.722330 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1494/2980] 10.222.0.20 () {58 vars in 1063 bytes} [Sun Aug 7 02:01:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:01:02.728968 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fd617-b563-42a4-b1ab-55d3d789e82f None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:01:02.738418 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fd617-b563-42a4-b1ab-55d3d789e82f None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:01:02.742145 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5630b-c507-4b05-912d-8c88e6078535 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '345c25e7dd2341bcb4c53d0a5aa36b9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:01:02.742748 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5630b-c507-4b05-912d-8c88e6078535 service glance] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:02.743031 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5630b-c507-4b05-912d-8c88e6078535 service glance] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:02.743412 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5630b-c507-4b05-912d-8c88e6078535 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:02.753758 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5630b-c507-4b05-912d-8c88e6078535 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:01:02.755156 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5630b-c507-4b05-912d-8c88e6078535 service glance] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:01:02.765737 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1487/2981] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 02:01:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:01:03.046734 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1baef-423b-4087-b69d-b5ba220e8218 None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:01:03.056654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1baef-423b-4087-b69d-b5ba220e8218 None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:01:03.060426 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439cff4-7cd2-4697-8b5c-06c89230e984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:01:03.061026 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439cff4-7cd2-4697-8b5c-06c89230e984 service neutron] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:03.061308 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439cff4-7cd2-4697-8b5c-06c89230e984 service neutron] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:03.061583 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439cff4-7cd2-4697-8b5c-06c89230e984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:03.063328 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1439cff4-7cd2-4697-8b5c-06c89230e984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:03.073591 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439cff4-7cd2-4697-8b5c-06c89230e984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:01:03.075023 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439cff4-7cd2-4697-8b5c-06c89230e984 service neutron] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:01:03.082914 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1495/2982] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 02:01:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:01:04.416935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201602a-18c1-4f64-a962-a80c36ebf94e None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:04.417468 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201602a-18c1-4f64-a962-a80c36ebf94e None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:04.417580 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201602a-18c1-4f64-a962-a80c36ebf94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:04.438103 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-3201602a-18c1-4f64-a962-a80c36ebf94e None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:01:04.439299 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-3201602a-18c1-4f64-a962-a80c36ebf94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:04.448970 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1488/2983] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Aug 7 02:01:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:01:04.454456 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305da79-c879-44de-9dc8-1eae51c57da2 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:04.454978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305da79-c879-44de-9dc8-1eae51c57da2 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:04.454978 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305da79-c879-44de-9dc8-1eae51c57da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:04.478383 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-1305da79-c879-44de-9dc8-1eae51c57da2 None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:01:04.479761 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-1305da79-c879-44de-9dc8-1eae51c57da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:04.489983 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1496/2984] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 02:01:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:01:04.501603 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201602a-18c1-4f64-a962-a80c36ebf94e None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:01:04.514354 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201602a-18c1-4f64-a962-a80c36ebf94e None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:01:04.517964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbf6ea-ddc3-41b5-a3ee-7c09047a632d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:01:04.518724 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbf6ea-ddc3-41b5-a3ee-7c09047a632d service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:04.519156 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbf6ea-ddc3-41b5-a3ee-7c09047a632d service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:04.519475 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbf6ea-ddc3-41b5-a3ee-7c09047a632d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:04.531296 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbf6ea-ddc3-41b5-a3ee-7c09047a632d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:01:04.532746 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbf6ea-ddc3-41b5-a3ee-7c09047a632d service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:01:04.546458 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1489/2985] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 02:01:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:01:05.678920 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e073cb-e9cb-4717-bf30-a78b17ea0e08 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:05.679429 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e073cb-e9cb-4717-bf30-a78b17ea0e08 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:05.679594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e073cb-e9cb-4717-bf30-a78b17ea0e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:05.702498 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-40e073cb-e9cb-4717-bf30-a78b17ea0e08 None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:01:05.703825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-40e073cb-e9cb-4717-bf30-a78b17ea0e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:05.711516 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1497/2986] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 02:01:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:01:05.736461 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbf6ea-ddc3-41b5-a3ee-7c09047a632d service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:01:05.742167 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbf6ea-ddc3-41b5-a3ee-7c09047a632d service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:01:05.748093 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94031b63-f2b7-43ca-bb08-e8dbc4027695 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:01:05.748696 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94031b63-f2b7-43ca-bb08-e8dbc4027695 service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:05.749159 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94031b63-f2b7-43ca-bb08-e8dbc4027695 service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:05.749430 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94031b63-f2b7-43ca-bb08-e8dbc4027695 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:05.757575 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94031b63-f2b7-43ca-bb08-e8dbc4027695 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:01:05.759920 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94031b63-f2b7-43ca-bb08-e8dbc4027695 service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:01:05.768669 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1490/2987] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 02:01:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:01:15.021511 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286486e-25f3-4923-a51b-b1e703cb24a5 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:15.022070 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286486e-25f3-4923-a51b-b1e703cb24a5 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:15.022070 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286486e-25f3-4923-a51b-b1e703cb24a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:15.165649 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-7286486e-25f3-4923-a51b-b1e703cb24a5 None None] MFA Rules not processed for user `e393d9c50bbb4f69a48ae635d13b1197`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:01:15.166870 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7286486e-25f3-4923-a51b-b1e703cb24a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:15.174125 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1498/2988] 10.222.0.33 () {58 vars in 1015 bytes} [Sun Aug 7 02:01:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:01:15.198449 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94031b63-f2b7-43ca-bb08-e8dbc4027695 service swift] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:01:15.208048 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94031b63-f2b7-43ca-bb08-e8dbc4027695 service swift] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:01:15.211699 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73afa39-4012-48a2-9628-5d763cf3d188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e393d9c50bbb4f69a48ae635d13b1197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:01:15.212344 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73afa39-4012-48a2-9628-5d763cf3d188 service neutron] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:15.212627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73afa39-4012-48a2-9628-5d763cf3d188 service neutron] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:15.212900 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73afa39-4012-48a2-9628-5d763cf3d188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:15.221522 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73afa39-4012-48a2-9628-5d763cf3d188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:01:15.222939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73afa39-4012-48a2-9628-5d763cf3d188 service neutron] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:01:15.231402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1491/2989] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 02:01:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:01:15.828700 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1f1e4-d8aa-4c51-b9e9-978c8c41376b None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:15.829066 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1f1e4-d8aa-4c51-b9e9-978c8c41376b None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:15.829403 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1f1e4-d8aa-4c51-b9e9-978c8c41376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:15.851781 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-bdb1f1e4-d8aa-4c51-b9e9-978c8c41376b None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:01:15.853002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-bdb1f1e4-d8aa-4c51-b9e9-978c8c41376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:15.863151 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1499/2990] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 02:01:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:01:15.877389 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73afa39-4012-48a2-9628-5d763cf3d188 service neutron] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:01:15.890930 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73afa39-4012-48a2-9628-5d763cf3d188 service neutron] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:01:15.897486 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bd134-18b9-458b-8d82-9068edd2fe7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:01:15.898111 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bd134-18b9-458b-8d82-9068edd2fe7c service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:15.898386 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bd134-18b9-458b-8d82-9068edd2fe7c service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:15.898654 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bd134-18b9-458b-8d82-9068edd2fe7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:15.908643 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bd134-18b9-458b-8d82-9068edd2fe7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:01:15.910334 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bd134-18b9-458b-8d82-9068edd2fe7c service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:01:15.921031 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1492/2991] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 02:01:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:01:25.846263 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=88 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:01:25.916982 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=67 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:02:55.267821 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604e740-c7d3-4205-ae34-74a33a39727c None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:02:55.268384 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604e740-c7d3-4205-ae34-74a33a39727c None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:02:55.268494 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604e740-c7d3-4205-ae34-74a33a39727c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:02:55.327987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e604e740-c7d3-4205-ae34-74a33a39727c None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:02:55.329975 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e604e740-c7d3-4205-ae34-74a33a39727c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:02:55.347070 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1500/2992] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Aug 7 02:02:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:02:55.386639 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bd134-18b9-458b-8d82-9068edd2fe7c service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:02:55.432276 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bd134-18b9-458b-8d82-9068edd2fe7c service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:02:55.437391 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406259bf-5e1a-4ff6-a582-7d810a457a85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:02:55.437995 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406259bf-5e1a-4ff6-a582-7d810a457a85 service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:02:55.438298 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406259bf-5e1a-4ff6-a582-7d810a457a85 service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:02:55.438570 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406259bf-5e1a-4ff6-a582-7d810a457a85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:02:55.446959 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406259bf-5e1a-4ff6-a582-7d810a457a85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:02:55.448555 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406259bf-5e1a-4ff6-a582-7d810a457a85 service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:02:55.457290 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1493/2993] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 02:02:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:02:58.620795 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ada18-2e14-40bd-b275-db1ea72e4ade None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:02:58.621376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ada18-2e14-40bd-b275-db1ea72e4ade None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:02:58.621376 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ada18-2e14-40bd-b275-db1ea72e4ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:02:58.707256 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-455ada18-2e14-40bd-b275-db1ea72e4ade None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:02:58.709013 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-455ada18-2e14-40bd-b275-db1ea72e4ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:02:58.720466 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1501/2994] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 02:02:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:02:58.836602 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406259bf-5e1a-4ff6-a582-7d810a457a85 service swift] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:02:58.848964 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406259bf-5e1a-4ff6-a582-7d810a457a85 service swift] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:02:58.855004 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221a732-8996-456d-bcfc-41d62f4d5104 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:02:58.855627 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221a732-8996-456d-bcfc-41d62f4d5104 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:02:58.855991 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221a732-8996-456d-bcfc-41d62f4d5104 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:02:58.856278 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221a732-8996-456d-bcfc-41d62f4d5104 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:02:58.867565 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221a732-8996-456d-bcfc-41d62f4d5104 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:02:58.869379 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221a732-8996-456d-bcfc-41d62f4d5104 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:02:58.882502 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1494/2995] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 02:02:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:03:04.291654 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878d221-95cd-46b0-b4b9-7f8e672a094d None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:04.292203 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878d221-95cd-46b0-b4b9-7f8e672a094d None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:04.292329 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878d221-95cd-46b0-b4b9-7f8e672a094d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:04.310929 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-c878d221-95cd-46b0-b4b9-7f8e672a094d None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:04.312108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-c878d221-95cd-46b0-b4b9-7f8e672a094d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:04.319420 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1502/2996] 10.222.0.20 () {58 vars in 967 bytes} [Sun Aug 7 02:03:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:04.332295 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221a732-8996-456d-bcfc-41d62f4d5104 service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:04.343210 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221a732-8996-456d-bcfc-41d62f4d5104 service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:04.348793 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db387f-2928-4b95-9b77-59b8cc883b7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:04.349383 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db387f-2928-4b95-9b77-59b8cc883b7c service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:04.349664 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db387f-2928-4b95-9b77-59b8cc883b7c service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:04.349935 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db387f-2928-4b95-9b77-59b8cc883b7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:04.357919 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db387f-2928-4b95-9b77-59b8cc883b7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:04.360017 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db387f-2928-4b95-9b77-59b8cc883b7c service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:04.368594 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1495/2997] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 02:03:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:03:05.757381 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbcaa6-684c-4baa-a6ac-52cca2e875c4 None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:05.757758 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbcaa6-684c-4baa-a6ac-52cca2e875c4 None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:05.757996 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbcaa6-684c-4baa-a6ac-52cca2e875c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:05.781015 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-13fbcaa6-684c-4baa-a6ac-52cca2e875c4 None None] MFA Rules not processed for user `20b8a995891f46f1ab1672836752cc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:05.783199 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-13fbcaa6-684c-4baa-a6ac-52cca2e875c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:05.792865 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1503/2998] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 02:03:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:05.807939 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db387f-2928-4b95-9b77-59b8cc883b7c service swift] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:05.820514 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db387f-2928-4b95-9b77-59b8cc883b7c service swift] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:05.825961 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95cd65-c97a-48e4-94b9-d9ffaa197798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20b8a995891f46f1ab1672836752cc4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:05.826809 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95cd65-c97a-48e4-94b9-d9ffaa197798 service nova] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:05.827094 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95cd65-c97a-48e4-94b9-d9ffaa197798 service nova] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:05.827367 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95cd65-c97a-48e4-94b9-d9ffaa197798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:05.837277 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95cd65-c97a-48e4-94b9-d9ffaa197798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:05.838854 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95cd65-c97a-48e4-94b9-d9ffaa197798 service nova] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:05.851506 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1496/2999] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 02:03:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:03:09.451792 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b0a9d-f332-40a3-99a7-7eaf7bed067f None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:09.452258 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b0a9d-f332-40a3-99a7-7eaf7bed067f None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:09.452373 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b0a9d-f332-40a3-99a7-7eaf7bed067f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:09.470753 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-b94b0a9d-f332-40a3-99a7-7eaf7bed067f None None] MFA Rules not processed for user `d89e8e9616b34203a3fa71611fed1665`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:09.471987 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-b94b0a9d-f332-40a3-99a7-7eaf7bed067f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:09.479267 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1504/3000] 10.222.0.20 () {58 vars in 967 bytes} [Sun Aug 7 02:03:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:09.491745 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95cd65-c97a-48e4-94b9-d9ffaa197798 service nova] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:09.503291 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95cd65-c97a-48e4-94b9-d9ffaa197798 service nova] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:09.508250 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b803e-4e6e-410f-9aee-f58f8fd016ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04ad38e3598f4b15b74398dbdb9e69b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:09.508925 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b803e-4e6e-410f-9aee-f58f8fd016ac service swift] REQUEST_METHOD: `GET` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:09.509205 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b803e-4e6e-410f-9aee-f58f8fd016ac service swift] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:09.509474 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b803e-4e6e-410f-9aee-f58f8fd016ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:09.517363 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b803e-4e6e-410f-9aee-f58f8fd016ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:09.518922 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b803e-4e6e-410f-9aee-f58f8fd016ac service swift] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:09.526922 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1497/3001] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Aug 7 02:03:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:03:18.030128 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e049d-558b-41f7-903d-cdf3177d42ec None None] REQUEST_METHOD: `POST` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:18.030661 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e049d-558b-41f7-903d-cdf3177d42ec None None] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:18.030877 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e049d-558b-41f7-903d-cdf3177d42ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:18.038541 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=45 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:18.063304 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.auth.core [None req-e65e049d-558b-41f7-903d-cdf3177d42ec None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:18.065067 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-e65e049d-558b-41f7-903d-cdf3177d42ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:18.086617 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1505/3002] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Aug 7 02:03:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:18.111640 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed19d5-a148-4533-bfb7-116e24f335ba None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:18.112184 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed19d5-a148-4533-bfb7-116e24f335ba None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:18.112288 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed19d5-a148-4533-bfb7-116e24f335ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:18.120053 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=44 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:18.134598 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-d4ed19d5-a148-4533-bfb7-116e24f335ba None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:18.135826 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-d4ed19d5-a148-4533-bfb7-116e24f335ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:18.145300 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1498/3003] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Aug 7 02:03:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:18.151504 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e049d-558b-41f7-903d-cdf3177d42ec None None] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:18.162224 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e049d-558b-41f7-903d-cdf3177d42ec None None] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:18.167411 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076af438-054e-4754-9c76-735ead97e2ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:18.168068 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076af438-054e-4754-9c76-735ead97e2ab service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:18.168351 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076af438-054e-4754-9c76-735ead97e2ab service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:18.168627 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076af438-054e-4754-9c76-735ead97e2ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:18.177998 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076af438-054e-4754-9c76-735ead97e2ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:18.179594 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076af438-054e-4754-9c76-735ead97e2ab service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:18.190216 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1506/3004] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 02:03:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:03:20.978271 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed19d5-a148-4533-bfb7-116e24f335ba None None] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:21.064753 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed19d5-a148-4533-bfb7-116e24f335ba None None] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:21.069301 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb986fb-e140-4359-8a11-88d03ee4aa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:21.069931 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb986fb-e140-4359-8a11-88d03ee4aa27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:21.070211 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb986fb-e140-4359-8a11-88d03ee4aa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:21.070485 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb986fb-e140-4359-8a11-88d03ee4aa27 admin admin] PATH_INFO: `/v3/users/1ac077804c5d4d009db7aaad4b704ac4` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:21.071593 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb986fb-e140-4359-8a11-88d03ee4aa27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac077804c5d4d009db7aaad4b704ac4)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:21.073544 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb986fb-e140-4359-8a11-88d03ee4aa27 admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:21.119617 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eb986fb-e140-4359-8a11-88d03ee4aa27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac077804c5d4d009db7aaad4b704ac4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.126876 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eb986fb-e140-4359-8a11-88d03ee4aa27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac077804c5d4d009db7aaad4b704ac4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.138940 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eb986fb-e140-4359-8a11-88d03ee4aa27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac077804c5d4d009db7aaad4b704ac4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.145841 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eb986fb-e140-4359-8a11-88d03ee4aa27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac077804c5d4d009db7aaad4b704ac4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.146480 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-7eb986fb-e140-4359-8a11-88d03ee4aa27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac077804c5d4d009db7aaad4b704ac4'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.152451 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1499/3005] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 02:03:20 2022] DELETE /identity/v3/users/1ac077804c5d4d009db7aaad4b704ac4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:03:21.330442 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076af438-054e-4754-9c76-735ead97e2ab service placement] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:21.347941 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076af438-054e-4754-9c76-735ead97e2ab service placement] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:21.403538 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18c61b-a476-447f-8f85-49a3a01cd08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:21.404190 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18c61b-a476-447f-8f85-49a3a01cd08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:21.404467 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18c61b-a476-447f-8f85-49a3a01cd08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:21.404734 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18c61b-a476-447f-8f85-49a3a01cd08b admin admin] PATH_INFO: `/v3/projects/4266153534904996a4a8e2e3b43aa6cf` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:21.405838 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18c61b-a476-447f-8f85-49a3a01cd08b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4266153534904996a4a8e2e3b43aa6cf)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:21.408359 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18c61b-a476-447f-8f85-49a3a01cd08b admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:21.453093 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7d18c61b-a476-447f-8f85-49a3a01cd08b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4266153534904996a4a8e2e3b43aa6cf', 'request_id': 'req-7d18c61b-a476-447f-8f85-49a3a01cd08b'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.459846 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7d18c61b-a476-447f-8f85-49a3a01cd08b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4266153534904996a4a8e2e3b43aa6cf', 'request_id': 'req-7d18c61b-a476-447f-8f85-49a3a01cd08b'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.467106 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7d18c61b-a476-447f-8f85-49a3a01cd08b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4266153534904996a4a8e2e3b43aa6cf', 'request_id': 'req-7d18c61b-a476-447f-8f85-49a3a01cd08b'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.490737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7d18c61b-a476-447f-8f85-49a3a01cd08b admin admin] The token cache is being invalidate because project 4266153534904996a4a8e2e3b43aa6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:03:21.491025 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7d18c61b-a476-447f-8f85-49a3a01cd08b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.491644 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-7d18c61b-a476-447f-8f85-49a3a01cd08b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.493108 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1507/3006] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 02:03:21 2022] DELETE /identity/v3/projects/4266153534904996a4a8e2e3b43aa6cf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:03:21.497151 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb986fb-e140-4359-8a11-88d03ee4aa27 admin admin] Authenticating user token {{(pid=80515) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:21.498582 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-7eb986fb-e140-4359-8a11-88d03ee4aa27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:21.512392 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb986fb-e140-4359-8a11-88d03ee4aa27 admin admin] Validating token access rules against request {{(pid=80515) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:21.563332 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:21.570130 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1827c06-e6f1-4bf7-bfbc-fa63b724b1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80515) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:21.570773 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1827c06-e6f1-4bf7-bfbc-fa63b724b1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:21.571392 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1827c06-e6f1-4bf7-bfbc-fa63b724b1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:21.571713 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1827c06-e6f1-4bf7-bfbc-fa63b724b1ad admin admin] PATH_INFO: `/v3/users/d8f2e777fffb4fd99908da056864c45b` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:21.573030 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1827c06-e6f1-4bf7-bfbc-fa63b724b1ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f2e777fffb4fd99908da056864c45b)` {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:21.575349 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1827c06-e6f1-4bf7-bfbc-fa63b724b1ad admin admin] RBAC: Authorization granted {{(pid=80515) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:21.621402 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f1827c06-e6f1-4bf7-bfbc-fa63b724b1ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f2e777fffb4fd99908da056864c45b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.628727 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f1827c06-e6f1-4bf7-bfbc-fa63b724b1ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f2e777fffb4fd99908da056864c45b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.642287 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f1827c06-e6f1-4bf7-bfbc-fa63b724b1ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f2e777fffb4fd99908da056864c45b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.650291 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f1827c06-e6f1-4bf7-bfbc-fa63b724b1ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f2e777fffb4fd99908da056864c45b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.650989 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.notifications [None req-f1827c06-e6f1-4bf7-bfbc-fa63b724b1ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f2e777fffb4fd99908da056864c45b'} {{(pid=80515) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.656790 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1500/3007] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Aug 7 02:03:21 2022] DELETE /identity/v3/users/d8f2e777fffb4fd99908da056864c45b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:03:21.827472 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18c61b-a476-447f-8f85-49a3a01cd08b admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:21.828991 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-7d18c61b-a476-447f-8f85-49a3a01cd08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:21.842509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18c61b-a476-447f-8f85-49a3a01cd08b admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:21.883011 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:21.900344 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057cc48-d200-406f-adda-51c512638bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aada59ce5bc4a1481277a87a82e45b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348c3b03b0964532b13e1c51a4b097f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:21.900965 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057cc48-d200-406f-adda-51c512638bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:21.901239 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057cc48-d200-406f-adda-51c512638bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:21.901507 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057cc48-d200-406f-adda-51c512638bd8 admin admin] PATH_INFO: `/v3/projects/25fa6866175f4d8c9dd038308ca3a0ca` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:21.902602 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057cc48-d200-406f-adda-51c512638bd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25fa6866175f4d8c9dd038308ca3a0ca)` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:21.904531 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057cc48-d200-406f-adda-51c512638bd8 admin admin] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:21.949194 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8057cc48-d200-406f-adda-51c512638bd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25fa6866175f4d8c9dd038308ca3a0ca', 'request_id': 'req-8057cc48-d200-406f-adda-51c512638bd8'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.955800 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8057cc48-d200-406f-adda-51c512638bd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25fa6866175f4d8c9dd038308ca3a0ca', 'request_id': 'req-8057cc48-d200-406f-adda-51c512638bd8'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.963140 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8057cc48-d200-406f-adda-51c512638bd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25fa6866175f4d8c9dd038308ca3a0ca', 'request_id': 'req-8057cc48-d200-406f-adda-51c512638bd8'} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.973105 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8057cc48-d200-406f-adda-51c512638bd8 admin admin] The token cache is being invalidate because project 25fa6866175f4d8c9dd038308ca3a0ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:03:21.973393 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8057cc48-d200-406f-adda-51c512638bd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.974002 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.notifications [None req-8057cc48-d200-406f-adda-51c512638bd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:21.975450 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1508/3008] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Aug 7 02:03:21 2022] DELETE /identity/v3/projects/25fa6866175f4d8c9dd038308ca3a0ca => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:03:31.653337 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=27,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:31.970791 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=32,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:45.460470 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932e63-4062-4960-a454-e088140c6854 None None] REQUEST_METHOD: `POST` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:45.460927 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932e63-4062-4960-a454-e088140c6854 None None] SCRIPT_NAME: `/identity` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:45.461051 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932e63-4062-4960-a454-e088140c6854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80515) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:45.490322 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.auth.core [None req-18932e63-4062-4960-a454-e088140c6854 None None] MFA Rules not processed for user `f7d9f23893704741bcc8ced0550c0391`. Rule list: `[]` (Enabled: `True`). {{(pid=80515) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:04:45.491510 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG keystone.common.fernet_utils [None req-18932e63-4062-4960-a454-e088140c6854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80515) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:45.575628 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: [pid: 80515|app: 0|req: 1501/3009] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Aug 7 02:04:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:04:45.581825 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057cc48-d200-406f-adda-51c512638bd8 admin admin] Authenticating user token {{(pid=80516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:45.596737 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057cc48-d200-406f-adda-51c512638bd8 admin admin] Validating token access rules against request {{(pid=80516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:45.602481 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e82d46-f649-44e9-8db7-b3d61f7cc03f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7d9f23893704741bcc8ced0550c0391', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b9f64c951f44fd48eedc312b1f33694', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:45.603080 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e82d46-f649-44e9-8db7-b3d61f7cc03f service placement] REQUEST_METHOD: `GET` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:45.603355 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e82d46-f649-44e9-8db7-b3d61f7cc03f service placement] SCRIPT_NAME: `/identity` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:45.603622 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e82d46-f649-44e9-8db7-b3d61f7cc03f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:45.605509 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.fernet_utils [None req-48e82d46-f649-44e9-8db7-b3d61f7cc03f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:45.617523 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e82d46-f649-44e9-8db7-b3d61f7cc03f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:45.619103 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e82d46-f649-44e9-8db7-b3d61f7cc03f service placement] RBAC: Authorization granted {{(pid=80516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:45.628694 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: [pid: 80516|app: 0|req: 1509/3010] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Aug 7 02:04:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:04:55.573568 dv-neutron-master-2-hyperv devstack@keystone.service[80515]: DEBUG dbcounter [-] [80515] Writing DB stats keystone:SELECT=42 {{(pid=80515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:55.624695 dv-neutron-master-2-hyperv devstack@keystone.service[80516]: DEBUG dbcounter [-] [80516] Writing DB stats keystone:SELECT=8 {{(pid=80516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}